-- Logs begin at Mon 2022-10-10 09:51:27 UTC, end at Mon 2022-10-10 12:13:52 UTC. -- Oct 10 10:26:49.598360 n-d-860687-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 10:26:49.606056 n-d-860687-2 devstack@n-api.service[106494]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 10:26:49 2022] *** Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: nodename: n-d-860687-2 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: machine: x86_64 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: clock source: unix Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: pcre jit disabled Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: detected number of CPU cores: 4 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: current working directory: / Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: detected binary path: /usr/bin/uwsgi-core Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: your processes number limit is 47680 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: your memory page size is 4096 bytes Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: detected max file descriptor number: 2048 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: lock engine: pthread robust mutexes Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: thunder lock: enabled Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 10:26:49.610287 n-d-860687-2 devstack@n-api.service[106494]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 10:26:49.648972 n-d-860687-2 devstack@n-api.service[106494]: Python main interpreter initialized at 0x55dad6d7a9c0 Oct 10 10:26:49.648972 n-d-860687-2 devstack@n-api.service[106494]: python threads support enabled Oct 10 10:26:49.648972 n-d-860687-2 devstack@n-api.service[106494]: your server socket listen backlog is limited to 100 connections Oct 10 10:26:49.648972 n-d-860687-2 devstack@n-api.service[106494]: your mercy for graceful operations on workers is 90 seconds Oct 10 10:26:49.649333 n-d-860687-2 devstack@n-api.service[106494]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 10:26:49.649333 n-d-860687-2 devstack@n-api.service[106494]: *** Operational MODE: preforking *** Oct 10 10:26:49.649573 n-d-860687-2 devstack@n-api.service[106494]: *** uWSGI is running in multiple interpreter mode *** Oct 10 10:26:49.649573 n-d-860687-2 devstack@n-api.service[106494]: spawned uWSGI master process (pid: 106494) Oct 10 10:26:49.649768 n-d-860687-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 10:26:49.650623 n-d-860687-2 devstack@n-api.service[106494]: spawned uWSGI worker 1 (pid: 106495, cores: 1) Oct 10 10:26:49.650623 n-d-860687-2 devstack@n-api.service[106494]: spawned uWSGI worker 2 (pid: 106496, cores: 1) Oct 10 10:26:49.650804 n-d-860687-2 devstack@n-api.service[106494]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 10:26:50.305656 n-d-860687-2 devstack@n-api.service[106496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 10:26:50.318148 n-d-860687-2 devstack@n-api.service[106495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 10:26:51.382580 n-d-860687-2 devstack@n-api.service[106496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:26:51.382580 n-d-860687-2 devstack@n-api.service[106496]: from cryptography.utils import int_from_bytes Oct 10 10:26:51.383060 n-d-860687-2 devstack@n-api.service[106496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:26:51.383060 n-d-860687-2 devstack@n-api.service[106496]: from cryptography.utils import int_from_bytes Oct 10 10:26:51.399453 n-d-860687-2 devstack@n-api.service[106495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:26:51.399453 n-d-860687-2 devstack@n-api.service[106495]: from cryptography.utils import int_from_bytes Oct 10 10:26:51.399904 n-d-860687-2 devstack@n-api.service[106495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:26:51.399904 n-d-860687-2 devstack@n-api.service[106495]: from cryptography.utils import int_from_bytes Oct 10 10:26:53.842317 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 10:26:53.842900 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 10:26:53.843114 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 10:26:53.843473 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 10:26:53.843727 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 10:26:53.844112 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.844432 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.844612 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 10:26:53.845012 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.845149 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 10:26:53.845271 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.845414 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.845532 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 10:26:53.845652 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.845779 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 10:26:53.845965 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.846098 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 10:26:53.846277 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.846398 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.846600 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.846724 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.846852 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.847069 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.847448 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.847568 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.847744 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.847881 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848061 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848183 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848362 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848483 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848665 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848798 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.848979 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849107 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849280 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849404 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849594 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849751 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.849926 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.850045 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.850286 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.850413 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.850880 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.851104 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.851281 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.851441 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.851669 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.851838 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852013 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852175 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852360 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852548 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852738 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852932 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.852932 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853226 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853369 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853556 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853556 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853862 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.853862 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854180 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854180 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854466 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854644 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854763 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.854950 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855151 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855324 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855458 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855638 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855780 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.855908 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.856084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.856212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.856397 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.856563 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.857282 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.857497 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.857641 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.857830 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.857949 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858100 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858218 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858218 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858504 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858628 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858769 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.858897 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859035 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859175 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859293 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859455 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859577 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859707 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.859836 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860011 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860140 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860262 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860379 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860509 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860627 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860747 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.860886 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861007 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861136 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861255 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861374 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861492 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861616 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861767 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.861903 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862029 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862156 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862286 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862461 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862597 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862777 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.862898 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863098 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863218 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863352 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863493 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863627 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863745 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.863954 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864087 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864217 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864351 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864477 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864596 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864752 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.864887 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865073 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865204 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865383 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865512 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865692 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.865820 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866032 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866152 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866294 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866422 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866601 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866729 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.866908 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867053 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867236 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867357 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867543 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867673 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867864 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.867985 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868178 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868298 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868472 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868602 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868788 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.868910 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869106 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869226 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869411 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869560 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869716 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.869847 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870025 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870199 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870340 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870478 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870663 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870789 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.870962 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871154 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871285 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871429 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871556 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871861 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.871988 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872116 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872252 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872372 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872498 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872617 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872745 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.872913 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873050 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873247 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873385 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873554 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873687 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873816 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.873953 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874123 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874242 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874388 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874510 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874709 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.874831 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875038 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875162 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875349 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875472 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875658 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875779 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.875959 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876079 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876260 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876388 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876566 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876699 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.876875 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877011 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877179 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877301 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877482 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877614 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877787 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.877918 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878088 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878207 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878395 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878527 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878697 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.878818 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879018 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879147 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879339 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879469 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879644 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879782 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.879945 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880080 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880253 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880391 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880555 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880674 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880861 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.880994 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881176 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881299 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881475 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881609 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881778 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.881911 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882091 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882393 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882513 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882694 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.882830 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883017 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883203 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883379 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883499 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883620 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883764 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.883891 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884009 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884178 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884306 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884463 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884595 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884762 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.884897 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885083 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885203 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885394 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885535 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885699 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.885818 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886002 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886121 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886303 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886422 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886607 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886728 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.886910 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.887098 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.887240 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.887360 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.887527 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.887659 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.888391 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.888796 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.888965 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.889111 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.889424 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.889649 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.889790 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.890032 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.890169 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:26:53.890399 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.890520 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.890698 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.890829 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891071 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891196 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891390 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891512 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891728 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.891863 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.892070 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.892407 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.892589 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.892726 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.892847 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893049 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893382 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893525 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893706 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.893827 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894061 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894217 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894467 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894597 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894718 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894837 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.894962 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.895124 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.895332 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.895675 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.895998 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.896356 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.896801 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.896989 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.897155 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.897323 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.897495 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.897671 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.897848 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898005 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898176 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898344 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898509 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898684 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.898861 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.900898 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901093 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901272 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901442 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901634 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901823 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.901990 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.902160 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.902349 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.902523 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.902692 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.902865 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.903055 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.903249 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.903439 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.904167 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.904426 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.904614 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.904803 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.904997 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.905192 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.905377 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.905576 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.905770 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.905959 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.906143 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.906326 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.906507 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.906709 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.906894 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.907137 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.907137 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.907137 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.907667 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.907874 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.908072 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.908259 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.908443 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.908631 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.908817 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.909007 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.909199 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.909710 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.909914 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.910104 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.910301 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.910483 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.910662 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.910850 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911053 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911238 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911436 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911619 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911800 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.911980 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.912162 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.912344 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.912544 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.912729 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.912920 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.913103 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.913285 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.913498 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.913678 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.913855 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914040 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914218 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914397 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914589 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914768 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.914955 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.915256 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.915451 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.915636 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.915838 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916024 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916216 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916401 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916598 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916782 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.916978 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.917163 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.917359 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.917543 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.917734 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.917927 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.918116 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.918312 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.918499 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.918682 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.918866 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.919085 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.919270 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.919454 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.919647 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.919829 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920010 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920206 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920387 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920569 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920755 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.920946 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921118 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921301 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921465 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921630 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921801 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.921973 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.922160 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.922333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.922517 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.922702 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.923173 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.923372 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.923562 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.923747 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.923926 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.924114 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.924293 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.924487 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.924777 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.924959 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925167 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925352 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925544 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925729 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925927 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925927 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.925927 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.926432 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.926613 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.926812 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927023 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927203 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927396 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927575 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927759 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.927960 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.928154 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.928340 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.928524 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.928712 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.928893 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.929099 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.929296 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.929485 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.929665 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.929847 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930038 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930229 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930412 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930608 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930788 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.930971 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.931265 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.931445 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.931642 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.931832 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.932012 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.932191 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.932392 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.932656 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.932842 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933025 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933400 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933592 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933776 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.933956 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.934133 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.934327 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.934509 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.934708 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.934898 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.935176 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.935514 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.935701 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.935899 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.936223 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.936424 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.936613 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.936795 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.937007 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.937312 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.937511 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.937706 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.937888 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.938078 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.938258 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.938460 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.938652 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.938834 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939037 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939222 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939401 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939596 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939779 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.939961 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.940136 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.940333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.940516 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.940713 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.940905 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.941081 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.941259 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.941449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.941644 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.941825 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942011 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942193 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942383 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942577 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942777 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.942959 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.943167 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.943351 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.943532 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.943717 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.943922 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.944104 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.944286 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.944472 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.944652 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.944832 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945027 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945207 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945389 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945389 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945754 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.945949 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.946137 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.946315 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.946493 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.946672 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.946853 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947070 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947255 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947438 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947620 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947801 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.947984 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.948177 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.948358 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.948538 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.948717 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.948901 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.949094 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.949291 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.949475 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.949664 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.949851 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.950033 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.950209 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.950909 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.951433 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.951631 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.951813 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.951994 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.952186 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.952370 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.952551 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.952735 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.952936 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.953212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.953424 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.953617 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.953805 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.953988 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.954221 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.954406 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.954613 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.954793 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.954981 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.955198 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.955384 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.955570 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.955769 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.955954 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.956150 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.957533 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.958765 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.958949 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.959150 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.959330 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.959514 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.959695 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.959890 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.960076 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.960254 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.960435 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.960624 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.960910 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.961094 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.961283 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.961474 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.961665 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.961845 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962048 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962239 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962415 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962598 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962783 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.962963 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.963176 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.963176 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.963519 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.963704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.963887 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964065 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964261 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964453 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964636 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964817 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.964997 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.965194 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.965372 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.965550 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.965734 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.966000 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.966679 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.966887 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.967158 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.967158 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.967495 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.967674 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.967855 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968054 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968231 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968406 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968581 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968758 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.968945 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.969139 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.969341 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.969522 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.969700 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.969878 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970055 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970243 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970440 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970619 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970798 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.970979 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.971179 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.971179 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.971547 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.971730 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.971907 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972087 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972510 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.972704 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.974084 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.975449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.976779 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.976779 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.977125 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.977320 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.977503 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.977711 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.977908 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978096 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978275 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978453 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978643 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978825 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.978968 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979165 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979341 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979507 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979703 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979894 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.979894 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980249 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980383 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980505 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980627 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980749 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.980880 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981001 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981121 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981243 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981371 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981507 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981661 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981792 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.981912 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982034 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982156 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982296 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982419 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982540 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982661 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982781 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.982919 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983118 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983247 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983377 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983496 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983617 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983739 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983873 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.983992 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984112 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984232 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984361 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984492 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984668 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984798 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.984971 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985107 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985226 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985365 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985486 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985608 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985729 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985849 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.985967 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986106 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986288 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986409 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986409 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986645 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986774 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.986964 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987106 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987231 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987350 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987474 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987614 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987735 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987859 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987981 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.987981 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988227 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988362 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988494 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988615 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988739 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988862 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.988983 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989123 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989244 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989378 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989497 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989620 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989748 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.989882 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990012 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990142 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990260 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990384 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990518 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990638 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990762 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.990895 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991066 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991186 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.991326 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992202 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.992859 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993025 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993146 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993287 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993408 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993528 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993653 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993773 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.993893 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994024 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994153 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994273 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994399 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994527 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994645 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994828 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.994950 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995161 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995293 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995414 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995535 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995667 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995794 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.995915 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996036 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996170 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996359 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996478 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996601 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996722 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996843 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.996964 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997095 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997236 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997361 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997493 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997614 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997748 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.997884 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998003 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998126 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998250 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998382 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998511 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998643 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998773 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.998913 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999060 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999197 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999328 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999447 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999575 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999704 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999825 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:53.999952 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000090 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000209 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000467 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000587 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000712 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000834 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.000966 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001085 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001215 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001337 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001458 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001586 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001716 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001836 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.001958 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002078 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002197 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002197 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002435 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002555 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002685 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002808 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.002929 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003105 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003295 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.003452 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.004333 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005302 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005302 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005302 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005302 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005761 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.005893 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.006159 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.006484 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.006790 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.007143 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.007372 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.007521 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.007694 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.007813 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008059 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008188 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008373 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008510 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008685 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008820 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.008991 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009114 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009314 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009439 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009636 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009770 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.009949 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010073 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010267 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010389 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010594 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010729 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.010916 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.011098 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.011295 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.011562 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.011711 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.011858 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.012016 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.012189 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.012391 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.012511 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.012636 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.013349 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.013480 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.013819 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.013944 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014153 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014276 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014460 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014580 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014787 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.014911 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015122 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015324 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015517 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015639 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015780 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.015945 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016070 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016256 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016379 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016558 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016692 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016854 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.016976 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017176 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017311 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017485 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017627 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017803 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.017928 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018116 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018239 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018437 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018560 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018760 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.018896 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.019093 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.019399 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.019710 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.020016 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.020321 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.020624 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.020965 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.021272 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.021592 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.021925 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.022255 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.022568 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.022902 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023158 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023285 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023504 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023649 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023824 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.023967 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024139 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024264 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024459 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024582 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024763 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.024884 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025069 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025249 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025456 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025659 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025659 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.025913 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026036 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026160 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026296 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026416 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026539 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026721 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.026844 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.027050 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.027322 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.027513 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.027692 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.027939 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.028127 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.028312 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.029071 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.029254 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.029628 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.029812 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.029991 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.030192 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.030436 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.030622 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.030822 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.031043 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.031542 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.032033 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.032467 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.033966 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.033966 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.034500 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.034978 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.035196 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.035427 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.035748 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.036037 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.036188 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.036406 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.036682 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.037020 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.037164 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.037303 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.037731 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.037892 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.038023 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.038343 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.038498 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.038757 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.039095 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.039266 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.039397 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.039730 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.039884 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.040093 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.040378 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.040602 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.040747 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.041006 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.041322 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.041470 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.041674 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.041972 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.042115 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.042364 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.042602 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.042873 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.043071 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.043219 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.043539 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.043779 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.043989 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.044606 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.044817 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.045012 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.045012 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.045379 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.045612 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.045946 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.046183 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.046386 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.046583 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.046859 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.047154 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.047719 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.048137 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.048254 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.048456 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.048761 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.048865 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.049084 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.049282 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.049399 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.049835 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.050051 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.050350 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.050453 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.050679 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.050869 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.051044 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.051349 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.051440 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.051656 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053135 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053249 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053249 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053398 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053488 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053569 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053656 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053741 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053810 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053810 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.053936 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054004 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054070 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054135 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054397 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054561 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054715 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.054946 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.055139 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.055358 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.055651 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.055820 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056046 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056289 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056396 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056635 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056806 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.056965 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.057301 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.057465 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.057616 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.057922 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.058086 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.058239 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059020 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059193 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059193 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059457 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059602 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059602 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.059881 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.060193 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.060443 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.060602 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.060827 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.061030 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.061176 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.061416 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.061569 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.061779 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.062054 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.062212 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.062342 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.062647 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.062798 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.063061 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.063289 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.063490 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.063687 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.063926 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.064125 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.064345 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.064541 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.064751 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.064945 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.065154 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.065354 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.065561 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.065764 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.065974 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.066170 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.066364 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.066562 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.066770 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.066975 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.067228 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.067426 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.067618 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.067919 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.067919 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.068300 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.068497 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.068693 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.068931 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.069142 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.069393 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.069598 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.069805 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.070035 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.070232 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.070445 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.070641 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.070838 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.071079 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.071293 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.071492 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.071702 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.071897 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.072096 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.072290 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.072501 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.072805 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.072805 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.073177 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.073383 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.073595 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.073795 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.073795 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.074283 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.074479 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.074479 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.074849 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.075101 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.075101 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076184 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076382 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076382 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076769 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076987 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.076987 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.077383 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.077580 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.077580 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.077963 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.078171 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.078171 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.078539 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.078734 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.078734 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.079143 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.079361 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.079572 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.079778 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.079778 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.080155 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.080363 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.080571 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.080571 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.080952 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.081152 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.081359 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.081566 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.081764 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.081958 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.082169 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.082366 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.082561 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.082779 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.082976 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.083200 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.083396 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.083593 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.083806 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.084058 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.084255 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.084450 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.084646 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.084855 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.085073 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.085280 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.085476 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.085672 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.085875 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.086071 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.086286 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.086479 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.086674 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.086871 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.087626 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.087819 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088054 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088054 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088440 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088650 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088845 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.088845 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.089234 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.089429 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.089429 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.089800 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.089997 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.090216 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.090413 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.090413 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.090803 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.091658 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.091658 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092061 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092262 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092262 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092709 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092915 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.092915 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.093308 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.093504 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.093504 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.093879 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.094127 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.094127 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.094514 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.094711 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.094711 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.095124 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.095322 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.095322 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.095708 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.095903 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.096097 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.096293 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.096293 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.096688 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.096883 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.097080 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.097521 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.097715 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.097715 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.098104 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.098300 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.098300 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.098667 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.098874 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.099111 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.099309 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.099505 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.099505 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.099883 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100086 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100086 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100473 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100718 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100916 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.100916 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.101285 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.101494 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.101494 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.101872 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.102070 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.102070 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.102449 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.102657 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.102854 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.103120 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.103319 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.103534 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.103748 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.103942 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.104152 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.104413 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.104618 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.104824 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.104824 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.105209 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.105403 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.105403 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.105782 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.105974 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.106183 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.106378 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.106378 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.106782 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.106983 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.107284 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.107599 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.107797 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.107994 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.108190 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.108386 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.108594 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.108788 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.108994 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.109232 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.109437 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.109632 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.109843 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.110041 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.110238 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.110476 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.110686 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.110882 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.111140 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.111338 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.111548 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.111743 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.111940 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.112147 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.112340 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.112540 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.112736 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.112930 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.113126 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.113341 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.113536 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.113747 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.113943 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.114138 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.114387 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.114594 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.114806 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.115063 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.115261 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.115513 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.115732 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.115929 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.116135 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.116343 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.116541 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.116749 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.116962 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.117157 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.117348 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.117543 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.117742 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.117936 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.118145 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.118341 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.118534 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.118731 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.118929 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.119182 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.119381 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.119575 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.119784 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.119981 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.120172 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.120380 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.120579 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.120773 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.120968 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.121165 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.121359 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.121565 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.121761 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.121955 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.122199 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.122397 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.122590 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.122801 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.123036 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.123232 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.123445 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.123646 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.123852 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.124051 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.124245 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.124488 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.124684 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.124684 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125068 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125267 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125475 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125680 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125876 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.125876 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.126268 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.126463 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.126658 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.126867 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.126867 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.127275 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.127491 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.127491 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.127882 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.128076 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.128076 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.128460 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.128658 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.128658 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129038 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129241 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129241 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129649 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129845 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.129845 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.130232 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.130422 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.130769 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.131104 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.131305 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.131504 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.131720 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.131914 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.132127 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.132321 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.132517 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.132730 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.132945 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.133201 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.133458 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.133687 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.133883 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.134081 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.134288 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.134541 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.134752 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.134947 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.135167 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.135362 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.135560 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.135781 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.135977 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.136173 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.136371 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.136371 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.136737 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.136954 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.137216 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.137413 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.137608 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.138497 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.138497 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.138887 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.139231 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.139431 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.139639 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.139837 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.139837 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140217 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140412 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140412 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140787 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140985 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.140985 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.141375 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.141569 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.141569 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.141939 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.142132 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.142340 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.142536 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.142536 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.142906 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.143136 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.143136 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.143600 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.143818 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 10:26:54.144016 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.144407 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.144870 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.145362 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.145873 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.146514 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.147817 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.147817 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.148258 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.150662 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.150662 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.150662 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.150662 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.151451 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.151451 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.151899 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.152408 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.152905 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.153511 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.154572 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.155189 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.155731 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.156296 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.156829 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.157414 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.157951 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.158455 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.159021 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.159604 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.160120 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.160654 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.161168 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.161683 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.162187 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.162694 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.163230 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.163761 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.164280 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.164812 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.165351 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.165861 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.166405 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.166925 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.167497 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.168028 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.168550 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.169124 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.169667 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.170208 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.170774 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.171299 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.171804 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.172312 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.172850 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.173367 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.173886 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.174394 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.174968 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.175538 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.176087 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.176670 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.177227 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.177861 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.178396 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.179044 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.179616 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.180144 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.180713 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.181238 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:26:54.181683 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 10:26:54.295927 n-d-860687-2 devstack@n-api.service[106495]: INFO dbcounter [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Registered counter for database nova_api Oct 10 10:26:54.319249 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_db.sqlalchemy.engines [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.327167 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writer thread running {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.354803 n-d-860687-2 devstack@n-api.service[106496]: INFO dbcounter [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Registered counter for database nova_api Oct 10 10:26:54.375655 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.382538 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.385525 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.context [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=106495) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 10:26:54.390053 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:26:54.390531 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:26:54.392147 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:26:54.392903 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:26:54.393339 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:26:54.395353 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:26:54.397332 n-d-860687-2 devstack@n-api.service[106495]: INFO dbcounter [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Registered counter for database nova_cell0 Oct 10 10:26:54.401357 n-d-860687-2 devstack@n-api.service[106495]: INFO dbcounter [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Registered counter for database nova_cell1 Oct 10 10:26:54.409412 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_db.sqlalchemy.engines [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.410326 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_db.sqlalchemy.engines [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.415331 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writer thread running {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.421208 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writer thread running {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.441255 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.context [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=106496) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 10:26:54.445225 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:26:54.445732 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:26:54.447346 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:26:54.448091 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:26:54.448543 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:26:54.451223 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:26:54.453224 n-d-860687-2 devstack@n-api.service[106496]: INFO dbcounter [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Registered counter for database nova_cell0 Oct 10 10:26:54.457263 n-d-860687-2 devstack@n-api.service[106496]: INFO dbcounter [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Registered counter for database nova_cell1 Oct 10 10:26:54.464435 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.468186 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.470675 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.565090 n-d-860687-2 devstack@n-api.service[106495]: INFO dbcounter [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Registered counter for database nova_cell0 Oct 10 10:26:54.572022 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_db.sqlalchemy.engines [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.576977 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writer thread running {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.613514 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.622405 n-d-860687-2 devstack@n-api.service[106496]: INFO dbcounter [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Registered counter for database nova_cell0 Oct 10 10:26:54.629343 n-d-860687-2 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:26:54.634063 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:26:54.915983 n-d-860687-2 devstack@n-api.service[106495]: WARNING keystonemiddleware.auth_token [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:26:54.923274 n-d-860687-2 devstack@n-api.service[106495]: WARNING keystonemiddleware.auth_token [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:26:54.953946 n-d-860687-2 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:26:54.961346 n-d-860687-2 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:26:55.265289 n-d-860687-2 devstack@n-api.service[106495]: WARNING keystonemiddleware.auth_token [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:26:55.271254 n-d-860687-2 devstack@n-api.service[106495]: WARNING keystonemiddleware.auth_token [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:26:55.276562 n-d-860687-2 devstack@n-api.service[106495]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dad6d7a9c0 pid: 106495 (default app) Oct 10 10:26:55.278804 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:26:55.280020 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001927 Oct 10 10:26:55.280424 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Oct 10 10:26:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:26:55.306742 n-d-860687-2 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:26:55.313424 n-d-860687-2 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7404ebbc-1465-4be3-9f76-911ae1ff73a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:26:55.318713 n-d-860687-2 devstack@n-api.service[106496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dad6d7a9c0 pid: 106496 (default app) Oct 10 10:28:16.873703 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:16.874733 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 10 10:28:16.875157 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:16.892436 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:16.893078 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell0:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:16.894304 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell1:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:16.895710 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell0:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:17.769342 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-83eb1424-9e52-446a-a12e-1e239cf1364b admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:17.802914 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-83eb1424-9e52-446a-a12e-1e239cf1364b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920988 Oct 10 10:28:17.803706 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:28:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:20.434892 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:20.435954 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-fe69b530-7ae2-4105-bd19-d7fa7d9e157b None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 10 10:28:20.436519 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:20.866951 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-21ae6ac4-1048-4843-a0e4-c4ea2aebdb58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "swap": 0, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:20.914956 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-21ae6ac4-1048-4843-a0e4-c4ea2aebdb58 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.472033 Oct 10 10:28:20.916422 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:28:20.930587 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_api:SELECT=3 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:20.932038 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_cell1:SELECT=3 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:20.933030 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_cell0:SELECT=3 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:20.933874 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:21.152612 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-443e3044-ff8c-4549-92be-8c438db0a990 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:21.221089 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-443e3044-ff8c-4549-92be-8c438db0a990 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295760 Oct 10 10:28:21.222247 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 10 10:28:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:23.864251 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-21ae6ac4-1048-4843-a0e4-c4ea2aebdb58 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:23.865609 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-21ae6ac4-1048-4843-a0e4-c4ea2aebdb58 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Oct 10 10:28:23.866305 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:24.694863 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-f46049e0-37de-40f3-b8bd-d4909773d6d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "ram": 512}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:24.751736 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-f46049e0-37de-40f3-b8bd-d4909773d6d1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.878655 Oct 10 10:28:24.759037 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:24.766757 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-b566db1e-7ff5-4a01-9009-6f912c7842fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:24.840719 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-b566db1e-7ff5-4a01-9009-6f912c7842fc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078229 Oct 10 10:28:24.841319 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 10 10:28:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:27.680468 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-f46049e0-37de-40f3-b8bd-d4909773d6d1 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:27.681601 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-f46049e0-37de-40f3-b8bd-d4909773d6d1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 10 10:28:27.682279 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:28.227362 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4e270fec-9208-4c75-b3d7-3e1092ca424e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:28.247824 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4e270fec-9208-4c75-b3d7-3e1092ca424e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558446 Oct 10 10:28:28.255288 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:28:28.262080 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-f7519f65-2e08-48eb-b28f-c1016f8fb88f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:28.303057 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-f7519f65-2e08-48eb-b28f-c1016f8fb88f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045754 Oct 10 10:28:28.304335 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 10 10:28:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:28:30.945317 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4e270fec-9208-4c75-b3d7-3e1092ca424e admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:30.946346 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4e270fec-9208-4c75-b3d7-3e1092ca424e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 10 10:28:30.949500 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:31.419969 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-073e621a-b3fa-4824-9c26-d541f70624d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:31.440805 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-073e621a-b3fa-4824-9c26-d541f70624d5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486919 Oct 10 10:28:31.441684 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:31.455126 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4205eca4-d614-45e9-9b63-505a35991290 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:31.487567 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4205eca4-d614-45e9-9b63-505a35991290 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037287 Oct 10 10:28:31.488436 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 10 10:28:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:28:34.242003 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-073e621a-b3fa-4824-9c26-d541f70624d5 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:34.243146 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-073e621a-b3fa-4824-9c26-d541f70624d5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Oct 10 10:28:34.245184 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:34.693432 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "swap": 0}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:34.713825 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462055 Oct 10 10:28:34.714366 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:34.726846 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-97190c9e-deae-440b-8545-83fef243508c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:34.752090 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-97190c9e-deae-440b-8545-83fef243508c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029007 Oct 10 10:28:34.752651 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Mon Oct 10 10:28:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:28:37.513430 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:37.514392 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 10 10:28:37.520433 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:37.963649 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-2a794aab-949f-4821-a6b2-349eb02bafd4 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:38.001144 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-2a794aab-949f-4821-a6b2-349eb02bafd4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479017 Oct 10 10:28:38.002131 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:28:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:28:40.694767 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:40.695863 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-961949f5-f441-4a24-b06f-ed31b3b1919c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 10 10:28:40.696273 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:41.130422 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-bb93bfe6-97e4-4645-aaee-2d5c97a306d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:41.155966 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-bb93bfe6-97e4-4645-aaee-2d5c97a306d7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452859 Oct 10 10:28:41.156625 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:28:41.170108 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-44b87d3a-02ff-4358-abe4-7b0e52b257a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:41.199176 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-44b87d3a-02ff-4358-abe4-7b0e52b257a7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033892 Oct 10 10:28:41.199852 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 10 10:28:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:43.913891 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-bb93bfe6-97e4-4645-aaee-2d5c97a306d7 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:43.916561 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-bb93bfe6-97e4-4645-aaee-2d5c97a306d7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Oct 10 10:28:43.917458 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:44.311391 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-35ee6b50-b8e5-475c-8c4d-da5fed866e16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "vcpus": 1, "id": "2", "ram": 2048}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:44.332011 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-35ee6b50-b8e5-475c-8c4d-da5fed866e16 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408649 Oct 10 10:28:44.332566 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:44.345321 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-aada16eb-8e63-4793-a2df-ebb0074da8f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:44.369397 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-aada16eb-8e63-4793-a2df-ebb0074da8f9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027853 Oct 10 10:28:44.369979 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 10 10:28:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:28:46.988189 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-35ee6b50-b8e5-475c-8c4d-da5fed866e16 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:46.989209 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-35ee6b50-b8e5-475c-8c4d-da5fed866e16 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 10 10:28:46.989609 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:47.405883 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9df91b24-519b-4b31-885e-3b1a860567db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:47.428099 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9df91b24-519b-4b31-885e-3b1a860567db admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431973 Oct 10 10:28:47.428663 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:47.441049 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-a6349e0a-dc70-4334-97b2-aa11aefb6beb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:47.445917 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:47.469989 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-a6349e0a-dc70-4334-97b2-aa11aefb6beb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032694 Oct 10 10:28:47.470722 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 10 10:28:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:50.124999 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9df91b24-519b-4b31-885e-3b1a860567db admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:50.126026 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9df91b24-519b-4b31-885e-3b1a860567db admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 10 10:28:50.126430 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:28:50.585542 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-35dae28c-f517-40ee-8ef6-000ccb0be894 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:50.606768 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-35dae28c-f517-40ee-8ef6-000ccb0be894 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473865 Oct 10 10:28:50.607658 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:50.619743 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9a7adc7d-ca79-4cfb-91a2-d81d0e894266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:50.644280 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9a7adc7d-ca79-4cfb-91a2-d81d0e894266 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028062 Oct 10 10:28:50.647366 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 10 10:28:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:28:53.343714 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-35dae28c-f517-40ee-8ef6-000ccb0be894 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:28:53.345982 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-35dae28c-f517-40ee-8ef6-000ccb0be894 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002743 Oct 10 10:28:53.346413 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:28:53.803745 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:53.811212 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:28:53.830210 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477374 Oct 10 10:28:53.830768 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Mon Oct 10 10:28:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:28:53.843750 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-29feb8ad-3dd9-412d-9a61-7922fb953c14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:28:53.882982 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-29feb8ad-3dd9-412d-9a61-7922fb953c14 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042852 Oct 10 10:28:53.884357 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Mon Oct 10 10:28:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:29:15.100042 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:15.101079 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 10 10:29:15.101484 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:15.112726 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:29:15.496958 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-0b3d28ac-7bc2-4a6a-9696-168576537cef admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:15.515821 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-0b3d28ac-7bc2-4a6a-9696-168576537cef admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407486 Oct 10 10:29:15.516282 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:29:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:16.832397 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:16.833413 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-6186c127-9b60-4a57-a16e-c5da101ddda2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 10 10:29:16.833804 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:17.365936 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-957102e2-0a5b-4768-8454-b58e5cd6e827 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:17.372451 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-957102e2-0a5b-4768-8454-b58e5cd6e827 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-957102e2-0a5b-4768-8454-b58e5cd6e827 admin admin] Request method failure captured: Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Accept: application/json Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Connection: keep-alive Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Content-Length: 0 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Host: 10.222.0.16 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: Openstack-System-Scope: None Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: User-Agent: python-novaclient Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjQ_P8MdMnnvsSxmbEW7aAr27AzTDIDF-n7Cib6EA1-I4zz2FcVHCFyu9wPO-D58Jf1NxC9m1Vctup_xRKH_Q5RFy8Tn2VXYqwmu6etX-RKr4XTH-fTwMexCvk9EhizBU68hkmy7ndN_O23pM5mRhv_bTGi5y7jlN5wgCORAh-PmXQd_w Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Id: None Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Name: None Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Is-Admin-Project: True Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Id: default Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Name: admin Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Role: admin,member,reader Oct 10 10:29:17.376152 n-d-860687-2 devstack@n-api.service[106496]: X-Roles: admin,member,reader Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant: admin Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Name: admin Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-User: admin Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Id: default Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Name: Default Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: X-User-Name: admin Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: method: > Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: exception: Flavor 42 could not be found. Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: action_args: {'id': '42'} Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:17.377643 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:17.378631 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.380114 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-957102e2-0a5b-4768-8454-b58e5cd6e827 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:17.381307 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-957102e2-0a5b-4768-8454-b58e5cd6e827 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391778 Oct 10 10:29:17.381307 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 10 10:29:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:29:17.389887 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-43250463-86d6-44db-8abe-b042bfc14954 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:17.417298 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-43250463-86d6-44db-8abe-b042bfc14954 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.031375 Oct 10 10:29:17.417887 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:17.435503 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4509496d-2c45-4f21-ac62-3095e5108419 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:17.457656 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4509496d-2c45-4f21-ac62-3095e5108419 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027521 Oct 10 10:29:17.458195 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:17.468574 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-021a8493-27b1-458e-990e-19ae67df7988 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:17.474025 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.wsgi [None req-021a8493-27b1-458e-990e-19ae67df7988 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-021a8493-27b1-458e-990e-19ae67df7988 admin admin] Request method failure captured: Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Accept: application/json Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Accept-Encoding: gzip, deflate Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Connection: keep-alive Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Content-Length: 0 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Host: 10.222.0.16 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: Openstack-System-Scope: None Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: User-Agent: python-novaclient Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Auth-Token: gAAAAABjQ_P8MdMnnvsSxmbEW7aAr27AzTDIDF-n7Cib6EA1-I4zz2FcVHCFyu9wPO-D58Jf1NxC9m1Vctup_xRKH_Q5RFy8Tn2VXYqwmu6etX-RKr4XTH-fTwMexCvk9EhizBU68hkmy7ndN_O23pM5mRhv_bTGi5y7jlN5wgCORAh-PmXQd_w Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Id: None Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Name: None Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Identity-Status: Confirmed Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Is-Admin-Project: True Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Id: default Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Name: Default Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Name: admin Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Role: admin,member,reader Oct 10 10:29:17.477887 n-d-860687-2 devstack@n-api.service[106495]: X-Roles: admin,member,reader Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant: admin Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Name: admin Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-User: admin Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Id: default Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Name: Default Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: X-User-Name: admin Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: method: > Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: exception: Flavor 42 could not be found. Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: action_args: {'id': '42'} Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:17.479536 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:17.480391 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:17.481468 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-021a8493-27b1-458e-990e-19ae67df7988 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:17.482527 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-021a8493-27b1-458e-990e-19ae67df7988 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014585 Oct 10 10:29:17.482527 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 10 10:29:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:29:18.683090 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4509496d-2c45-4f21-ac62-3095e5108419 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:18.684134 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4509496d-2c45-4f21-ac62-3095e5108419 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 10 10:29:18.684530 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:19.214649 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-7c16b3f2-b47f-4dad-9e9b-7feb23c612c3 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:19.219643 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.wsgi [None req-7c16b3f2-b47f-4dad-9e9b-7feb23c612c3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-7c16b3f2-b47f-4dad-9e9b-7feb23c612c3 admin admin] Request method failure captured: Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Accept: application/json Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Accept-Encoding: gzip, deflate Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Connection: keep-alive Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Content-Length: 0 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Host: 10.222.0.16 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: Openstack-System-Scope: None Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: User-Agent: python-novaclient Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Auth-Token: gAAAAABjQ_P-RMc5sjW2ViWpvNzkH79SHcwuMnVhwVO2UZtnPAFuUF9I3oIfDHd09w1-VgStNNawWwBfw9y831sHIwSD2ouoSA4uBWETylC3Oaa5aDpLgE2-gWI-Bmbu3LRbbcmmx_GwRCngLfzDn2PdWCSSO121uL9IFwhZA76IlYSbwjjfcHI Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Id: None Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Name: None Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Identity-Status: Confirmed Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Is-Admin-Project: True Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Id: default Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Name: Default Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Name: admin Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Role: admin,member,reader Oct 10 10:29:19.221126 n-d-860687-2 devstack@n-api.service[106495]: X-Roles: admin,member,reader Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant: admin Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Name: admin Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-User: admin Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Id: default Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Name: Default Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: X-User-Name: admin Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: method: > Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: exception: Flavor 84 could not be found. Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: action_args: {'id': '84'} Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:19.222914 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:19.223852 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.225139 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-7c16b3f2-b47f-4dad-9e9b-7feb23c612c3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:19.226647 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-7c16b3f2-b47f-4dad-9e9b-7feb23c612c3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398285 Oct 10 10:29:19.226647 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 10 10:29:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:29:19.232806 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-0d739455-94fd-4043-96a7-937a4d0c85fb admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:19.248775 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-0d739455-94fd-4043-96a7-937a4d0c85fb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019628 Oct 10 10:29:19.249297 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:19.259348 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9d0d83bf-81a6-4216-9c30-50cf7517a2c0 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:19.274924 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9d0d83bf-81a6-4216-9c30-50cf7517a2c0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019885 Oct 10 10:29:19.275478 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:19.284588 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-269e6360-d634-4d6c-92df-5d6894da9842 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:19.289554 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-269e6360-d634-4d6c-92df-5d6894da9842 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-269e6360-d634-4d6c-92df-5d6894da9842 admin admin] Request method failure captured: Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Accept: application/json Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Connection: keep-alive Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Content-Length: 0 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Host: 10.222.0.16 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: Openstack-System-Scope: None Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: User-Agent: python-novaclient Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjQ_P-RMc5sjW2ViWpvNzkH79SHcwuMnVhwVO2UZtnPAFuUF9I3oIfDHd09w1-VgStNNawWwBfw9y831sHIwSD2ouoSA4uBWETylC3Oaa5aDpLgE2-gWI-Bmbu3LRbbcmmx_GwRCngLfzDn2PdWCSSO121uL9IFwhZA76IlYSbwjjfcHI Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Id: None Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Name: None Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Is-Admin-Project: True Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Id: default Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Name: admin Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Role: admin,member,reader Oct 10 10:29:19.291137 n-d-860687-2 devstack@n-api.service[106496]: X-Roles: admin,member,reader Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant: admin Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Name: admin Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-User: admin Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Id: default Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Name: Default Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: X-User-Name: admin Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: method: > Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: exception: Flavor 84 could not be found. Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: action_args: {'id': '84'} Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:19.292832 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:19.293829 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:19.295189 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-269e6360-d634-4d6c-92df-5d6894da9842 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:19.296454 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-269e6360-d634-4d6c-92df-5d6894da9842 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011429 Oct 10 10:29:19.296454 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Oct 10 10:29:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 10:29:20.520019 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9d0d83bf-81a6-4216-9c30-50cf7517a2c0 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:20.521050 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9d0d83bf-81a6-4216-9c30-50cf7517a2c0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 10 10:29:20.521447 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:21.038215 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-a169b7ce-3a3f-44c1-afb3-e9024833fd20 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:21.044902 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-a169b7ce-3a3f-44c1-afb3-e9024833fd20 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-a169b7ce-3a3f-44c1-afb3-e9024833fd20 admin admin] Request method failure captured: Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Accept: application/json Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Connection: keep-alive Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Content-Length: 0 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Host: 10.222.0.16 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: Openstack-System-Scope: None Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: User-Agent: python-novaclient Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjQ_QAs0rVlWXwj7jCpIRU_4iZcrS080rWJuQRtNizLv0DPYELf5S_tC4fn4D74Qebk-c17WaAvSENn5psZIKE5Sb77BSDxOPcKqo5wjTIxEgpB3ZgpCqP8_e7ILAtXM9VZvwW-f_RVrP0RWPGJqi5UWFjrNhyyRPQBzZqeiJJhP6emLQ Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Id: None Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Domain-Name: None Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Is-Admin-Project: True Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Id: default Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Project-Name: admin Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Role: admin,member,reader Oct 10 10:29:21.046477 n-d-860687-2 devstack@n-api.service[106496]: X-Roles: admin,member,reader Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant: admin Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-Tenant-Name: admin Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-User: admin Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Id: default Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-User-Domain-Name: Default Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: X-User-Name: admin Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: method: > Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: exception: Flavor 451 could not be found. Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: action_args: {'id': '451'} Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:21.048055 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:21.048923 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.049972 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-a169b7ce-3a3f-44c1-afb3-e9024833fd20 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:21.050979 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-a169b7ce-3a3f-44c1-afb3-e9024833fd20 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389604 Oct 10 10:29:21.050979 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:29:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:29:21.058387 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-a2c8d2d9-ac8c-43f3-a20c-e56aed18f5d1 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:21.074731 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-a2c8d2d9-ac8c-43f3-a20c-e56aed18f5d1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020492 Oct 10 10:29:21.075303 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:21.084627 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:21.100894 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019725 Oct 10 10:29:21.101415 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Oct 10 10:29:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:29:21.111098 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-5882c548-82ce-4ee3-bd27-c4db27f9fd73 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:21.115968 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.wsgi [None req-5882c548-82ce-4ee3-bd27-c4db27f9fd73 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-5882c548-82ce-4ee3-bd27-c4db27f9fd73 admin admin] Request method failure captured: Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Accept: application/json Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Accept-Encoding: gzip, deflate Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Connection: keep-alive Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Content-Length: 0 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Host: 10.222.0.16 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Openstack-Api-Version: compute 2.92 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: Openstack-System-Scope: None Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: User-Agent: python-novaclient Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Auth-Token: gAAAAABjQ_QAs0rVlWXwj7jCpIRU_4iZcrS080rWJuQRtNizLv0DPYELf5S_tC4fn4D74Qebk-c17WaAvSENn5psZIKE5Sb77BSDxOPcKqo5wjTIxEgpB3ZgpCqP8_e7ILAtXM9VZvwW-f_RVrP0RWPGJqi5UWFjrNhyyRPQBzZqeiJJhP6emLQ Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Id: None Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Domain-Name: None Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Identity-Status: Confirmed Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Is-Admin-Project: True Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Id: default Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Domain-Name: Default Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Project-Name: admin Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Role: admin,member,reader Oct 10 10:29:21.117511 n-d-860687-2 devstack@n-api.service[106495]: X-Roles: admin,member,reader Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b4a24c48f148435084e4b435cdbb4693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b4a24c48f148435084e4b435cdbb4693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b4a24c48f148435084e4b435cdbb4693"}]}] Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant: admin Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Id: b4a24c48f148435084e4b435cdbb4693 Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-Tenant-Name: admin Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-User: admin Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Id: default Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-User-Domain-Name: Default Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-User-Id: 48f5a34cfe514fbea43c4e8c1d052039 Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: X-User-Name: admin Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: method: > Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: exception: Flavor 451 could not be found. Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: action_args: {'id': '451'} Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:29:21.119097 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:21.120079 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: ERROR nova.api.openstack.wsgi Oct 10 10:29:21.121376 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-5882c548-82ce-4ee3-bd27-c4db27f9fd73 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:29:21.122594 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-5882c548-82ce-4ee3-bd27-c4db27f9fd73 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011346 Oct 10 10:29:21.122594 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:29:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:29:22.445889 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:22.446902 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 10 10:29:22.447321 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:22.961522 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-3b12dc8c-a4df-46ba-9464-063137e03426 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:29:22.981012 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-3b12dc8c-a4df-46ba-9464-063137e03426 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398417 Oct 10 10:29:22.981558 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 10 10:29:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:29:24.195184 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:24.196450 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Oct 10 10:29:24.196839 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:24.719051 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-bdbbe50a-c49d-4570-ab55-811143a9bceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:29:24.737225 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-bdbbe50a-c49d-4570-ab55-811143a9bceb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399227 Oct 10 10:29:24.737763 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 10 10:29:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:29:25.941731 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:25.942750 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 10 10:29:25.943178 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:26.467657 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-3f91ba79-87db-4d28-8158-ee9e08eccae5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:29:26.486149 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-3f91ba79-87db-4d28-8158-ee9e08eccae5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407474 Oct 10 10:29:26.486680 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 10 10:29:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:29:27.716638 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:27.717666 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 10 10:29:27.718051 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:28.240970 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-e152958c-0938-4ff5-a1bd-d52e49129901 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:29:28.260280 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-e152958c-0938-4ff5-a1bd-d52e49129901 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.407376 Oct 10 10:29:28.260758 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Oct 10 10:29:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:29:29.478059 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:29.479087 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 10 10:29:29.479475 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:29:30.000180 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-cec05dd4-bcac-47eb-9f7f-dd833bbab8ab admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:29:30.021125 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-cec05dd4-bcac-47eb-9f7f-dd833bbab8ab admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399769 Oct 10 10:29:30.021660 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 10 10:29:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:30:26.686649 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:26.687713 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-adf4acbf-ad0c-4e32-9533-77da927f7df6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 10 10:30:26.688110 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Mon Oct 10 10:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:30:26.699642 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:30:27.106495 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-ea5634fd-c126-4b32-a278-e091a556dbc8 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:27.129445 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-ea5634fd-c126-4b32-a278-e091a556dbc8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435109 Oct 10 10:30:27.129990 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:30:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:30:27.158696 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=14 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:30:27.162935 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-321f87cc-b928-4cb5-bff8-ba702cfbd844 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:27.171871 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-321f87cc-b928-4cb5-bff8-ba702cfbd844 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014553 Oct 10 10:30:27.172415 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 10 10:30:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:30:27.186398 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-a613302e-d85c-4fb5-b415-96df65e412bd admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:27.193860 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-a613302e-d85c-4fb5-b415-96df65e412bd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011110 Oct 10 10:30:27.194401 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 10 10:30:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:30:27.206350 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:27.214697 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011938 Oct 10 10:30:27.215254 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Mon Oct 10 10:30:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:30:27.228568 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-86f2bd46-576d-4a10-b69b-6824be5ad9b4 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:30:27.236169 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-86f2bd46-576d-4a10-b69b-6824be5ad9b4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012276 Oct 10 10:30:27.236728 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Mon Oct 10 10:30:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:35:43.740680 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:35:43.741705 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 10 10:35:43.742099 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:35:43.884751 n-d-860687-2 devstack@n-api.service[106495]: DEBUG dbcounter [-] [106495] Writing DB stats nova_api:SELECT=6 {{(pid=106495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:35:44.030353 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:35:44.035035 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:35:44.035543 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:35:44.035970 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:35:44.036686 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:35:44.037161 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:35:44.037580 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:35:44.076369 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-9e879f9c-2812-48db-9054-3b913ffa4da9 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.193034 Oct 10 10:35:44.076928 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:35:43 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:35:45.158353 n-d-860687-2 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:35:45.159402 n-d-860687-2 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-de692561-2657-4ffa-bcc6-36f3f4ce7de4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 10 10:35:45.159798 n-d-860687-2 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Oct 10 10:35:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:35:45.351314 n-d-860687-2 devstack@n-api.service[106495]: DEBUG nova.api.openstack.wsgi [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Calling method '>' {{(pid=106495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:35:45.355370 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:35:45.355858 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:35:45.356321 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:35:45.357045 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:35:45.357495 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:35:45.357913 n-d-860687-2 devstack@n-api.service[106495]: DEBUG oslo_concurrency.lockutils [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:35:45.380922 n-d-860687-2 devstack@n-api.service[106495]: INFO nova.api.openstack.requestlog [None req-c2de55cf-d54d-46d0-8cbf-14ac5f16a529 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080867 Oct 10 10:35:45.381152 n-d-860687-2 devstack@n-api.service[106495]: [pid: 106495|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:35:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:36:29.014240 n-d-860687-2 devstack@n-api.service[106494]: Mon Oct 10 10:36:29 2022 - graceful shutdown triggered... Oct 10 10:36:29.014349 n-d-860687-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 10:36:29.015254 n-d-860687-2 devstack@n-api.service[106495]: Gracefully killing worker 1 (pid: 106495)... Oct 10 10:36:29.015924 n-d-860687-2 devstack@n-api.service[106496]: Gracefully killing worker 2 (pid: 106496)... Oct 10 10:36:29.142219 n-d-860687-2 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=4 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:36:30.016034 n-d-860687-2 devstack@n-api.service[106494]: worker 1 buried after 1 seconds Oct 10 10:36:30.016034 n-d-860687-2 devstack@n-api.service[106494]: worker 2 buried after 1 seconds Oct 10 10:36:30.016675 n-d-860687-2 devstack@n-api.service[106494]: goodbye to uWSGI. Oct 10 10:36:30.017549 n-d-860687-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 10 10:36:30.018124 n-d-860687-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 10:36:30.020892 n-d-860687-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 10:36:30.040248 n-d-860687-2 devstack@n-api.service[128787]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 10:36:30 2022] *** Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: nodename: n-d-860687-2 Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: machine: x86_64 Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: clock source: unix Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: pcre jit disabled Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: detected number of CPU cores: 4 Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: current working directory: / Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: detected binary path: /usr/bin/uwsgi-core Oct 10 10:36:30.056495 n-d-860687-2 devstack@n-api.service[128787]: your processes number limit is 47680 Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: your memory page size is 4096 bytes Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: detected max file descriptor number: 2048 Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: lock engine: pthread robust mutexes Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: thunder lock: enabled Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 10:36:30.057370 n-d-860687-2 devstack@n-api.service[128787]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 10:36:30.098788 n-d-860687-2 devstack@n-api.service[128787]: Python main interpreter initialized at 0x564120de39c0 Oct 10 10:36:30.098788 n-d-860687-2 devstack@n-api.service[128787]: python threads support enabled Oct 10 10:36:30.098788 n-d-860687-2 devstack@n-api.service[128787]: your server socket listen backlog is limited to 100 connections Oct 10 10:36:30.098788 n-d-860687-2 devstack@n-api.service[128787]: your mercy for graceful operations on workers is 90 seconds Oct 10 10:36:30.099293 n-d-860687-2 devstack@n-api.service[128787]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 10:36:30.099293 n-d-860687-2 devstack@n-api.service[128787]: *** Operational MODE: preforking *** Oct 10 10:36:30.099508 n-d-860687-2 devstack@n-api.service[128787]: *** uWSGI is running in multiple interpreter mode *** Oct 10 10:36:30.099508 n-d-860687-2 devstack@n-api.service[128787]: spawned uWSGI master process (pid: 128787) Oct 10 10:36:30.099720 n-d-860687-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 10:36:30.100879 n-d-860687-2 devstack@n-api.service[128787]: spawned uWSGI worker 1 (pid: 128800, cores: 1) Oct 10 10:36:30.100879 n-d-860687-2 devstack@n-api.service[128787]: spawned uWSGI worker 2 (pid: 128801, cores: 1) Oct 10 10:36:30.100879 n-d-860687-2 devstack@n-api.service[128787]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 10:36:30.765547 n-d-860687-2 devstack@n-api.service[128800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 10:36:30.766122 n-d-860687-2 devstack@n-api.service[128801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 10:36:31.942162 n-d-860687-2 devstack@n-api.service[128801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:36:31.942162 n-d-860687-2 devstack@n-api.service[128801]: from cryptography.utils import int_from_bytes Oct 10 10:36:31.942896 n-d-860687-2 devstack@n-api.service[128801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:36:31.942896 n-d-860687-2 devstack@n-api.service[128801]: from cryptography.utils import int_from_bytes Oct 10 10:36:31.943333 n-d-860687-2 devstack@n-api.service[128800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:36:31.943333 n-d-860687-2 devstack@n-api.service[128800]: from cryptography.utils import int_from_bytes Oct 10 10:36:31.943333 n-d-860687-2 devstack@n-api.service[128800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 10:36:31.943333 n-d-860687-2 devstack@n-api.service[128800]: from cryptography.utils import int_from_bytes Oct 10 10:36:34.375934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 10:36:34.376631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 10:36:34.376925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 10:36:34.377127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 10:36:34.377391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 10:36:34.377787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.378120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.378447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.378773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.379149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.379472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.379801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.380446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.380446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.380704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.381021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.381525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.381862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.382178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.382496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.382824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.383161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.383496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.383810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.384327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.384795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.385112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.385594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.385864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.386260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.386580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.386913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.387259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.387587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.387896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.388317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.388645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.388971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.389302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.389738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.390048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.390389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.390705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.391060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.391379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.391716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.392046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.392376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.392706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.393016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.393332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.393653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.393980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.394296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.394608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.394867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.395282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.395615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.395950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.396283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.396554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.396800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.397128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.397460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.397777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.398095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.398411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.398725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.399054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.399373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.399686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.399997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.400340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.400659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.401177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.401659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.402165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.402607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.402866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.403207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.403578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.403895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.404209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.404540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.404868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.405181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.405495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.405808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.406137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.406473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.406783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.407064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.407374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.407684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.408012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.408327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.408637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.408948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.409255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.409566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.409879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.410190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.410507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.410819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.411153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.411462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.411772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.412080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.412389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.412727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.413047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.413360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.413670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.413979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.414291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.414623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.414934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.415273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.415600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.415909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.416383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.417266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.417763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.418081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.418412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.418722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.419058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.419384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.419700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.420012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.420319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.420808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.421132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.421439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.421930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.422252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.422562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.422892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.423253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.423571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.423886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.424200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.424530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.424877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.425218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.425317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 10:36:34.425733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 10:36:34.425828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.425920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.426039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 10:36:34.426209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.426404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 10:36:34.426551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.426650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 10:36:34.426876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.427059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.427222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.427379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.427544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.427698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.427880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.428018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.428199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.428352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.428517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.428666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.428834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.428988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.429157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.429307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.429482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.429645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.429819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.429952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.430140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.430277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.430467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.430726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860687-2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.430910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.431047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.431173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.431312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.431439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.431625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.431740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.431951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.432129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.432883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.433055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.433413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.433599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.433772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.433909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.434094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.434422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.434588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.434739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.434908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.435109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.435248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.435399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.435549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.435702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.435838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.435979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.436120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.436293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.436439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.436619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.436765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.436933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.437069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.437259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.437395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.437567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.437711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.437896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.438031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860687-2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.438213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.438350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.438532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.438688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.438851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.438951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.439192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.439317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.439536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.439629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.439857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.439961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.440190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.440282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.440511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.440603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.440833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.440982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.441167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.441286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.441485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.441596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.441801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.441926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.442109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.442207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.442425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.442526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.442738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.442847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.443070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.443171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.443389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.443488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.443701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.443810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.444031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.444130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.444283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.444424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.444675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.444878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.445045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.445201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.445360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.445534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.446006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.446109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.446194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.446270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.446350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.446516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.446667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.446832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.447017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.447177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.447331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.447518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.447692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.447847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.448334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.448442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.448744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.448937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.449100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.449263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.449417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.449560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.449680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.449783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.449904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.450077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.450224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.450318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.450531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.450655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.450851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.451266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.451427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.451693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.451850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.451949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.452047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.452134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.452224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.452346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.452457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.452665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.452768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.453011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.453104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.453341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.453442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.453654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.453754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.453980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.454080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.454304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.454402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.454614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.454706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.454924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.455048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.455262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.455366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.455569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.455724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.455883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.455976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.456199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.456297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.456454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.456555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.456757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.456849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.457063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.457171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.457626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.457771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.457771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.457984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.457984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.458166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.458260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.458353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.458566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.458672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.458877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.459071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.459209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.459302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.459520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.459620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.459830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.459930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.460138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.460236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.460448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.460580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.460754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.460909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.461127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.461312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.461403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.461557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.461712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.461883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.462043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.462190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.462334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.462484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.462636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.462833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.462987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.463178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.463284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.463636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.464031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.464145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.464379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.464486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.464693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.464785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.465011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.465102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.465333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.465432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.465652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.465795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.465964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.466067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.466285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.466382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.466596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.466706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.466908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.467077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.467266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.467369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.467576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.467670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.467893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.468059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.468223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.468376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.468519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.468668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.468819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.468941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.469108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.469227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.469416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.469519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.469725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.469834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.470033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.470384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.470596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.470694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.470906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.471032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.471254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.471418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.471557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.471691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.471938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.472088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.472245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.472396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.472536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.472676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.472824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.472971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.473120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 10:36:34.473259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.473407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.473547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.473715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.473879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.474861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.475939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.476891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.477946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.478877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.479658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.479938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.480995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.481966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.482875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.483625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.483749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.483849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.483942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.484969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.485931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.486882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.487846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.488885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.489837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.490983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.491368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.491476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.491701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.491803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.492065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.492453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.492675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.492780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.493922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.494007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.494085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.494244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.494346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.494557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.495263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.495481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.495794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.496717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.496717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.496907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.497901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.498851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.499996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.500994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.501944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.502980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.503904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.504902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.505985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.506923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.507884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.508915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.509894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.510103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.510186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.511879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.512902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.513893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.514986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.515106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.515332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.515524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.515663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.515757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.516046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.516167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.516298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.516462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.517908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.518554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.519834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.520991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.521936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.522898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.523980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.524176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.524345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.524573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.527813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.528423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.529576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.529720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.529832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.529832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.530923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.531966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.532931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.533875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.534881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.535103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.535288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.535428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.535713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.536908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.537884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.538815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.539821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.540792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.541009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.541113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.541329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.541423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.541694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.542976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.543956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.544180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.544365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.544504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.544686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.544827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.545015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.545427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.545535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.545744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.545848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.546830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.547809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.548967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.549902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.550941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.551952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.552982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.553928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.554950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.555206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.555453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.555563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.555825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.555929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.556212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.556348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.556467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.556580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.556838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.557187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.559981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.560938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.561882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.562846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.563858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.564976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.565131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.565382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.565634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.565807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.565976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.566928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.567992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.568936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.569901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.570860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.571841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.572006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.572168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.572323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.572485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.572650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.573362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.573637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.573806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.573970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.574143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.574307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.574462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.574689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.574862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.575037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.575211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.575388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.575637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.575914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.576866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.577923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.578722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.579911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.580869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.581992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.582939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.583960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.584929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.585084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.585238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.585425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.585607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.585844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.586206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.586448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.586617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.586781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.586937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.587996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.588151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.588318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.589956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.590779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.591094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.591277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.591441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.591606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.591761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.592865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.593953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.594966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.595448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.595618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.595775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.596124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.596377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.596541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.596695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.596864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.597948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.598911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.599185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.599364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.599571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.599733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.599733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.600853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.601855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.602979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.603171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.603334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.603334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.603646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.603842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.604549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.604710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.604873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.605145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.605388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.605545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.605700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.605854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.606015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.606303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.606553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.606722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.606878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.607979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.608144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.608300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.610655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.610836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.611915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.612887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.613879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.614868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.615966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.616127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.616308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.616575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.616813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.617988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.618944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.619239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.619396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.619588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.619811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.620008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.620170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.620334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.620502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.650309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.650847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.651339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.651622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.651870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.652185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.652510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.652696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.652877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.653052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.653243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.653424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.653750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.654892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.655987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.656142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.656540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.656688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.656842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.657921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.658951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.659928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.660892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.661911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.662863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.663162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.663162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.663503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.663503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.663868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.664035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.664310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.664597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.664880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.665162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.665571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.666193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.667682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.667993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.668293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.668509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.668509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.668790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.668927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.669062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.669263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.669473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.669800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.669949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.670928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.671935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.672906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.673364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.674303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.674453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.674600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.674738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.674876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.675784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.676125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.676313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.676573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.676814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.676926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.677972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.678965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.679320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.679475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.679615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.679754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.679991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.680997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.681878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.682016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.682787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.683158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.683158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.683589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.683750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.683893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.684968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.685917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.686076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.686479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.686634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.686774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.687042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.687217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.687416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.687761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.688892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.689031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.690784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.691964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.692945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.693083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.694158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.695351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.696530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.697728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.699121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.700142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.701301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.702321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.703344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.704431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.705425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.706437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.707861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.709143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.710247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.711869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.712887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.714583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.715686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 10:36:34.716909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 10:36:34.729913 n-d-860687-2 devstack@n-api.service[128800]: INFO dbcounter [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Registered counter for database nova_api Oct 10 10:36:34.750873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_db.sqlalchemy.engines [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.757904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writer thread running {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:34.782689 n-d-860687-2 devstack@n-api.service[128801]: INFO dbcounter [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Registered counter for database nova_api Oct 10 10:36:34.804081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.811586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:34.816960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.context [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128800) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 10:36:34.821119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:36:34.821604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:36:34.823262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:36:34.824005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:36:34.824455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:36:34.826511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:36:34.828560 n-d-860687-2 devstack@n-api.service[128800]: INFO dbcounter [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Registered counter for database nova_cell0 Oct 10 10:36:34.832708 n-d-860687-2 devstack@n-api.service[128800]: INFO dbcounter [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Registered counter for database nova_cell1 Oct 10 10:36:34.843167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_db.sqlalchemy.engines [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.843941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_db.sqlalchemy.engines [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.851663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writer thread running {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:34.852949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writer thread running {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:34.868406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.context [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128801) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 10:36:34.872566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:36:34.872983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:36:34.874549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:36:34.875317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:36:34.875770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:36:34.877834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:36:34.879868 n-d-860687-2 devstack@n-api.service[128801]: INFO dbcounter [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Registered counter for database nova_cell0 Oct 10 10:36:34.884019 n-d-860687-2 devstack@n-api.service[128801]: INFO dbcounter [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Registered counter for database nova_cell1 Oct 10 10:36:34.891607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.893921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:34.898931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:34.902207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:35.009581 n-d-860687-2 devstack@n-api.service[128800]: INFO dbcounter [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Registered counter for database nova_cell0 Oct 10 10:36:35.016715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_db.sqlalchemy.engines [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:35.021409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writer thread running {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:35.049457 n-d-860687-2 devstack@n-api.service[128801]: INFO dbcounter [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Registered counter for database nova_cell0 Oct 10 10:36:35.056560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 10:36:35.061957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 10:36:35.341919 n-d-860687-2 devstack@n-api.service[128800]: WARNING keystonemiddleware.auth_token [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:36:35.349461 n-d-860687-2 devstack@n-api.service[128800]: WARNING keystonemiddleware.auth_token [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:36:35.397338 n-d-860687-2 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:36:35.405350 n-d-860687-2 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:36:35.695913 n-d-860687-2 devstack@n-api.service[128800]: WARNING keystonemiddleware.auth_token [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:36:35.702405 n-d-860687-2 devstack@n-api.service[128800]: WARNING keystonemiddleware.auth_token [None req-48cae128-cc87-4b76-b58d-5a37af30d0ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:36:35.707793 n-d-860687-2 devstack@n-api.service[128800]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564120de39c0 pid: 128800 (default app) Oct 10 10:36:35.763429 n-d-860687-2 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 10:36:35.769499 n-d-860687-2 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-bd2d6af1-6505-4acc-89eb-7e855fae2068 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 10:36:35.774848 n-d-860687-2 devstack@n-api.service[128801]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564120de39c0 pid: 128801 (default app) Oct 10 10:37:15.662893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:15.664118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:15.665666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:15.666490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:16.621063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:16.621971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:16.622823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:16.623869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:17.004747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c682e65-08d8-4255-a84b-e22190be2831 tempest-AZAdminNegativeTestJSON-1319110589 tempest-AZAdminNegativeTestJSON-1319110589-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:17.006406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c682e65-08d8-4255-a84b-e22190be2831 tempest-AZAdminNegativeTestJSON-1319110589 tempest-AZAdminNegativeTestJSON-1319110589-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1b42fb38fd6c4fd59a54132718b1ae9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fdc84d6b7f645b9b24d5349b521bd83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c682e65-08d8-4255-a84b-e22190be2831 tempest-AZAdminNegativeTestJSON-1319110589 tempest-AZAdminNegativeTestJSON-1319110589-project] Request method failure captured: Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XZD52xknmkv2wNvQ2bR-N5DX3Gf-UQ4yfOBY6WIWdF6y7fk_4y7ku9IQJsdgjatml3w82mPd-7RJhOpUUKOPbddaD_j5LitlqNDafsrnem4_WZbddPI3kc2dmYgN3YmrvLim_eNkKUjLjFltu_zN2b5TZVQSDahC96MRT2gRcfTGc Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5fdc84d6b7f645b9b24d5349b521bd83 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1319110589 Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:17.010748 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fdc84d6b7f645b9b24d5349b521bd83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fdc84d6b7f645b9b24d5349b521bd83", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fdc84d6b7f645b9b24d5349b521bd83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fdc84d6b7f645b9b24d5349b521bd83"}]}] Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AZAdminNegativeTestJSON-1319110589 Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5fdc84d6b7f645b9b24d5349b521bd83 Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1319110589 Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AZAdminNegativeTestJSON-1319110589-project Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 1b42fb38fd6c4fd59a54132718b1ae9b Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AZAdminNegativeTestJSON-1319110589-project Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 10:37:17.012005 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:17.012625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:17.013578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c682e65-08d8-4255-a84b-e22190be2831 tempest-AZAdminNegativeTestJSON-1319110589 tempest-AZAdminNegativeTestJSON-1319110589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:17.014448 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c682e65-08d8-4255-a84b-e22190be2831 tempest-AZAdminNegativeTestJSON-1319110589 tempest-AZAdminNegativeTestJSON-1319110589-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.355809 Oct 10 10:37:17.014448 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:37:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1358 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:17.251916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ea8ee94-6af1-4145-aa28-985d865a9518 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-473924756", "id": 2131536199, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:17.311868 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ea8ee94-6af1-4145-aa28-985d865a9518 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.297411 Oct 10 10:37:17.313316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2/2] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:37:17 2022] POST /compute/v2.1/flavors => generated 448 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:17.314593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ea8ee94-6af1-4145-aa28-985d865a9518 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:17.315792 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ea8ee94-6af1-4145-aa28-985d865a9518 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001236 Oct 10 10:37:17.316123 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3/3] 10.222.0.16 () {56 vars in 886 bytes} [Mon Oct 10 10:37:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 10:37:17.611702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Calling method '.version_select at 0x7f677edae940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:17.615538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.616016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.616638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.617342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.618582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.619181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.634674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '.version_select at 0x7f677e57b550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:17.642733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128801) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 10:37:17.643671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.644286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.645008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.667415 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d43e90f-ea1e-46c4-b289-35cb30ae58db tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.350074 Oct 10 10:37:17.667988 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:37:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:17.677816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.678801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.679547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.697481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.698064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.698587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.706013 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-528b2311-ddb2-4fc9-b570-5e315e289ea4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.096640 Oct 10 10:37:17.706847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1/5] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:37:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:17.979223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Calling method '.version_select at 0x7f677e3cf820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:17.991711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128800) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 10:37:17.992448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:17.993029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:17.993908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:17.995789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.002790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.003959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.004809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.005757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.006277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.006760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.022711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.023262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.023650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.050120 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-536a992d-021e-4b95-9451-bc1ce587a10d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.341956 Oct 10 10:37:18.055397 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2/6] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:37:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:18.063027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.063506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.063945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.077163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.077705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.078345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.093814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.094430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.095461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.102778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2271a168-9f55-4771-a02d-3ad161984868 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.433069 Oct 10 10:37:18.103412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 5/7] 10.222.0.16 () {60 vars in 1243 bytes} [Mon Oct 10 10:37:17 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:18.209332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Calling method '.version_select at 0x7f677e4f5700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.213921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.214443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.214883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.232245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.232738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.233176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.248402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.248936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.249367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.256272 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f02a527b-9d92-4a0f-86d4-42b7a607eaf7 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.204260 Oct 10 10:37:18.257922 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3/8] 10.222.0.16 () {60 vars in 1208 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:18.273664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f08b09c-3dee-4130-879b-1800a7758b51 tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.297541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f08b09c-3dee-4130-879b-1800a7758b51 tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] 10.222.0.16 "GET /compute/v2.1/flavors/2131536199" status: 200 len: 448 microversion: 2.55 time: 0.193042 Oct 10 10:37:18.298285 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 6/9] 10.222.0.16 () {60 vars in 1199 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/flavors/2131536199 => generated 448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:18.303524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df0841b4-f556-4de2-a8cf-05ffd5902772 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-44314362", "name": "tempest-test_aggregate-1562921678"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:18.325181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-df0841b4-f556-4de2-a8cf-05ffd5902772 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid fdde0b1b-261b-4a90-8e8f-138e49a24fa7 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:18.404730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df0841b4-f556-4de2-a8cf-05ffd5902772 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.105205 Oct 10 10:37:18.406247 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 7/10] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Oct 10 10:37:18 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:18.411474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Calling method '.version_select at 0x7f677e338040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.415484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.416146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.417498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.432593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.433073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.433510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.446619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.447348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.447781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.457808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.458287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.458717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.473790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.474474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.474946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.483343 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2c8f7ab7-5d85-4bff-84ed-4b901de46dc4 tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.075852 Oct 10 10:37:18.490945 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 8/11] 10.222.0.16 () {60 vars in 1222 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:18.496339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f90180d5-19ad-443d-84fb-fe3f7945e8ac tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] Action: 'update', calling method: .version_select at 0x7f677e936dc0>, body: {"flavor": {"description": "new"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:18.543046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f90180d5-19ad-443d-84fb-fe3f7945e8ac tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/2131536199" status: 200 len: 449 microversion: 2.55 time: 0.050879 Oct 10 10:37:18.543671 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 9/12] 10.222.0.16 () {62 vars in 1219 bytes} [Mon Oct 10 10:37:18 2022] PUT /compute/v2.1/flavors/2131536199 => generated 449 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:18.548259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73c0833f-7b1f-4ee7-bf47-a50d60ac7371 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.560979 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73c0833f-7b1f-4ee7-bf47-a50d60ac7371 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.016074 Oct 10 10:37:18.561549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 10/13] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:18.565801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Calling method '.version_select at 0x7f677e30a8b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.569264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.569761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.570206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.589521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.590011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.590454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.596798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0974abba-47ec-4bba-b24c-ccb4247631ee tempest-HypervisorAdminV253TestBase-382735390 tempest-HypervisorAdminV253TestBase-382735390-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/d601c9e6-ad7a-4de0-8c8c-2eae4a5581a2" status: 200 len: 791 microversion: 2.53 time: 0.034306 Oct 10 10:37:18.597391 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 11/14] 10.222.0.16 () {60 vars in 1298 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hypervisors/d601c9e6-ad7a-4de0-8c8c-2eae4a5581a2 => generated 791 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:18.610579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7656199-1bf6-4146-9272-49fb99096adc tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.641568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b30fbb67-2048-41fe-8a58-0a42a27072dd tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Calling method '.version_select at 0x7f677e3eb820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.645412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b30fbb67-2048-41fe-8a58-0a42a27072dd tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b30fbb67-2048-41fe-8a58-0a42a27072dd tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:18.656301 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: action_args: {} Oct 10 10:37:18.657399 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.658086 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 10:37:18.659032 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.660002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b30fbb67-2048-41fe-8a58-0a42a27072dd tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.660002 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b30fbb67-2048-41fe-8a58-0a42a27072dd tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.398127 Oct 10 10:37:18.660002 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 4/15] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 400 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:18.666506 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7656199-1bf6-4146-9272-49fb99096adc tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.061387 Oct 10 10:37:18.668181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 12/16] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:18.670550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36c19d59-405c-4708-84b9-8d66d6b21d6a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:18.679191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea8c845d-9472-408f-a033-5abb9e2e4493 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Calling method '.version_select at 0x7f677da739d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.681874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ea8c845d-9472-408f-a033-5abb9e2e4493 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea8c845d-9472-408f-a033-5abb9e2e4493 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/n-d-860687-2/reboot HTTP/1.1 Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:18.683835 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2'} Oct 10 10:37:18.685686 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.686571 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 10:37:18.687805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.689741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea8c845d-9472-408f-a033-5abb9e2e4493 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.690798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea8c845d-9472-408f-a033-5abb9e2e4493 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-860687-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.021760 Oct 10 10:37:18.691878 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 13/17] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/n-d-860687-2/reboot => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:18.703768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ef352be-9e72-42ea-b6a7-f7a0597ca18e tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.721446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36c19d59-405c-4708-84b9-8d66d6b21d6a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:18.722093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36c19d59-405c-4708-84b9-8d66d6b21d6a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:18.722613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36c19d59-405c-4708-84b9-8d66d6b21d6a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:18.730885 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ef352be-9e72-42ea-b6a7-f7a0597ca18e tempest-FlavorsV255TestJSON-1810634689 tempest-FlavorsV255TestJSON-1810634689-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.037392 Oct 10 10:37:18.732578 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 14/18] 10.222.0.16 () {60 vars in 1166 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:18.748448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7bfeeb7-c648-48e3-a1ff-11cbdaa2ff89 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Calling method '.version_select at 0x7f677da73ee0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.763548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a7bfeeb7-c648-48e3-a1ff-11cbdaa2ff89 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7bfeeb7-c648-48e3-a1ff-11cbdaa2ff89 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:18.769084 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'nonexistent_hostname'} Oct 10 10:37:18.770500 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:18.771336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 10:37:18.772431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.773741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.775994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7bfeeb7-c648-48e3-a1ff-11cbdaa2ff89 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.777878 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7bfeeb7-c648-48e3-a1ff-11cbdaa2ff89 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.043323 Oct 10 10:37:18.778654 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 15/19] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:18.784662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc5abaa0-59e4-4721-950d-51632a7c9ff3 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.839511 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc5abaa0-59e4-4721-950d-51632a7c9ff3 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2131536199" status: 202 len: 0 microversion: 2.55 time: 0.059436 Oct 10 10:37:18.840765 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 16/20] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 10 10:37:18 2022] DELETE /compute/v2.1/flavors/2131536199 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:37:18.846219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d071d043-c0c0-4c68-9493-bdcbb5d40e03 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Calling method '.version_select at 0x7f677d98c820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.848840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d071d043-c0c0-4c68-9493-bdcbb5d40e03 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d071d043-c0c0-4c68-9493-bdcbb5d40e03 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/n-d-860687-2 HTTP/1.1 Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:18.850538 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2'} Oct 10 10:37:18.851726 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.852938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 10:37:18.853890 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.855814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d071d043-c0c0-4c68-9493-bdcbb5d40e03 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.856777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d071d043-c0c0-4c68-9493-bdcbb5d40e03 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-860687-2" status: 403 len: 109 microversion: 2.1 time: 0.014841 Oct 10 10:37:18.857871 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 17/21] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/n-d-860687-2 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:18.866657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b14b6c28-1ddc-4064-8ea2-9a7ef5b1aa23 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.901407 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b14b6c28-1ddc-4064-8ea2-9a7ef5b1aa23 tempest-FlavorsV255TestJSON-1742184623 tempest-FlavorsV255TestJSON-1742184623-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.042403 Oct 10 10:37:18.902544 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 18/22] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:18.907292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b403bf64-09b3-4393-95ab-f73f9b0bab2e tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Calling method '.version_select at 0x7f677e338c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.913656 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b403bf64-09b3-4393-95ab-f73f9b0bab2e tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b403bf64-09b3-4393-95ab-f73f9b0bab2e tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:18.915894 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'nonexistent_hostname'} Oct 10 10:37:18.917037 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.917823 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.918990 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.920904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b403bf64-09b3-4393-95ab-f73f9b0bab2e tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.921795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b403bf64-09b3-4393-95ab-f73f9b0bab2e tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018097 Oct 10 10:37:18.922628 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 19/23] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:18.933821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bd9ede3-7789-4269-82cc-8593e18890db tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Calling method '.version_select at 0x7f677d99c670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.936220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bd9ede3-7789-4269-82cc-8593e18890db tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bd9ede3-7789-4269-82cc-8593e18890db tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/n-d-860687-2/shutdown HTTP/1.1 Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:18.938247 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2'} Oct 10 10:37:18.939656 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.940535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 10:37:18.941942 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.944040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bd9ede3-7789-4269-82cc-8593e18890db tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.945157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bd9ede3-7789-4269-82cc-8593e18890db tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-860687-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016597 Oct 10 10:37:18.950504 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 20/24] 10.222.0.16 () {58 vars in 1194 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/n-d-860687-2/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:37:18.959289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d50bf01-e520-47ad-a47e-f5f691b24f81 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Calling method '.version_select at 0x7f677d99c1f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:18.975541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2d50bf01-e520-47ad-a47e-f5f691b24f81 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d50bf01-e520-47ad-a47e-f5f691b24f81 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:18.977940 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'nonexistent_hostname'} Oct 10 10:37:18.979310 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:18.979988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 10:37:18.980967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:18.981907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d50bf01-e520-47ad-a47e-f5f691b24f81 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:18.982529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2d50bf01-e520-47ad-a47e-f5f691b24f81 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.030980 Oct 10 10:37:18.983311 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 21/25] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:18.994361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7715bd9-c829-4e6e-8b5a-9a785ea4b9e3 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Calling method '.version_select at 0x7f677e2c21f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:19.001379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7715bd9-c829-4e6e-8b5a-9a785ea4b9e3 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7715bd9-c829-4e6e-8b5a-9a785ea4b9e3 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/n-d-860687-2/startup HTTP/1.1 Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:19.002986 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2'} Oct 10 10:37:19.004116 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:19.004756 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 10:37:19.005696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.008080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7715bd9-c829-4e6e-8b5a-9a785ea4b9e3 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.009271 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7715bd9-c829-4e6e-8b5a-9a785ea4b9e3 tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-860687-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.018683 Oct 10 10:37:19.010352 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 22/26] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Oct 10 10:37:18 2022] GET /compute/v2.1/os-hosts/n-d-860687-2/startup => generated 110 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:19.022750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b1c3ce7-8343-4f07-b4e5-9d6b3a50ef92 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Calling method '.version_select at 0x7f677d98c310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:19.034467 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0b1c3ce7-8343-4f07-b4e5-9d6b3a50ef92 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b1c3ce7-8343-4f07-b4e5-9d6b3a50ef92 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:19.036703 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'nonexistent_hostname'} Oct 10 10:37:19.037949 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:19.038715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 10:37:19.040397 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.041504 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.046954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b1c3ce7-8343-4f07-b4e5-9d6b3a50ef92 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.046954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b1c3ce7-8343-4f07-b4e5-9d6b3a50ef92 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030976 Oct 10 10:37:19.049483 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 23/27] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 10 10:37:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:19.064080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67e6550d-5e66-4442-96dc-b68f831f187a tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Action: 'update', calling method: .version_select at 0x7f677d98c1f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67e6550d-5e66-4442-96dc-b68f831f187a tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-hosts/n-d-860687-2 HTTP/1.1 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 51 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:19.084592 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: {"status": "enable", "maintenance_mode": "invalid"} Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.085737 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance: Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.086394 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.089172 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67e6550d-5e66-4442-96dc-b68f831f187a tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.091565 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67e6550d-5e66-4442-96dc-b68f831f187a tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-860687-2" status: 400 len: 199 microversion: 2.1 time: 0.030973 Oct 10 10:37:19.093180 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 24/28] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:19 2022] PUT /compute/v2.1/os-hosts/n-d-860687-2 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:37:19.102158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59ed3121-e2a4-40f2-ab80-039d17a9470d tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Action: 'update', calling method: .version_select at 0x7f677d9995e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59ed3121-e2a4-40f2-ab80-039d17a9470d tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-hosts/n-d-860687-2 HTTP/1.1 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 51 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:19.109205 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: {"status": "invalid", "maintenance_mode": "enable"} Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.110346 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance: Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.112017 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.113347 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59ed3121-e2a4-40f2-ab80-039d17a9470d tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.116232 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59ed3121-e2a4-40f2-ab80-039d17a9470d tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-860687-2" status: 400 len: 189 microversion: 2.1 time: 0.016402 Oct 10 10:37:19.118553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 25/29] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:19 2022] PUT /compute/v2.1/os-hosts/n-d-860687-2 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:37:19.143956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3768faec-95e1-4af3-ad9b-67f0e726646b tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Action: 'update', calling method: .version_select at 0x7f677d99cdc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:19.147930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3768faec-95e1-4af3-ad9b-67f0e726646b tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '4abbd5d407f94c88a909bf0b9f3464ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd05ffbb4db44f6a24c76d9aac2798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3768faec-95e1-4af3-ad9b-67f0e726646b tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Request method failure captured: Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-hosts/n-d-860687-2 HTTP/1.1 Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 50 Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xao1rOBBozHF3kycwJgAHwPwGmwkKHBjnzuevnzTB0zo0st8GPwqYkvB3XPDWD5gGxT6f9mgUomYPmLFrtOBb7eZWjLnUQLqFBOkJ-RBslUhWnAUyzsHIwt5wy10Qg7wx5pQ3yr2rn8Lzc76Vb2h--YJn4H3VfWwmT81bGDgvqZWQ Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:19.162985 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ecd05ffbb4db44f6a24c76d9aac2798a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ecd05ffbb4db44f6a24c76d9aac2798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ecd05ffbb4db44f6a24c76d9aac2798a"}]}] Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ecd05ffbb4db44f6a24c76d9aac2798a Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-941143002 Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4abbd5d407f94c88a909bf0b9f3464ce Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-941143002-project Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 10:37:19.164470 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:19.165786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 10:37:19.167615 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.168821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3768faec-95e1-4af3-ad9b-67f0e726646b tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.168821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3768faec-95e1-4af3-ad9b-67f0e726646b tempest-HostsAdminNegativeTestJSON-941143002 tempest-HostsAdminNegativeTestJSON-941143002-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-860687-2" status: 403 len: 111 microversion: 2.1 time: 0.027263 Oct 10 10:37:19.168821 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 26/30] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:19 2022] PUT /compute/v2.1/os-hosts/n-d-860687-2 => generated 111 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:19.184129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d37cdd6e-091e-459c-b2e3-0316dcdbd85f tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Action: 'update', calling method: .version_select at 0x7f677d94b5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d37cdd6e-091e-459c-b2e3-0316dcdbd85f tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-hosts/n-d-860687-2 HTTP/1.1 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 42 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:19.188486 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: {"status": null, "maintenance_mode": null} Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 10:37:19.189812 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-d-860687-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance: Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi None Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.191384 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.193352 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d37cdd6e-091e-459c-b2e3-0316dcdbd85f tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.194513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d37cdd6e-091e-459c-b2e3-0316dcdbd85f tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-860687-2" status: 400 len: 127 microversion: 2.1 time: 0.021461 Oct 10 10:37:19.198957 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 27/31] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:37:19 2022] PUT /compute/v2.1/os-hosts/n-d-860687-2 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:37:19.207112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Action: 'update', calling method: .version_select at 0x7f677d94bee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:19.217263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.hosts [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Enabling host nonexistent_hostname. Oct 10 10:37:19.229094 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Request method failure captured: Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 50 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XcMirVtqnxlllHi2ZrAEgkXGsuyQem-moyCMjPkc4sGjAxdi5UdrT3eBrayCYmvLoLVzx8AwxDGbXmTfOL8wTaPvmdPMsiQZcyDHzb6PGArF_RsfzsWZ5N9_EGmKOylXg3cqmEB50NMPuAE0N4GtUZyIDvAckHS6YOgQyeuKJaAHU Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:19.230848 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdfb77e94a8a4494b6dfc8f067a46209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdfb77e94a8a4494b6dfc8f067a46209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdfb77e94a8a4494b6dfc8f067a46209"}]}] Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: cdfb77e94a8a4494b6dfc8f067a46209 Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2060130770 Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2f865a3225cd4dcabf77e5b92f0054e7 Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2060130770-project-admin Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.231928 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:19.232721 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:19.237558 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:19.239317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:19.240229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d6e1013-2664-45c1-9696-3d7ae7bfeef2 tempest-HostsAdminNegativeTestJSON-2060130770 tempest-HostsAdminNegativeTestJSON-2060130770-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028773 Oct 10 10:37:19.240229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 28/32] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Oct 10 10:37:19 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:19.616355 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36c19d59-405c-4708-84b9-8d66d6b21d6a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 0.953236 Oct 10 10:37:19.617455 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 5/33] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:20.120279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-58119869", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "availability_zone": "tempest-test_az-44314362"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:20.154275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:20.154769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:20.155244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:20.155974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:20.156430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:20.156851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:21.227667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:37:21.628734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:37:21.629164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:37:21.629699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:37:21.630240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:37:21.630651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:37:21.649172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:21.649761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:21.650205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:21.650983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:21.651462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:21.651883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:21.699376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Getting quotas for project 6175c446137541038f09aaaab284c740. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:37:21.707270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Getting quotas for user 93f8ecd3f474408e8d76257499ccc2e7 and project 6175c446137541038f09aaaab284c740. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:37:21.721505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:37:21.724813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:37:21.810235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c084cf6-c777-43f2-b64c-ec3a67681520 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906982 Oct 10 10:37:21.815867 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 29/34] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:37:21.831609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-835888e2-596d-44ad-a278-631987d6a7b5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:21.832448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-835888e2-596d-44ad-a278-631987d6a7b5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:22.743945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-835888e2-596d-44ad-a278-631987d6a7b5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:22.758686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-835888e2-596d-44ad-a278-631987d6a7b5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1239 microversion: 2.1 time: 0.935000 Oct 10 10:37:22.759470 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 6/35] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:21 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1239 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:23.783592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:23.785933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:23.829964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:23.831420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:23.832608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:23.833530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:23.835781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:23.837989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:23.992038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:24.015564 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36dd521c-dc58-4b53-97f4-542125ba516c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1239 microversion: 2.1 time: 0.237646 Oct 10 10:37:24.017980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 30/36] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:23 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1239 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:24.564301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ead24b6-11aa-4f77-9721-7ca702db38a7 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-117690167", "id": 1318019452, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:24.658432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ead24b6-11aa-4f77-9721-7ca702db38a7 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.628722 Oct 10 10:37:24.659636 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 7/37] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:37:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:24.676649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47420cf2-5955-44ad-89a9-26c173295699 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2718332be56409b88ef541ef926efa1"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:25.043685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:25.044420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:25.058383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:25.059108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:25.059714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:25.060578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:25.061174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:25.061745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:25.497386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:25.522944 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74c36437-5a5f-4034-a80c-85273440ac12 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1293 microversion: 2.1 time: 0.483928 Oct 10 10:37:25.526918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 8/38] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:25 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1293 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:25.528806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47420cf2-5955-44ad-89a9-26c173295699 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1318019452/action" status: 200 len: 97 microversion: 2.1 time: 0.858412 Oct 10 10:37:25.531913 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 31/39] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:37:24 2022] POST /compute/v2.1/flavors/1318019452/action => generated 97 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:37:26.124455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fc644a2-f66d-4e90-88e6-c4728ffd0b94 tempest-FlavorsAccessTestJSON-40474084 tempest-FlavorsAccessTestJSON-40474084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:26.199756 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fc644a2-f66d-4e90-88e6-c4728ffd0b94 tempest-FlavorsAccessTestJSON-40474084 tempest-FlavorsAccessTestJSON-40474084-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.661713 Oct 10 10:37:26.200363 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 9/40] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:25 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:26.220756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96830023-d1d8-4e9e-9c2f-58df24e6721c tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d2718332be56409b88ef541ef926efa1"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:26.533551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Calling method '.version_select at 0x7f677d98c5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:26.536547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:26.537546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:26.538241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:26.575482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:26.614987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:26.616017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:26.616611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:26.673790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:26.677984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:26.678643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:26.704016 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-007e0227-56e6-471a-8d3c-79df549366d4 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.707649 Oct 10 10:37:26.708017 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 32/41] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:26.725039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:26.727382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:26.775268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:26.776590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:26.778716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:26.780361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:26.781630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:26.785163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:27.393583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:27.409027 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3df13bf7-c6f0-4daf-909b-f96a89e28fc0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.694065 Oct 10 10:37:27.427616 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 33/42] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:26 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:27.587192 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96830023-d1d8-4e9e-9c2f-58df24e6721c tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1318019452/action" status: 200 len: 21 microversion: 2.1 time: 1.370425 Oct 10 10:37:27.594970 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 10/43] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:37:26 2022] POST /compute/v2.1/flavors/1318019452/action => generated 21 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:37:27.844367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7949b356-26a9-43f8-b749-08a8b7fc3b16 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Calling method '.version_select at 0x7f677d865310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:27.847354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7949b356-26a9-43f8-b749-08a8b7fc3b16 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '7647c4eadcb043bbb749a0557d8682a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7702d8e0e414643a46914a0b35425c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7949b356-26a9-43f8-b749-08a8b7fc3b16 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Request method failure captured: Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hypervisors/n-h1-860687-2/search HTTP/1.1 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XjEEOCocvT0RNeqliWIJVC-lQ0FL1GPP46pzTZUPE3eOptq765snVmrpiGHvce9pZPZ786MpfQot5vuqsEt1F1Lx5kY-v-F-KfdyXFuctWb4SolHR7SxR5I-jjqboCz9sZ2n0a4QN_f2OE8Di02_fjgu4KNq-_HE1GY9oW2P9ZlKQ Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c7702d8e0e414643a46914a0b35425c0 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:27.849555 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7702d8e0e414643a46914a0b35425c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7702d8e0e414643a46914a0b35425c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7702d8e0e414643a46914a0b35425c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7702d8e0e414643a46914a0b35425c0"}]}] Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c7702d8e0e414643a46914a0b35425c0 Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7647c4eadcb043bbb749a0557d8682a4 Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 10:37:27.850818 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'n-h1-860687-2'} Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:27.851745 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 10:37:27.853213 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:27.855179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7949b356-26a9-43f8-b749-08a8b7fc3b16 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:27.856191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7949b356-26a9-43f8-b749-08a8b7fc3b16 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-860687-2/search" status: 403 len: 117 microversion: 2.1 time: 0.427201 Oct 10 10:37:27.857221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 34/44] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Oct 10 10:37:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-2/search => generated 117 bytes in 429 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:27.863077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ebb0700f-ffa6-4f89-abaf-98244afb7762 tempest-FlavorsAccessTestJSON-40474084 tempest-FlavorsAccessTestJSON-40474084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:27.901139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ebb0700f-ffa6-4f89-abaf-98244afb7762 tempest-FlavorsAccessTestJSON-40474084 tempest-FlavorsAccessTestJSON-40474084-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042552 Oct 10 10:37:27.904539 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 35/45] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:27.977403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677e3d5550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:27.984510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:27.985142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:27.985625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:27.986472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.002298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.003190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.089831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e20276fa-523f-4bcf-87a5-b3bebb6e9bbd tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Action: 'create', calling method: .version_select at 0x7f677d7c90d0>, body: {"keypair": {"name": "tempest-keypair-1639814167", "type": "ssh", "user_id": "5c653148ed2742f585942327584a14dc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZqXIA25g5znZOeOIxVwzgkKc9cHSqVHCdrF/P1tmO9IeG9jINPlv8aKtt+pG/9B8QByIHI+Sq5nVi/z2rb+jIw2cZbrN6X7M7iNqcTnh1fdWcctYV3XaS+DbwhgaOhFw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:28.134566 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a52b713-c003-48dd-8938-3587b4477a33 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 396 microversion: 2.1 time: 0.537066 Oct 10 10:37:28.147075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 11/46] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:37:27 2022] GET /compute/v2.1/os-hosts => generated 396 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:28.165302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Calling method '.version_select at 0x7f677d9fbca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.168943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e20276fa-523f-4bcf-87a5-b3bebb6e9bbd tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:37:28.174268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.176612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.181511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e20276fa-523f-4bcf-87a5-b3bebb6e9bbd tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for user b718f394ff9b443299674678a9745172 and project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:37:28.182393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.215919 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Request method failure captured: Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xls1UeWdm6I_lNq4mt2PI34f9mNqrZxpdYRk2iDkdSooke0jrFOMazOhvSdSe7M52AfbpgAP7JHDx6LYTNeYN1VP_gT6w6dJJ5AlKWZFz0BtaJ-4U1BCVUsrGHodTJSHqkArc_XxMyueI54x8Y61Ad6z4SP33FHzC1l_GqYovbCxI Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e69aca073b3943f68f5117a8aacfc38e Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:28.223817 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e69aca073b3943f68f5117a8aacfc38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e69aca073b3943f68f5117a8aacfc38e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e69aca073b3943f68f5117a8aacfc38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e69aca073b3943f68f5117a8aacfc38e"}]}] Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e69aca073b3943f68f5117a8aacfc38e Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6e63d4fa577342d79c8273b53b10af33 Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 10:37:28.225198 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.225908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.228227 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.228227 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:28.228227 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:28.228227 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 10:37:28.228227 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.237871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:28.239215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9553466-931e-4499-bc23-f191aa6806bc tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.090629 Oct 10 10:37:28.246093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 12/47] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:28.257721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29f4ef55-d7b3-430e-b39e-69298cf23936 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.272174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e20276fa-523f-4bcf-87a5-b3bebb6e9bbd tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.363925 Oct 10 10:37:28.280041 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 36/48] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:37:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:37:28.293036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d7c9ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.311859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.313908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.315201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.318009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.322113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.327502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.382716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29f4ef55-d7b3-430e-b39e-69298cf23936 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1318019452" status: 202 len: 0 microversion: 2.1 time: 0.133948 Oct 10 10:37:28.385399 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 13/49] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:37:28 2022] DELETE /compute/v2.1/flavors/1318019452 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:37:28.397447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Calling method '.version_select at 0x7f677d99b430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.402076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.410698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.411576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.437708 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a296910-3838-4d03-9151-8a060d471edb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 396 microversion: 2.1 time: 0.154778 Oct 10 10:37:28.453829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 37/50] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hosts?zone= => generated 396 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:28.463448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-721b4843-838b-48f5-8899-a2d8f4678aa9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Action: 'create', calling method: .version_select at 0x7f677d7e3820>, body: {"keypair": {"name": "tempest-keypair-1647237039", "type": "ssh", "user_id": "5c653148ed2742f585942327584a14dc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEps5vrYHMbuFbN3rye80+AJA0Te+pA1tfoIxCJo3Y/up9XE+2BTWLrr2SGwfcT3KHaTtlKMWBShPac941eqEJaSel7dO8gpwSEZBDsdoDts/W+vLzaYJ9JCd661YlTbeg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:28.465736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.468601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.469249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.501225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.502101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.502893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.510713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-721b4843-838b-48f5-8899-a2d8f4678aa9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:37:28.521221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70391be8-a36c-428b-b19a-9cb4e3961ae9 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132715 Oct 10 10:37:28.522833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-721b4843-838b-48f5-8899-a2d8f4678aa9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for user b718f394ff9b443299674678a9745172 and project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:37:28.530006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 14/51] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:28.536587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2579f2a4-2840-4f7c-87e2-3a59a6e8f30d tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.594162 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-721b4843-838b-48f5-8899-a2d8f4678aa9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.138867 Oct 10 10:37:28.597327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 38/52] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:37:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:37:28.608753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.609687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:28.640381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.641334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.642066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.643098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.644781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.645778 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2579f2a4-2840-4f7c-87e2-3a59a6e8f30d tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114222 Oct 10 10:37:28.646814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.648499 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 15/53] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:28.658040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d9b1e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.670125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.671833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.673757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.674737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.676161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.680822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.752456 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2693809f-8b60-43fb-b705-54300b5013fb tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.101771 Oct 10 10:37:28.759619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 16/54] 10.222.0.16 () {58 vars in 1145 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:37:28.762878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2965c9a5-35e9-414f-a3af-2f14d13f06e7 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Calling method '.version_select at 0x7f677da6fca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.766512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2965c9a5-35e9-414f-a3af-2f14d13f06e7 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '7647c4eadcb043bbb749a0557d8682a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7702d8e0e414643a46914a0b35425c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2965c9a5-35e9-414f-a3af-2f14d13f06e7 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Request method failure captured: Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XjEEOCocvT0RNeqliWIJVC-lQ0FL1GPP46pzTZUPE3eOptq765snVmrpiGHvce9pZPZ786MpfQot5vuqsEt1F1Lx5kY-v-F-KfdyXFuctWb4SolHR7SxR5I-jjqboCz9sZ2n0a4QN_f2OE8Di02_fjgu4KNq-_HE1GY9oW2P9ZlKQ Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: c7702d8e0e414643a46914a0b35425c0 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:28.779276 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7702d8e0e414643a46914a0b35425c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c7702d8e0e414643a46914a0b35425c0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c7702d8e0e414643a46914a0b35425c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c7702d8e0e414643a46914a0b35425c0"}]}] Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: c7702d8e0e414643a46914a0b35425c0 Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387 Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7647c4eadcb043bbb749a0557d8682a4 Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 10:37:28.780605 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1'} Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:28.781437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 10:37:28.782599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.792370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2965c9a5-35e9-414f-a3af-2f14d13f06e7 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:28.793527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2965c9a5-35e9-414f-a3af-2f14d13f06e7 tempest-HypervisorAdminNegativeUnderV252Test-1243234387 tempest-HypervisorAdminNegativeUnderV252Test-1243234387-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.039001 Oct 10 10:37:28.794747 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 17/55] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:28.801500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac139dc4-4718-4d2f-8086-acc04f56442c tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Calling method '.version_select at 0x7f677d8e81f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.816205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac139dc4-4718-4d2f-8086-acc04f56442c tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1639814167?user_id=5c653148ed2742f585942327584a14dc" status: 200 len: 512 microversion: 2.10 time: 0.020077 Oct 10 10:37:28.827672 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 18/56] 10.222.0.16 () {60 vars in 1340 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1639814167?user_id=5c653148ed2742f585942327584a14dc => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:28.833544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19370269-0151-415c-91b3-81e53672f988 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1131330529", "id": 1616554806, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:28.862327 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19370269-0151-415c-91b3-81e53672f988 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.032438 Oct 10 10:37:28.864571 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 19/57] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:37:28 2022] POST /compute/v2.1/flavors => generated 431 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:28.874179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Calling method '.version_select at 0x7f677d8e8700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:28.876372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:28.877310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:28.879312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:28.891584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] HTTP exception thrown: No hypervisor matching '27f39768-266a-4941-8017-46ddd702a6de' could be found. Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Request method failure captured: Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/27f39768-266a-4941-8017-46ddd702a6de/servers HTTP/1.1 Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xls1UeWdm6I_lNq4mt2PI34f9mNqrZxpdYRk2iDkdSooke0jrFOMazOhvSdSe7M52AfbpgAP7JHDx6LYTNeYN1VP_gT6w6dJJ5AlKWZFz0BtaJ-4U1BCVUsrGHodTJSHqkArc_XxMyueI54x8Y61Ad6z4SP33FHzC1l_GqYovbCxI Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e69aca073b3943f68f5117a8aacfc38e Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:28.894102 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e69aca073b3943f68f5117a8aacfc38e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e69aca073b3943f68f5117a8aacfc38e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e69aca073b3943f68f5117a8aacfc38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e69aca073b3943f68f5117a8aacfc38e"}]}] Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e69aca073b3943f68f5117a8aacfc38e Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930 Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6e63d4fa577342d79c8273b53b10af33 Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: exception: No hypervisor matching '27f39768-266a-4941-8017-46ddd702a6de' could be found. Oct 10 10:37:28.895226 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '27f39768-266a-4941-8017-46ddd702a6de'} Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '27f39768-266a-4941-8017-46ddd702a6de' could be found. Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.895864 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '27f39768-266a-4941-8017-46ddd702a6de' could be found. Oct 10 10:37:28.896788 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:28.899726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] Returning 404 to user: No hypervisor matching '27f39768-266a-4941-8017-46ddd702a6de' could be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:28.903749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d3312b7-cb2e-435c-9554-a5ede9088b23 tempest-HypervisorAdminNegativeUnderV252Test-1498012930 tempest-HypervisorAdminNegativeUnderV252Test-1498012930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/27f39768-266a-4941-8017-46ddd702a6de/servers" status: 404 len: 123 microversion: 2.1 time: 0.036129 Oct 10 10:37:28.904918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 20/58] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/os-hypervisors/27f39768-266a-4941-8017-46ddd702a6de/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:28.923062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf95702a-fe32-408b-8fc1-6f35dc58a583 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Action: 'create', calling method: .version_select at 0x7f677d8e8b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1962666627", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtRJ8n/TwTbqGgYhS7Kgu9QiUrxMg8haWQkBpkNANGfk+wNm+MZfVmV7rLIYa8n36fHPJ23uNK2qmAbFFS+UkMeKHr8x7OSdonsWqiK7OHHObazIABUnrLv0rkwalN6og=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:29.003471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cf95702a-fe32-408b-8fc1-6f35dc58a583 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:37:29.012686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cf95702a-fe32-408b-8fc1-6f35dc58a583 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Getting quotas for user b718f394ff9b443299674678a9745172 and project 6475477e27934f08891752d142053013. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:37:29.109393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf95702a-fe32-408b-8fc1-6f35dc58a583 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.203200 Oct 10 10:37:29.113111 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 21/59] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:37:28 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:37:29.154285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-638c857c-2f16-4c15-b494-0f81a6760f86 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.236487 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-638c857c-2f16-4c15-b494-0f81a6760f86 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1616554806/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.119420 Oct 10 10:37:29.242624 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 22/60] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Oct 10 10:37:29 2022] GET /compute/v2.1/flavors/1616554806/os-flavor-access => generated 21 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:37:29.267135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:29.270039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7af6c648-d5e0-4e53-b803-ffba25a8e7c9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Calling method '.version_select at 0x7f677d911c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.278597 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9f24f8d-980a-4a1b-b514-fc059857d89d tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.679957 Oct 10 10:37:29.279303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 39/61] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:28 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:29.289858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-193a47eb-4257-407a-bb64-e1e795a73da0 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.292826 n-d-860687-2 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-7af6c648-d5e0-4e53-b803-ffba25a8e7c9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:37:29.328379 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7af6c648-d5e0-4e53-b803-ffba25a8e7c9 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=5c653148ed2742f585942327584a14dc" status: 200 len: 726 microversion: 2.10 time: 0.080902 Oct 10 10:37:29.328981 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 23/62] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Oct 10 10:37:29 2022] GET /compute/v2.1/os-keypairs?user_id=5c653148ed2742f585942327584a14dc => generated 726 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:29.337194 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-193a47eb-4257-407a-bb64-e1e795a73da0 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1616554806" status: 202 len: 0 microversion: 2.1 time: 0.055968 Oct 10 10:37:29.338062 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 40/63] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:37:29 2022] DELETE /compute/v2.1/flavors/1616554806 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:37:29.345707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-068b08ea-cd0f-48f3-be45-cf419c00b9df tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Calling method '.version_select at 0x7f677d8b10d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.350432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6dd99f46-df08-4595-b63b-6d1e4e58bd19 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.401599 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6dd99f46-df08-4595-b63b-6d1e4e58bd19 tempest-FlavorsAccessTestJSON-1362755480 tempest-FlavorsAccessTestJSON-1362755480-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059107 Oct 10 10:37:29.401795 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-068b08ea-cd0f-48f3-be45-cf419c00b9df tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1962666627" status: 204 len: 0 microversion: 2.10 time: 0.060510 Oct 10 10:37:29.402478 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 24/64] 10.222.0.16 () {60 vars in 1325 bytes} [Mon Oct 10 10:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1962666627 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:37:29.407047 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 41/65] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:29.410747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b70d19a-1392-409e-810f-76afef14d6c7 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Calling method '.version_select at 0x7f677d8b1550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.459807 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b70d19a-1392-409e-810f-76afef14d6c7 tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647237039?user_id=5c653148ed2742f585942327584a14dc" status: 204 len: 0 microversion: 2.10 time: 0.052814 Oct 10 10:37:29.460684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 25/66] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647237039?user_id=5c653148ed2742f585942327584a14dc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:37:29.469928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-08b76752-5162-4eeb-8ceb-7cb0af40fc3d tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] Calling method '.version_select at 0x7f677d7c9670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:29.524061 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-08b76752-5162-4eeb-8ceb-7cb0af40fc3d tempest-KeyPairsV210TestJSON-48293382 tempest-KeyPairsV210TestJSON-48293382-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639814167?user_id=5c653148ed2742f585942327584a14dc" status: 204 len: 0 microversion: 2.10 time: 0.058329 Oct 10 10:37:29.525082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 42/67] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639814167?user_id=5c653148ed2742f585942327584a14dc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:37:30.306452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:30.307298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:30.323926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:30.324556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:30.325046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:30.325925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:30.326367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:30.326806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:30.820907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c5737f-51c0-42aa-a158-a8f6db83fa51", "tag": "2091da12-584d-47ab-8fb5-bb279c15f4ba"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:30.856139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:30.857288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:30.858246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:30.899127 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Creating event network-changed:2091da12-584d-47ab-8fb5-bb279c15f4ba for instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 on n-h1-860687-2 Oct 10 10:37:30.902207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:37:30.902928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3be5c48e-7a6e-4921-a1b4-4a4774ec6752 req-e22837f4-aecb-4056-91bf-07e6aa8801ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:37:30.905840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:30.908077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:30.908990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:30.911358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:30.913771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:30.915310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:30.934004 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.rpcapi [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 10:37:30.935663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] Releasing lock "compute-rpcapi-router" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:37:30.973189 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-50ad5cb3-3378-4cfb-bad2-47e08175375b None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244092 Oct 10 10:37:30.974016 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 43/68] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:31.156225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:31.166572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6251e8b5-cb91-4a29-8d75-102eaf33d6df tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.864526 Oct 10 10:37:31.191155 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 26/69] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:30 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:32.201577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:32.203280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:32.215262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:32.216034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:32.216674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:32.217557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:32.218555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:32.220113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:32.869020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:32.882678 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16920c57-f5b1-4870-b4e9-f9ff9064509b tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.686420 Oct 10 10:37:32.885754 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 44/70] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:32 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:33.924909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:33.928592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:33.934543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:33.941550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:33.942605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:33.943276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:33.944276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:33.946001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:33.946609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:34.607900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:34.645500 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6a58715-d3ef-49fa-afd5-ce5ed90a9b75 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.723667 Oct 10 10:37:34.648315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 27/71] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:33 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:35.670588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:35.671727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:35.693505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:35.694417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:35.695822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:35.702247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:35.703442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:35.704106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:36.220826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:36.235977 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3e4bc3f-c80a-4aa6-80c2-868980a625e9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.566790 Oct 10 10:37:36.238787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 45/72] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:35 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:37.263709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:37.264407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:37.281922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:37.282794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:37.286140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:37.287235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:37.289761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:37.291259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:37.627734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:37.643599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48b3412d-c92d-463e-933e-627214d4a7f5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.384148 Oct 10 10:37:37.648979 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 28/73] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:37 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:38.554251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=14 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:38.674158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:38.677115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:38.690284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:38.692967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:38.693921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:38.696966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:38.697622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:38.699390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:38.749476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:39.046914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:39.090675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba704ee7-7be4-4feb-a264-e2830ee8b211 tempest-InstanceUsageAuditLogTestJSON-1131891901 tempest-InstanceUsageAuditLogTestJSON-1131891901-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:39.136447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba704ee7-7be4-4feb-a264-e2830ee8b211 tempest-InstanceUsageAuditLogTestJSON-1131891901 tempest-InstanceUsageAuditLogTestJSON-1131891901-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 10:37:38" status: 200 len: 318 microversion: 2.1 time: 0.624454 Oct 10 10:37:39.139132 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 46/74] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:37:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2010%3A37%3A38 => generated 318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:39.160736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd4fe4a2-15d8-46d0-b0ec-cfa6f70b76dc tempest-InstanceUsageAuditLogTestJSON-1131891901 tempest-InstanceUsageAuditLogTestJSON-1131891901-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:39.171441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:39.181382 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de561362-5d4b-4e89-b4bb-bd9a6b54edf2 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.511456 Oct 10 10:37:39.182921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd4fe4a2-15d8-46d0-b0ec-cfa6f70b76dc tempest-InstanceUsageAuditLogTestJSON-1131891901 tempest-InstanceUsageAuditLogTestJSON-1131891901-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025760 Oct 10 10:37:39.183682 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 29/75] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:38 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:39.188002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 47/76] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:37:39 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:39.729964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Calling method '.version_select at 0x7f677d8c2160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:39.731857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.732348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.732793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.763068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.763581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.764020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.791174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.791675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.792119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.808231 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8a0ba91-3734-4552-8dab-adbcc1b627ee tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.475404 Oct 10 10:37:39.808838 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 30/77] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:39.820832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Calling method '.version_select at 0x7f677d7e3160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:39.822781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.823314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.823756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.868188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.871269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.872536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.912058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.912819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.913396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.920313 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2e2cbcf-8c1d-4769-a834-d29630639ad3 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-860687-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.104209 Oct 10 10:37:39.921418 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 48/78] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Oct 10 10:37:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-2/servers => generated 196 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:39.940234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Calling method '.version_select at 0x7f677d7c95e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:39.948309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.949067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.949688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:39.981815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:39.982309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:39.982754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.003722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.004255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.005263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.012001 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73e07b02-174a-43e0-9c94-43208c630f60 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081578 Oct 10 10:37:40.018612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 49/79] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:40.023952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Calling method '.version_select at 0x7f677d7c9280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:40.027392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.028200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.029041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.044318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.045003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.045442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.052136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c8f2fb1-0f9f-494e-bf09-79f14c337069 tempest-HypervisorAdminUnderV252Test-1143867979 tempest-HypervisorAdminUnderV252Test-1143867979-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-860687-2/search" status: 200 len: 104 microversion: 2.1 time: 0.032255 Oct 10 10:37:40.059529 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 50/80] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Oct 10 10:37:40 2022] GET /compute/v2.1/os-hypervisors/n-h1-860687-2/search => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:40.092028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Action: 'update', calling method: .version_select at 0x7f677d8c2790>, body: {"quota_set": {"ram": "5120"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:40.185173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.185734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.186337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.187781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.188643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.190062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.215114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:40.215868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:40.222212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.230202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.231123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.233532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.234725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.237190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.337144 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6566ad9c-6063-407f-a358-418c2bf52224 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964" status: 200 len: 240 microversion: 2.36 time: 0.448459 Oct 10 10:37:40.343734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 31/81] 10.222.0.16 () {62 vars in 1303 bytes} [Mon Oct 10 10:37:39 2022] PUT /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964 => generated 240 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:40.350341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Calling method '.version_select at 0x7f677d8c28b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:40.668838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.669479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.670233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.671146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:40.671761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:40.672469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:40.677461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:40.687298 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24c150b3-5f71-4906-9f48-5d5cda1dcda0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.477193 Oct 10 10:37:40.689916 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 51/82] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:40 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:40.714297 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-252aab65-7be2-4f59-9cbe-5239b947d1b6 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964/detail" status: 200 len: 672 microversion: 2.36 time: 0.368141 Oct 10 10:37:40.715946 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 32/83] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Oct 10 10:37:40 2022] GET /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964/detail => generated 672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:41.015292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Action: 'update', calling method: .version_select at 0x7f677d841af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:41.035106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:41.350479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.351778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.352373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.354295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.355054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.355561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.428123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.428697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.429199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.430815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.431340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.431835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.439028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:41.531883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b8f0730-cf94-4d5f-a69e-4a66ebbf1202 tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964?user_id=396f8f141e924edca739ceb53992a6dc" status: 200 len: 240 microversion: 2.36 time: 0.520501 Oct 10 10:37:41.546430 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 52/84] 10.222.0.16 () {62 vars in 1384 bytes} [Mon Oct 10 10:37:41 2022] PUT /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964?user_id=396f8f141e924edca739ceb53992a6dc => generated 240 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:41.548858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cf12c4e-b1f5-4084-a6b6-126e6b1b200c tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] Calling method '.version_select at 0x7f677d8fadc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:41.712765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:41.713534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:41.721756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.725105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.727482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.728378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:41.729774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:41.730579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:41.936685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cf12c4e-b1f5-4084-a6b6-126e6b1b200c tempest-QuotasAdminTestV236-1753543615 tempest-QuotasAdminTestV236-1753543615-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964?user_id=396f8f141e924edca739ceb53992a6dc" status: 200 len: 282 microversion: 2.36 time: 0.392799 Oct 10 10:37:41.948635 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 33/85] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Oct 10 10:37:41 2022] GET /compute/v2.1/os-quota-sets/9ea927bc9ed8400a9edd95b99e70a964?user_id=396f8f141e924edca739ceb53992a6dc => generated 282 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:42.156804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:42.165711 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df2406dd-793f-4369-9e92-a1a63ddc7cea tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.457402 Oct 10 10:37:42.169705 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 53/86] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:41 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:43.197481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:43.198088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:43.218168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:43.219101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:43.221404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:43.222544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:43.223279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:43.223983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:43.276096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1485165", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "62cb77a7-f0f1-4c26-8da8-dc077cf999d2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:43.416126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] validate_networks() for [('62cb77a7-f0f1-4c26-8da8-dc077cf999d2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:37:43.850547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:43.862189 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32f191b0-a192-4182-a873-0d3f7d3bc9c4 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.670236 Oct 10 10:37:43.865684 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 54/87] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:43 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:44.809543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:37:44.810010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:37:44.810303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:37:44.810713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:37:44.811191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:37:44.826194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:44.826676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:44.829027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:44.831812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:44.833403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:44.835050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:44.856366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:37:44.862131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for user 78daecbab97943d5a26534e791ae8107 and project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:37:44.877849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:37:44.882160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:37:44.895156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:44.896325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:44.910212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:44.916655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:44.917157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:44.924015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:44.925059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:44.926609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:44.966603 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d349e2af-822b-4bd2-9691-ff8fbe7a56cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.995383 Oct 10 10:37:44.970919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 34/88] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:37:44.996570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:44.998069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:45.171970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:45.185087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:45.188486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:45.191504 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da2f8fd6-aa7b-484a-96ab-c52da5afced7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1259 microversion: 2.25 time: 0.215333 Oct 10 10:37:45.200715 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 35/89] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:44 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:37:45.331120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:45.365329 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c2c3de7-171a-41fc-8319-735235e40bb9 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.465283 Oct 10 10:37:45.380406 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 55/90] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:44 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:46.306006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c5737f-51c0-42aa-a158-a8f6db83fa51", "name": "network-vif-plugged", "status": "completed", "tag": "2091da12-584d-47ab-8fb5-bb279c15f4ba"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:46.324369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:46.326880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:46.329381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:46.358473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] Creating event network-vif-plugged:2091da12-584d-47ab-8fb5-bb279c15f4ba for instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 on n-h1-860687-2 Oct 10 10:37:46.366307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ddc00387-9c99-444f-b8f1-1d3aadafe2e8 req-26d60d8c-5b3f-4753-aeb1-4fc7d461357d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173574 Oct 10 10:37:46.368768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 56/91] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:46.386603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:46.387565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:46.401585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:46.405318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:46.407520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:46.408499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:46.409503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:46.416082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d17aa0-c94f-4dd9-86ab-82c007bc1954 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Calling method '.version_select at 0x7f677d923700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:46.418542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84d17aa0-c94f-4dd9-86ab-82c007bc1954 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'caa74192b7634c5fb0cbf6d5ff0d437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2a7bf3b60d473fae73f23ecd2552ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d17aa0-c94f-4dd9-86ab-82c007bc1954 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Request method failure captured: Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_X41Lxzig-TCN1EAhY_iAIRkuipZM2BhnVefTn2f33e06KVwPVNA8F3dDsHUSxL77ZkjmGlU0FCcImza_579QgxkHeL2NJvNAaGrHf79qlqL2l6S6DsNhCz6qhRomlvzsAgIxjeIqG96oUbHmyLzewKW-kjpTzpAwl18N14vPc6gcI Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:46.420261 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d2a7bf3b60d473fae73f23ecd2552ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d2a7bf3b60d473fae73f23ecd2552ff"}]}] Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: caa74192b7634c5fb0cbf6d5ff0d437c Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: action_args: {} Oct 10 10:37:46.421553 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:46.428921 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 10:37:46.430908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.434006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d17aa0-c94f-4dd9-86ab-82c007bc1954 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:46.434006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84d17aa0-c94f-4dd9-86ab-82c007bc1954 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.435478 Oct 10 10:37:46.434006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 36/92] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:37:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 436 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:46.434478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:46.434478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:46.440422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:46.441420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:46.471628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:46.474679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:46.476101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:46.483537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:46.484085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:46.485018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:46.715304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.727297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.733643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.738471 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c15b61ca-047c-4afb-9dab-2e309be7a515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1255 microversion: 2.25 time: 0.368345 Oct 10 10:37:46.783398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 57/93] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:46 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1255 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:46.791752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4b03c8-0877-4246-a3e1-faec043e3d47 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Calling method '.version_select at 0x7f677d6b5430>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:46.793691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb4b03c8-0877-4246-a3e1-faec043e3d47 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'caa74192b7634c5fb0cbf6d5ff0d437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2a7bf3b60d473fae73f23ecd2552ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4b03c8-0877-4246-a3e1-faec043e3d47 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Request method failure captured: Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_X41Lxzig-TCN1EAhY_iAIRkuipZM2BhnVefTn2f33e06KVwPVNA8F3dDsHUSxL77ZkjmGlU0FCcImza_579QgxkHeL2NJvNAaGrHf79qlqL2l6S6DsNhCz6qhRomlvzsAgIxjeIqG96oUbHmyLzewKW-kjpTzpAwl18N14vPc6gcI Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:46.797168 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d2a7bf3b60d473fae73f23ecd2552ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d2a7bf3b60d473fae73f23ecd2552ff"}]}] Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: caa74192b7634c5fb0cbf6d5ff0d437c Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:37:46.798663 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:46.799535 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 10:37:46.800685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.805306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4b03c8-0877-4246-a3e1-faec043e3d47 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:46.806360 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb4b03c8-0877-4246-a3e1-faec043e3d47 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021350 Oct 10 10:37:46.807447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 58/94] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:46 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:46.821249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b95a00db-fc38-4053-8b89-c38727f4e016 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Calling method '.version_select at 0x7f677d6f0af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:46.831293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b95a00db-fc38-4053-8b89-c38727f4e016 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'caa74192b7634c5fb0cbf6d5ff0d437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2a7bf3b60d473fae73f23ecd2552ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b95a00db-fc38-4053-8b89-c38727f4e016 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Request method failure captured: Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_X41Lxzig-TCN1EAhY_iAIRkuipZM2BhnVefTn2f33e06KVwPVNA8F3dDsHUSxL77ZkjmGlU0FCcImza_579QgxkHeL2NJvNAaGrHf79qlqL2l6S6DsNhCz6qhRomlvzsAgIxjeIqG96oUbHmyLzewKW-kjpTzpAwl18N14vPc6gcI Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:46.833404 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d2a7bf3b60d473fae73f23ecd2552ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d2a7bf3b60d473fae73f23ecd2552ff"}]}] Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: caa74192b7634c5fb0cbf6d5ff0d437c Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:37:46.834556 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:46.836083 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 10:37:46.837423 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:46.840307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b95a00db-fc38-4053-8b89-c38727f4e016 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:46.840307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b95a00db-fc38-4053-8b89-c38727f4e016 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021078 Oct 10 10:37:46.840307 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 59/95] 10.222.0.16 () {58 vars in 1179 bytes} [Mon Oct 10 10:37:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:37:46.904773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:46.907509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=79 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:46.922286 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-361c25ce-a1d2-4024-85d5-81af310e93b0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.497513 Oct 10 10:37:46.923191 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 37/96] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:46 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:47.315831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Calling method '.version_select at 0x7f677d7c9280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.317780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.321878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.326109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.381729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.383094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.383594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.413255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.419516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.420282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.430746 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc4f72a6-bc72-41ca-bc39-876b75beaf2e tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.586598 Oct 10 10:37:47.435936 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 60/97] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:47.451149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dabc33e3-b6b7-47bb-8fbe-9eee0cc9a83a tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Calling method '.version_select at 0x7f677d923ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.453070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dabc33e3-b6b7-47bb-8fbe-9eee0cc9a83a tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'caa74192b7634c5fb0cbf6d5ff0d437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2a7bf3b60d473fae73f23ecd2552ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dabc33e3-b6b7-47bb-8fbe-9eee0cc9a83a tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Request method failure captured: Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_X41Lxzig-TCN1EAhY_iAIRkuipZM2BhnVefTn2f33e06KVwPVNA8F3dDsHUSxL77ZkjmGlU0FCcImza_579QgxkHeL2NJvNAaGrHf79qlqL2l6S6DsNhCz6qhRomlvzsAgIxjeIqG96oUbHmyLzewKW-kjpTzpAwl18N14vPc6gcI Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:47.454752 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d2a7bf3b60d473fae73f23ecd2552ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d2a7bf3b60d473fae73f23ecd2552ff"}]}] Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: caa74192b7634c5fb0cbf6d5ff0d437c Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1'} Oct 10 10:37:47.456039 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:47.456739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 10:37:47.457739 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.458611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dabc33e3-b6b7-47bb-8fbe-9eee0cc9a83a tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:47.458611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dabc33e3-b6b7-47bb-8fbe-9eee0cc9a83a tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012781 Oct 10 10:37:47.458611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 38/98] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:47.467510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ee3df93-0d6d-4040-b7fb-aced1a9dd668 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Calling method '.version_select at 0x7f677d6b50d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.475914 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3ee3df93-0d6d-4040-b7fb-aced1a9dd668 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] HTTP exception thrown: Hypervisor with ID 'de230dc1-7546-4488-9c5d-ab7d8ba79186' could not be found. Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ee3df93-0d6d-4040-b7fb-aced1a9dd668 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Request method failure captured: Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hypervisors/de230dc1-7546-4488-9c5d-ab7d8ba79186/uptime HTTP/1.1 Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_X5Mp44L4eq_RyPbrKv3Cq4SKENL1H3aCwhBsvhAHGAqiMobY8BI9od8nFBB4IqIfL_to59BXfhEwqbmLsuaMbfvMZjralpc9XtVVZfbN6FuDzi-jPnJm7bk5iEfRvWgewDNOscZqsB6bYiPvXLkZ7PTTee0nX7M1MrrwiRJQ87rTU Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 6e67cadbbf7a4478961e63032598e39e Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:47.486324 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e67cadbbf7a4478961e63032598e39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e67cadbbf7a4478961e63032598e39e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e67cadbbf7a4478961e63032598e39e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e67cadbbf7a4478961e63032598e39e"}]}] Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 6e67cadbbf7a4478961e63032598e39e Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 55288ef7adc94e62890d6b0a5ac5f80b Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: exception: Hypervisor with ID 'de230dc1-7546-4488-9c5d-ab7d8ba79186' could not be found. Oct 10 10:37:47.487559 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'de230dc1-7546-4488-9c5d-ab7d8ba79186'} Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'de230dc1-7546-4488-9c5d-ab7d8ba79186' Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 10:37:47.488337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'de230dc1-7546-4488-9c5d-ab7d8ba79186' could not be found. Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.490261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'de230dc1-7546-4488-9c5d-ab7d8ba79186' could not be found. Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ee3df93-0d6d-4040-b7fb-aced1a9dd668 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Returning 404 to user: Hypervisor with ID 'de230dc1-7546-4488-9c5d-ab7d8ba79186' could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:47.493155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ee3df93-0d6d-4040-b7fb-aced1a9dd668 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/de230dc1-7546-4488-9c5d-ab7d8ba79186/uptime" status: 404 len: 123 microversion: 2.1 time: 0.027384 Oct 10 10:37:47.497262 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 61/99] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/os-hypervisors/de230dc1-7546-4488-9c5d-ab7d8ba79186/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:47.509011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Calling method '.version_select at 0x7f677d89c280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.515394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.516383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.518168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.541885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.542377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.542819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.562147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.562631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.563117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.573951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfa8f12f-e6fe-4463-aa2b-9caddd0e8d63 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075143 Oct 10 10:37:47.575064 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 39/100] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:47.588423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa40c278-af80-4164-bf3f-1f462f5691e7 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Calling method '.version_select at 0x7f677d6f0700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.590461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa40c278-af80-4164-bf3f-1f462f5691e7 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'caa74192b7634c5fb0cbf6d5ff0d437c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2a7bf3b60d473fae73f23ecd2552ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa40c278-af80-4164-bf3f-1f462f5691e7 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Request method failure captured: Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_X41Lxzig-TCN1EAhY_iAIRkuipZM2BhnVefTn2f33e06KVwPVNA8F3dDsHUSxL77ZkjmGlU0FCcImza_579QgxkHeL2NJvNAaGrHf79qlqL2l6S6DsNhCz6qhRomlvzsAgIxjeIqG96oUbHmyLzewKW-kjpTzpAwl18N14vPc6gcI Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:47.598047 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d2a7bf3b60d473fae73f23ecd2552ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d2a7bf3b60d473fae73f23ecd2552ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d2a7bf3b60d473fae73f23ecd2552ff"}]}] Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1d2a7bf3b60d473fae73f23ecd2552ff Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926540635 Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: caa74192b7634c5fb0cbf6d5ff0d437c Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926540635-project Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1'} Oct 10 10:37:47.599723 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:47.600459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 10:37:47.601979 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.603680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa40c278-af80-4164-bf3f-1f462f5691e7 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:47.604640 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa40c278-af80-4164-bf3f-1f462f5691e7 tempest-HypervisorAdminNegativeTestJSON-926540635 tempest-HypervisorAdminNegativeTestJSON-926540635-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022584 Oct 10 10:37:47.606422 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 62/101] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:47.624677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51db7005-c945-4bbe-8b9d-b285c7c2efd2 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Calling method '.version_select at 0x7f677d8c2160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.627732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-51db7005-c945-4bbe-8b9d-b285c7c2efd2 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] HTTP exception thrown: Hypervisor with ID '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' could not be found. Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51db7005-c945-4bbe-8b9d-b285c7c2efd2 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Request method failure captured: Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/4f73cfe0-a957-4c85-9697-9df4d4b9c2c4 HTTP/1.1 Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_X5Mp44L4eq_RyPbrKv3Cq4SKENL1H3aCwhBsvhAHGAqiMobY8BI9od8nFBB4IqIfL_to59BXfhEwqbmLsuaMbfvMZjralpc9XtVVZfbN6FuDzi-jPnJm7bk5iEfRvWgewDNOscZqsB6bYiPvXLkZ7PTTee0nX7M1MrrwiRJQ87rTU Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 6e67cadbbf7a4478961e63032598e39e Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:47.637835 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e67cadbbf7a4478961e63032598e39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e67cadbbf7a4478961e63032598e39e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e67cadbbf7a4478961e63032598e39e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e67cadbbf7a4478961e63032598e39e"}]}] Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 6e67cadbbf7a4478961e63032598e39e Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-322332711 Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 55288ef7adc94e62890d6b0a5ac5f80b Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: exception: Hypervisor with ID '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' could not be found. Oct 10 10:37:47.639226 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4'} Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 10:37:47.640095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:37:47.641742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' could not be found. Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' could not be found. Oct 10 10:37:47.643136 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:47.652076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51db7005-c945-4bbe-8b9d-b285c7c2efd2 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] Returning 404 to user: Hypervisor with ID '4f73cfe0-a957-4c85-9697-9df4d4b9c2c4' could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:47.653235 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51db7005-c945-4bbe-8b9d-b285c7c2efd2 tempest-HypervisorAdminNegativeTestJSON-322332711 tempest-HypervisorAdminNegativeTestJSON-322332711-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/4f73cfe0-a957-4c85-9697-9df4d4b9c2c4" status: 404 len: 123 microversion: 2.1 time: 0.039091 Oct 10 10:37:47.656249 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 40/102] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/os-hypervisors/4f73cfe0-a957-4c85-9697-9df4d4b9c2c4 => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:47.813378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.821831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:47.881278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.881782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.889555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.899531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.900301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.922300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.947440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:47.948648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:47.957275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.957741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.958190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:47.958971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:47.959379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:47.959808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:48.136070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:48.160748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:48.166443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:48.172141 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92b25d54-1afe-456f-af1b-1c509baac588 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1317 microversion: 2.25 time: 0.365551 Oct 10 10:37:48.175949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 63/103] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:48.272360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:48.283313 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-910ec358-a2bf-474d-9aaf-851e8ac1c2c0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1335 microversion: 2.1 time: 0.341328 Oct 10 10:37:48.284232 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 41/104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:47 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1335 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:49.201442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:49.203281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:49.209512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.210074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.212501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:49.221671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.222372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.222817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:49.309745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:49.310420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:49.329058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.329823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.330455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:49.331375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.332158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.332893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:49.418283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:49.428434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:49.430886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:49.432054 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a03dab10-7135-4bad-a4fb-712339904300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.234902 Oct 10 10:37:49.450237 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 64/105] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:49 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:49.615941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:49.625904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d5f81e3-d74d-4746-a702-eec9dd72cdf0 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1484 microversion: 2.1 time: 0.320982 Oct 10 10:37:49.626818 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 42/106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:49 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1484 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:49.649899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:49.650882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:49.656916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.657587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.658023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:49.659330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:49.659997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:49.660507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.020568 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-348f7531-b4cc-486f-92a3-0a51bbea1837 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1635 microversion: 2.1 time: 0.375417 Oct 10 10:37:50.026811 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 65/107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:49 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1635 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:50.044530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:50.045031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:50.051205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.051824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.052264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.052959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.053414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.053834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.086291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:37:50.238020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Action: 'update', calling method: .version_select at 0x7f677d815040>, body: {"quota_set": {"ram": "5120"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:50.251210 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6077f3ec-e024-4e66-9778-abb2bec8260c tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 204 len: 0 microversion: 2.1 time: 0.210363 Oct 10 10:37:50.254850 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 66/108] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:37:50 2022] DELETE /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:37:50.261583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:50.262275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:50.268645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.269137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.270140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.270853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.271334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.271756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.611114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:50.621939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8dea8a4-e58d-44b5-ac22-16035263cf54 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1490 microversion: 2.1 time: 0.365052 Oct 10 10:37:50.622731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 67/109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:50 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1490 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:50.629251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:50.645105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:50.658110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.658686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.659174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.660544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.661308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.661740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.751814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.752368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.752715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.754219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:50.754677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:50.755134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:50.825057 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20394ec8-0c6c-4844-a036-eb7bc8f41bde tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76" status: 200 len: 148 microversion: 2.57 time: 1.014922 Oct 10 10:37:50.835607 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 43/110] 10.222.0.16 () {62 vars in 1303 bytes} [Mon Oct 10 10:37:49 2022] PUT /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76 => generated 148 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:37:50.847880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Calling method '.version_select at 0x7f677d8b1e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:50.853371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:50.863882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:50.865341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:50.867139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b7b910a-471c-405f-b89f-a3b54cb5902d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.242396 Oct 10 10:37:50.868242 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 68/111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:50 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:51.188276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.188766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.189195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.190381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.191204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.191827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.218239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0d6ea7f-981d-4d80-8697-53a71758df4d tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76/detail" status: 200 len: 463 microversion: 2.57 time: 0.381450 Oct 10 10:37:51.218964 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 44/112] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Oct 10 10:37:50 2022] GET /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76/detail => generated 463 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:51.233964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.237422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.238104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.238540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.239301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.239747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.240363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.272354 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2cf95992-0c62-4f7b-8646-82a719fbe007 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 964 microversion: 2.1 time: 0.316150 Oct 10 10:37:51.274479 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 69/113] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:37:50 2022] GET /compute/v2.1/os-services => generated 964 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:51.289754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.294307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.294720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.295294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.296140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.296790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.297709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.328647 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-080e53f3-a641-4356-861e-8dffc1a064df tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-860687-2" status: 200 len: 578 microversion: 2.1 time: 0.044299 Oct 10 10:37:51.329250 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 45/114] 10.222.0.16 () {58 vars in 1172 bytes} [Mon Oct 10 10:37:51 2022] GET /compute/v2.1/os-services?host=n-d-860687-2 => generated 578 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:51.345213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.348669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.349167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.349596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.350328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.351447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.352375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.384157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f9359de-4612-4aaa-af5c-e1557db201b0 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 400 microversion: 2.1 time: 0.042818 Oct 10 10:37:51.398719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.402187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.402679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.403162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.403902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.404659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.404786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.405085 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 70/115] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:37:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 400 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:51.430243 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-115eda51-6b34-4d2e-a9b9-c6ae448c3748 tempest-ServicesAdminTestJSON-722506749 tempest-ServicesAdminTestJSON-722506749-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 964 microversion: 2.1 time: 0.034888 Oct 10 10:37:51.435960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 46/116] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:37:51 2022] GET /compute/v2.1/os-services => generated 964 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:51.456032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Action: 'update', calling method: .version_select at 0x7f677d695dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:51.522657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=20 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:51.645860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.646555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:51.652604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.653162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.653807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.654685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.655495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.655982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.901351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.901840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.902277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.903034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.903505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.903925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.940436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:51.952397 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72426d56-0acb-4f41-9504-bae7f4aa84e5 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1490 microversion: 2.1 time: 0.307666 Oct 10 10:37:51.953216 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 47/117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:51 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1490 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:37:51.961721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:51.962487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:51.968275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.968763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.969222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.970183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.970637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.970829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.971256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.971492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.971974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:51.972675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:51.973124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:51.973542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:52.045019 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ee5d5fa-e525-4e09-a2b1-883a60b5ce6f tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76?user_id=039bfcecdd9845d9892c1a987264ef1a" status: 200 len: 148 microversion: 2.57 time: 0.592924 Oct 10 10:37:52.045905 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 71/118] 10.222.0.16 () {62 vars in 1384 bytes} [Mon Oct 10 10:37:51 2022] PUT /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76?user_id=039bfcecdd9845d9892c1a987264ef1a => generated 148 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:52.058063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da64f9d0-13be-4ef7-bcba-9784c03667ba tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] Calling method '.version_select at 0x7f677d6cac10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:52.523508 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da64f9d0-13be-4ef7-bcba-9784c03667ba tempest-QuotasAdminTestV257-1556199163 tempest-QuotasAdminTestV257-1556199163-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76?user_id=039bfcecdd9845d9892c1a987264ef1a" status: 200 len: 190 microversion: 2.57 time: 0.469241 Oct 10 10:37:52.524948 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 72/119] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Oct 10 10:37:52 2022] GET /compute/v2.1/os-quota-sets/9e2fc193d5a14bdd9d647b86ca251f76?user_id=039bfcecdd9845d9892c1a987264ef1a => generated 190 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:52.568456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:52.584085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:52.585903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:52.587860 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ef753b8-00be-4b5c-b7f1-21fd8d3f12d4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.632945 Oct 10 10:37:52.588774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 48/120] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:51 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:52.666211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2de71c7-9e47-4de2-b8eb-e1e05222cee0 tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] Calling method '.version_select at 0x7f677d695d30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:52.931505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c5737f-51c0-42aa-a158-a8f6db83fa51", "name": "network-vif-deleted", "tag": "2091da12-584d-47ab-8fb5-bb279c15f4ba"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:52.942519 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2de71c7-9e47-4de2-b8eb-e1e05222cee0 tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 3322 microversion: 2.1 time: 0.416545 Oct 10 10:37:52.943823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 73/121] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:37:52 2022] GET /compute/v2.1/os-networks => generated 3322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:52.960725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65c579cc-e90a-475a-825e-381c2b2fadef tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] Calling method '.version_select at 0x7f677d749ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:52.967033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:52.967562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:52.969076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.045301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Creating event network-vif-deleted:2091da12-584d-47ab-8fb5-bb279c15f4ba for instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 on n-h1-860687-2 Oct 10 10:37:53.045865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:37:53.046250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c9a892a-0091-4ca0-a91f-363d0897d623 req-0a932636-37f2-4159-b75f-1cef94fa073e service nova] Acquired lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:37:53.047364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.047833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.048269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.049002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.049460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.049891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.084063 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.rpcapi [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 10:37:53.085983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] Releasing lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:37:53.104389 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65c579cc-e90a-475a-825e-381c2b2fadef tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/74342e93-82e4-4559-8240-24cfc91f813d" status: 200 len: 652 microversion: 2.1 time: 0.155382 Oct 10 10:37:53.105478 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 74/122] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:37:52 2022] GET /compute/v2.1/os-networks/74342e93-82e4-4559-8240-24cfc91f813d => generated 652 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:53.113633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:53.114356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:53.117188 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bc3de54-8675-4dec-9392-16b229b53576 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190141 Oct 10 10:37:53.117818 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 49/123] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:53.126019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72c223ef-8245-497f-8934-6ffd1dddf2a1 tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] Calling method '.version_select at 0x7f677d7be5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:53.132995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.133729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.135108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.136647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.137374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.138106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.322987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f8ecd3f474408e8d76257499ccc2e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6175c446137541038f09aaaab284c740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:53.332782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63ddd836-521d-419d-a45e-1edf354a246e tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 200 len: 1320 microversion: 2.1 time: 0.225974 Oct 10 10:37:53.340064 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 75/124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:53 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:53.432159 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72c223ef-8245-497f-8934-6ffd1dddf2a1 tempest-NetworksTest-2097975536 tempest-NetworksTest-2097975536-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 3322 microversion: 2.1 time: 0.312925 Oct 10 10:37:53.432903 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 50/125] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:37:53 2022] GET /compute/v2.1/os-networks => generated 3322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:37:53.614587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:53.615551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:53.627876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.628494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.628946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.629691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:53.633247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:53.633717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:53.880054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:53.884415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:53.889463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:53.890901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:53.892051 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b8ba5da-b1a9-475e-84c9-b58f2213ecf4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.282207 Oct 10 10:37:53.903150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 76/126] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:53 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:54.371421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:54.373220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:54.378856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:54.385111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:54.387653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:54.388450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:54.389977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:54.390871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:54.392264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:54.422713 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] HTTP exception thrown: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Request method failure captured: Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 HTTP/1.1 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xae2ZEkyMsqpBXQtdqPKEychlRkAn6kl9OW-zpzfKtI0p_0n-i4Z_C5RocT78FmuCnf87x4S4kzF-WIqzkBGRgdZ3qabbZhbDcqwMnc-BnFyC5roQdUqS3NKdijLYX7rGxjludqzxeU9tPFF6OGDqNV-7UN8E-d48hg33g7qHo43E Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:54.430972 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6175c446137541038f09aaaab284c740", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6175c446137541038f09aaaab284c740"}]}] Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 93f8ecd3f474408e8d76257499ccc2e7 Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:54.432271 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c6c5737f-51c0-42aa-a158-a8f6db83fa51'} Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:54.433026 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:54.434881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:54.439734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Returning 404 to user: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:54.441019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4225f8f8-4873-41e7-a377-5da1cc21607a tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 404 len: 111 microversion: 2.1 time: 0.076174 Oct 10 10:37:54.445823 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 51/127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:54 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:54.451574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f49f55ef-3cdc-4eb7-ba09-67bcde69a4cb tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:54.467137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49f55ef-3cdc-4eb7-ba09-67bcde69a4cb tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:54.467624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49f55ef-3cdc-4eb7-ba09-67bcde69a4cb tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:54.468054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49f55ef-3cdc-4eb7-ba09-67bcde69a4cb tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:54.960610 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f49f55ef-3cdc-4eb7-ba09-67bcde69a4cb tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.512809 Oct 10 10:37:54.961386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 77/128] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:54.966362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:54.967077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:54.973778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:54.974554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:54.975186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:54.976420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:54.977174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:54.977739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:55.130237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:55.139686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:55.141153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:55.142515 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b6b1909-ee95-4250-914c-bf8b48042c2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.180022 Oct 10 10:37:55.143140 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 78/129] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:54 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:55.148197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc92037c-cb95-4f28-aff5-ed6da380c41c tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:55.180545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc92037c-cb95-4f28-aff5-ed6da380c41c tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.036098 Oct 10 10:37:55.181554 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 79/130] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:55 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:55.187618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60be6671-ce50-4bb3-b544-bb72150d7486", "tag": "ea4a8da1-fc9a-4946-96aa-444543b59f2e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.200383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:55.201284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:55.201794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:55.214178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] Creating event network-changed:ea4a8da1-fc9a-4946-96aa-444543b59f2e for instance 60be6671-ce50-4bb3-b544-bb72150d7486 on n-h2-860687-2 Oct 10 10:37:55.220212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-50348fc7-4588-4c4b-b6ac-31613fb634b1 req-961cba9b-0af8-446e-8981-343d84dc5628 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036857 Oct 10 10:37:55.221467 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 80/131] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.228793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8428f30b-4c9c-4fd1-8189-378b8a2ce647 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-683068592"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.232348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-8428f30b-4c9c-4fd1-8189-378b8a2ce647 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 04e22f6a-8ae8-47bf-88eb-8731549c0406 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:55.251843 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8428f30b-4c9c-4fd1-8189-378b8a2ce647 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.028917 Oct 10 10:37:55.252999 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 81/132] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.264634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f40a0507-f3f5-4f7c-a572-0672eedabf34 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.284310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f40a0507-f3f5-4f7c-a572-0672eedabf34 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:55.285664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f40a0507-f3f5-4f7c-a572-0672eedabf34 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:55.286815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f40a0507-f3f5-4f7c-a572-0672eedabf34 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:55.397900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50bdd599-a0d7-49d3-b179-b59057eda9da tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:55.414478 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50bdd599-a0d7-49d3-b179-b59057eda9da tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.568643 Oct 10 10:37:55.415528 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 52/133] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:37:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.462229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f40a0507-f3f5-4f7c-a572-0672eedabf34 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.201827 Oct 10 10:37:55.464600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 82/134] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:55.474889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1145f82f-e575-4a33-a2ef-1cf3d253f060 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:55.487254 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1145f82f-e575-4a33-a2ef-1cf3d253f060 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.016188 Oct 10 10:37:55.488558 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 53/135] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:37:55 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.501446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f0bdf55-4129-4e78-a594-14f811ab5aa2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.519206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f0bdf55-4129-4e78-a594-14f811ab5aa2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:55.520187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f0bdf55-4129-4e78-a594-14f811ab5aa2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:55.520798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f0bdf55-4129-4e78-a594-14f811ab5aa2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:55.698349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:55.729232 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f0bdf55-4129-4e78-a594-14f811ab5aa2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.231629 Oct 10 10:37:55.729838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 83/136] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.743295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fca6e980-7dca-4f65-b297-9e711506ffbc tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:55.775594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fca6e980-7dca-4f65-b297-9e711506ffbc tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.037753 Oct 10 10:37:55.776615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 54/137] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:55 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:55.788704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36a7a547-f80b-460d-8b11-67dcc4053b1a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-416158108"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.793503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-36a7a547-f80b-460d-8b11-67dcc4053b1a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 4ce42a29-f634-4d60-ae61-e191ee5f2e79 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:55.836879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36a7a547-f80b-460d-8b11-67dcc4053b1a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053711 Oct 10 10:37:55.838399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 84/138] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:55.849422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-929ee6ed-4a84-488c-94d0-a9cd950ed09e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:55.861073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-929ee6ed-4a84-488c-94d0-a9cd950ed09e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:55.861763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-929ee6ed-4a84-488c-94d0-a9cd950ed09e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:55.862357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-929ee6ed-4a84-488c-94d0-a9cd950ed09e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.038613 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-929ee6ed-4a84-488c-94d0-a9cd950ed09e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.192636 Oct 10 10:37:56.040294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 55/139] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:55 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.054491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f78bea20-3fa6-4be3-8390-78a048c0f613 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:56.062067 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f78bea20-3fa6-4be3-8390-78a048c0f613 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.011879 Oct 10 10:37:56.062628 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 85/140] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:37:56 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.077235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5258810c-7b5a-4476-9ae2-9b525edaed6f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.106866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5258810c-7b5a-4476-9ae2-9b525edaed6f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:56.108129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5258810c-7b5a-4476-9ae2-9b525edaed6f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:56.108577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5258810c-7b5a-4476-9ae2-9b525edaed6f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.173608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:56.174772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:56.186432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:56.186891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:56.188957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.189871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:56.190343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:56.190777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.278792 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5258810c-7b5a-4476-9ae2-9b525edaed6f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.206058 Oct 10 10:37:56.280825 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 56/141] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.295294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d30a6f9a-effb-4e6a-b093-764a40c01337 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:56.340238 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d30a6f9a-effb-4e6a-b093-764a40c01337 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.051503 Oct 10 10:37:56.342091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 57/142] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:56 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:56.357026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03524060-8d0f-4cda-a7da-1ba6ff312c15 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-378596182"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.364786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-03524060-8d0f-4cda-a7da-1ba6ff312c15 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 084d5bbf-19aa-48ae-a2ff-6d26694e6c45 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:56.410464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03524060-8d0f-4cda-a7da-1ba6ff312c15 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057156 Oct 10 10:37:56.419369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 58/143] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.424715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9df9321-b257-4eaf-aaf2-3f99a6291c6b tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.443263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9df9321-b257-4eaf-aaf2-3f99a6291c6b tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:56.444285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9df9321-b257-4eaf-aaf2-3f99a6291c6b tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:56.446643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9df9321-b257-4eaf-aaf2-3f99a6291c6b tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.578414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:56.587039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:56.588496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:56.589616 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-731c7e76-e7b5-46ca-8e39-1f884bcd3f9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.423298 Oct 10 10:37:56.618283 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 86/144] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:56 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:37:56.627629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9df9321-b257-4eaf-aaf2-3f99a6291c6b tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.206648 Oct 10 10:37:56.628834 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 59/145] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.639672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-197644077", "imageRef": "e01a6779-1da4-4c25-8ad4-0b0db092055e", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.641655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-423a744c-3252-4670-93d0-34f86e43e243 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.661360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-423a744c-3252-4670-93d0-34f86e43e243 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:56.662214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-423a744c-3252-4670-93d0-34f86e43e243 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:56.662969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-423a744c-3252-4670-93d0-34f86e43e243 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:56.718696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:37:56.867540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-423a744c-3252-4670-93d0-34f86e43e243 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.229733 Oct 10 10:37:56.868998 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 60/146] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:56.881545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cefd4d80-73b2-4ec0-a635-8da5241be4f4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:56.942947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cefd4d80-73b2-4ec0-a635-8da5241be4f4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.067014 Oct 10 10:37:56.947382 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 61/147] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:56 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 10:37:56.957550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9781aa5f-8ce0-47c4-b5ef-1b8114dce19f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-392257609"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:56.968685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-9781aa5f-8ce0-47c4-b5ef-1b8114dce19f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 179c25df-217f-48de-bec1-5d283b13be4b for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.011499 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9781aa5f-8ce0-47c4-b5ef-1b8114dce19f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059098 Oct 10 10:37:57.012891 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 62/148] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.023955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d6e2ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.029234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.030107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.030763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.032564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.033517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.034294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.059598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] Request method failure captured: Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 142 Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YC5j-d0EuRdAVmvGWFWzfDK4Ald_iX0_e8mgBGG09yQ8GmAoURMfzpB4sLn1lVpis0bhHNq7MOWY9ybtJIhf-ifXUG1PsJhCO1_l9a8_y7RVlUZJF7SJLlxwForvpgWecauTcpADNR1BKK075SavUC8iCXU-i9q76ISyc6MeBaUfE Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: fa9b8cb2854e417ca483c08d133d713f Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsV2NegativeTest-1873626224 Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:57.063227 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa9b8cb2854e417ca483c08d133d713f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fa9b8cb2854e417ca483c08d133d713f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fa9b8cb2854e417ca483c08d133d713f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fa9b8cb2854e417ca483c08d133d713f"}]}] Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsV2NegativeTest-1873626224 Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: fa9b8cb2854e417ca483c08d133d713f Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1873626224 Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsV2NegativeTest-1873626224-project Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ffdda74708a43f59ee026ce307658a5 Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsV2NegativeTest-1873626224-project Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-197644077", "imageRef": "e01a6779-1da4-4c25-8ad4-0b0db092055e", "flavorRef": "452"}} Oct 10 10:37:57.064463 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: exception: Flavor's memory is too small for requested image. Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-197644077', 'imageRef': 'e01a6779-1da4-4c25-8ad4-0b0db092055e', 'flavorRef': '452'}}} Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.065127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.066159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 10 10:37:57.067274 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.071263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.072886 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e46a8c63-7009-4a66-9fe3-ab12d5f82e9f tempest-FlavorsV2NegativeTest-1873626224 tempest-FlavorsV2NegativeTest-1873626224-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.447390 Oct 10 10:37:57.073975 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 87/149] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:37:56 2022] POST /compute/v2.1/servers => generated 93 bytes in 449 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 10:37:57.074698 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf1bff38-536c-4304-b4c4-96a62ea39048 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.060460 Oct 10 10:37:57.075419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 63/150] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.081431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dab7f56d-fe94-411f-9f3c-a3b62b29de03 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.090401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d8780d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.095280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.096039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.097567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.098522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.099258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.099838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.123751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dab7f56d-fe94-411f-9f3c-a3b62b29de03 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.048180 Oct 10 10:37:57.127078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 88/151] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:57.138899 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a711140-aafb-4cfb-8661-8d1925942ded tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052324 Oct 10 10:37:57.141036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-525af48a-f3cc-4be2-92a6-4c28b0e4ef95 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.149246 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 64/152] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.154764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-525af48a-f3cc-4be2-92a6-4c28b0e4ef95 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 10 10:37:57.161213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d6e2790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-525af48a-f3cc-4be2-92a6-4c28b0e4ef95 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Request method failure captured: Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xcgn15pv726PtwKgAXbP3AEMl8m44NxEhRfRVbyDf2hHt233mASr-3eNGGSwFgAYexsq1u82LlQB6iGDax6wqrYsELptvitHs2mYBzTRHKE8DG6glYSNoBKcePD7Z_cvlxDiscx5I0W7r7op81QQjbQPsf7N2Ucg2xMarabcOt2QM Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:57.162372 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34000520b086477f9376d81dae451f23", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34000520b086477f9376d81dae451f23"}]}] Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ee3e2626d3fa41b6a31f039ae751dac2 Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: exception: Aggregate 5 could not be found. Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '5'} Oct 10 10:37:57.164380 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.165137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 10 10:37:57.169946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.172899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-525af48a-f3cc-4be2-92a6-4c28b0e4ef95 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.172899 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-525af48a-f3cc-4be2-92a6-4c28b0e4ef95 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.034503 Oct 10 10:37:57.172899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 89/153] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 10:37:57.177428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.178130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.179631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.180557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.181179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.181605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.184213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8586f38e-8637-41ac-b297-b892e80c9bec tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.206741 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8586f38e-8637-41ac-b297-b892e80c9bec tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8586f38e-8637-41ac-b297-b892e80c9bec tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Request method failure captured: Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xcgn15pv726PtwKgAXbP3AEMl8m44NxEhRfRVbyDf2hHt233mASr-3eNGGSwFgAYexsq1u82LlQB6iGDax6wqrYsELptvitHs2mYBzTRHKE8DG6glYSNoBKcePD7Z_cvlxDiscx5I0W7r7op81QQjbQPsf7N2Ucg2xMarabcOt2QM Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:57.208457 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34000520b086477f9376d81dae451f23", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34000520b086477f9376d81dae451f23"}]}] Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ee3e2626d3fa41b6a31f039ae751dac2 Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: exception: Aggregate 5 could not be found. Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '5'} Oct 10 10:37:57.209779 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:57.211596 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.214398 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8586f38e-8637-41ac-b297-b892e80c9bec tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8586f38e-8637-41ac-b297-b892e80c9bec tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033995 Oct 10 10:37:57.217947 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 90/154] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:57.220493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c68baf9-bffc-4ba5-ba28-769c1d4bb702 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.065327 Oct 10 10:37:57.220652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83354710-0e24-4c62-ac58-665b5f2cb35e tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1082268941"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.222780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-83354710-0e24-4c62-ac58-665b5f2cb35e tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid af87a6b6-d1d3-4675-a67e-84475892364e for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.223255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 65/155] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.229414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f13f990-4e89-4d41-a8f2-23ba57740ae2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1490965164", "name": "tempest-test_aggregate-1975509325"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.255528 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83354710-0e24-4c62-ac58-665b5f2cb35e tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042061 Oct 10 10:37:57.256056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-5f13f990-4e89-4d41-a8f2-23ba57740ae2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 3a6e0c76-f7f3-439c-ac19-c44c42ea45cc for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.258729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 91/156] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.270799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677d5c5f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.287876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.288293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.290602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.304525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f13f990-4e89-4d41-a8f2-23ba57740ae2 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.079232 Oct 10 10:37:57.305502 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 66/157] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.311529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36a979e2-5215-4bc8-b844-07075faab3e7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.315312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.315806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.316242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.327057 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90071061-4ba1-4949-8a81-b06b8af7cdee tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-860687-2" status: 200 len: 332 microversion: 2.1 time: 0.067288 Oct 10 10:37:57.327639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 92/158] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-hosts/n-h1-860687-2 => generated 332 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.328025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a979e2-5215-4bc8-b844-07075faab3e7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.329040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a979e2-5215-4bc8-b844-07075faab3e7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.329777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a979e2-5215-4bc8-b844-07075faab3e7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.334176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-738b05eb-b6a9-452e-aaab-8d6ef2decde5 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.362283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-738b05eb-b6a9-452e-aaab-8d6ef2decde5 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.033611 Oct 10 10:37:57.362974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 93/159] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:57.370934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Calling method '.version_select at 0x7f677ee08700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.379758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.380254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.386423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.404513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.405012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.405452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.425312 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8a28a5ab-a515-4667-86de-72e0f3b57707 tempest-HostsAdminTestJSON-1870473109 tempest-HostsAdminTestJSON-1870473109-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-860687-2" status: 200 len: 467 microversion: 2.1 time: 0.061217 Oct 10 10:37:57.425938 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 94/160] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-hosts/n-h2-860687-2 => generated 467 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.439812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc1ec8e4-4038-46c8-8c97-57cfc24e1c00 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.448208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cc1ec8e4-4038-46c8-8c97-57cfc24e1c00 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc1ec8e4-4038-46c8-8c97-57cfc24e1c00 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Request method failure captured: Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xcgn15pv726PtwKgAXbP3AEMl8m44NxEhRfRVbyDf2hHt233mASr-3eNGGSwFgAYexsq1u82LlQB6iGDax6wqrYsELptvitHs2mYBzTRHKE8DG6glYSNoBKcePD7Z_cvlxDiscx5I0W7r7op81QQjbQPsf7N2Ucg2xMarabcOt2QM Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:57.449823 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34000520b086477f9376d81dae451f23", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34000520b086477f9376d81dae451f23"}]}] Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ee3e2626d3fa41b6a31f039ae751dac2 Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: exception: Aggregate 7 could not be found. Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7'} Oct 10 10:37:57.451496 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.452420 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 10:37:57.454408 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.457164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc1ec8e4-4038-46c8-8c97-57cfc24e1c00 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.457164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc1ec8e4-4038-46c8-8c97-57cfc24e1c00 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.024321 Oct 10 10:37:57.457164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 95/161] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:57.461355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eae32b5e-4c4a-418a-bd98-ed54d836301d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.485142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-eae32b5e-4c4a-418a-bd98-ed54d836301d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eae32b5e-4c4a-418a-bd98-ed54d836301d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Request method failure captured: Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xcgn15pv726PtwKgAXbP3AEMl8m44NxEhRfRVbyDf2hHt233mASr-3eNGGSwFgAYexsq1u82LlQB6iGDax6wqrYsELptvitHs2mYBzTRHKE8DG6glYSNoBKcePD7Z_cvlxDiscx5I0W7r7op81QQjbQPsf7N2Ucg2xMarabcOt2QM Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:57.489642 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_34000520b086477f9376d81dae451f23", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/34000520b086477f9376d81dae451f23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/34000520b086477f9376d81dae451f23"}]}] Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 34000520b086477f9376d81dae451f23 Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1970345712 Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ee3e2626d3fa41b6a31f039ae751dac2 Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminTestJSON-1970345712-project-admin Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: exception: Aggregate 7 could not be found. Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7'} Oct 10 10:37:57.490907 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:57.491797 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.492831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eae32b5e-4c4a-418a-bd98-ed54d836301d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eae32b5e-4c4a-418a-bd98-ed54d836301d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035527 Oct 10 10:37:57.493937 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 96/162] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:57.507961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7326da1f-40f3-4b5e-a188-fca45bdd0a8f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-842326876"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.511380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-7326da1f-40f3-4b5e-a188-fca45bdd0a8f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 169e2fc9-43d2-4fea-855d-fbb95fb6e6ae for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.538104 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36a979e2-5215-4bc8-b844-07075faab3e7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.230967 Oct 10 10:37:57.539153 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 67/163] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.540880 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7326da1f-40f3-4b5e-a188-fca45bdd0a8f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.036222 Oct 10 10:37:57.541507 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 97/164] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.550971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.560250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-881debfb-0ab8-4e98-943c-e1b68b608eef tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.572081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.572300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.572795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.579728 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-881debfb-0ab8-4e98-943c-e1b68b608eef tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.021858 Oct 10 10:37:57.581146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 98/165] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.593532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0bce8296-0d2f-4893-8ad7-ad21d298f66e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.604098 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-860687-2. Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 39 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:57.621550 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: {"add_host": {"host": "n-h1-860687-2"}} Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:57.622823 n-d-860687-2 devstack@n-api.service[128801]: exception: Aggregate 6 already has host n-h1-860687-2. Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-860687-2'}}} Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:37:57.624050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860687-2-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 10:37:57.625144 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 10:37:57.626132 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:37:57.628096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860687-2-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 10, 37, 57, 591493), 'updated_at': None, 'host': 'n-h1-860687-2', 'aggregate_id': 6}] Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.629729 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-860687-2. Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.630869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-860687-2. Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:57.633560 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:57.636378 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-860687-2. Oct 10 10:37:57.636378 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:57.636378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-860687-2. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:57.636378 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7dd5e89-345f-4b58-bb61-31b9052a8fa4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.078871 Oct 10 10:37:57.636857 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0bce8296-0d2f-4893-8ad7-ad21d298f66e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.036386 Oct 10 10:37:57.636992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 68/166] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 10 10:37:57.637120 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 99/167] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.637246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.637385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:57.639343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc09ef04-794f-43c3-8e0c-ee9cd19e681f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.645917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.646501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.646945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.647740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.648195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.648716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.652808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc09ef04-794f-43c3-8e0c-ee9cd19e681f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:57.654841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc09ef04-794f-43c3-8e0c-ee9cd19e681f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:57.655549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc09ef04-794f-43c3-8e0c-ee9cd19e681f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:57.798454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:57.812747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:57.814694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:57.816445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16ed68c7-aadd-4de0-ae0f-43db5f264481 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.187665 Oct 10 10:37:57.817510 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 69/168] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:57.817627 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc09ef04-794f-43c3-8e0c-ee9cd19e681f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.182124 Oct 10 10:37:57.822620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d31a532-10a8-4817-84a1-4421329b097d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.825612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 100/169] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.830133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-978a1ae5-71cc-45d9-ae51-d9693303149f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.840667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d31a532-10a8-4817-84a1-4421329b097d tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.021595 Oct 10 10:37:57.841763 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 70/170] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:37:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.855124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c65784fc-70ce-4e3e-a8b1-644d69d606d4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:57.868865 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-978a1ae5-71cc-45d9-ae51-d9693303149f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.042134 Oct 10 10:37:57.870024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:57.870167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 101/171] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:57.881048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f8df5bd3-c882-4c04-8cf9-c98d36c310dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1088521026"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.887246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-f8df5bd3-c882-4c04-8cf9-c98d36c310dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid dae92beb-43be-49f0-8453-ac9fb66b26d0 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.891032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c65784fc-70ce-4e3e-a8b1-644d69d606d4 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.041183 Oct 10 10:37:57.891764 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 71/172] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:57 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 10:37:57.904043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8dacf9b7-d2b0-43b7-929f-aee2f739628f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851813800", "availability_zone": "tempest-test_az-265351655"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.908912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-8dacf9b7-d2b0-43b7-929f-aee2f739628f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid e851ac9f-4a5d-4e71-837a-2e18eae85bf3 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.953106 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8dacf9b7-d2b0-43b7-929f-aee2f739628f tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.054562 Oct 10 10:37:57.954982 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 72/173] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:57.962146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae0399dd-838c-47c0-84b7-ee6ee9443b33 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787490689"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:57.965805 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f8df5bd3-c882-4c04-8cf9-c98d36c310dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088983 Oct 10 10:37:57.966313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-ae0399dd-838c-47c0-84b7-ee6ee9443b33 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Generated uuid 2a13e1f3-0d3b-47a0-9ea6-0d43dcb86b24 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:57.968492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 102/174] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:58.000037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f36a9e0-82a9-43ea-a772-34e211c21280 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851813800_new", "availability_zone": "tempest-test_az-265351655_new"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.028545 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae0399dd-838c-47c0-84b7-ee6ee9443b33 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.072244 Oct 10 10:37:58.029849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 73/175] 10.222.0.16 () {62 vars in 1205 bytes} [Mon Oct 10 10:37:57 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:58.172751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f36a9e0-82a9-43ea-a772-34e211c21280 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.173357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f36a9e0-82a9-43ea-a772-34e211c21280 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.174437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f36a9e0-82a9-43ea-a772-34e211c21280 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.243768 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f36a9e0-82a9-43ea-a772-34e211c21280 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 334 microversion: 2.1 time: 0.258353 Oct 10 10:37:58.244587 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 103/176] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 10:37:57 2022] PUT /compute/v2.1/os-aggregates/10 => generated 334 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.258165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3eb9bee9-3496-4b57-9764-faee045c1e69 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-359563539"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.293729 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3eb9bee9-3496-4b57-9764-faee045c1e69 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.047697 Oct 10 10:37:58.294342 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 104/177] 10.222.0.16 () {62 vars in 1213 bytes} [Mon Oct 10 10:37:58 2022] PUT /compute/v2.1/os-aggregates/11 => generated 299 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:58.301194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-410215ad-16f4-40c1-9911-54cf27fcb97a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.310244 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-410215ad-16f4-40c1-9911-54cf27fcb97a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 789 microversion: 2.1 time: 0.014864 Oct 10 10:37:58.311198 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 105/178] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:37:58 2022] GET /compute/v2.1/os-aggregates => generated 789 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.315886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-930eff16-22c0-4700-a5c3-b9cae515cd50 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.324920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-930eff16-22c0-4700-a5c3-b9cae515cd50 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.012705 Oct 10 10:37:58.325492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 106/179] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:37:58 2022] GET /compute/v2.1/os-aggregates/11 => generated 299 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:58.333827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bba9d066-77e8-49e9-8f02-8368dd4aa56b tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.339329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bba9d066-77e8-49e9-8f02-8368dd4aa56b tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bba9d066-77e8-49e9-8f02-8368dd4aa56b tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 39 Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:58.341907 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: {"add_host": {"host": "n-h1-860687-2"}} Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:58.343261 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-860687-2'}}} Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:58.344043 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 10:37:58.345356 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.352312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d12a850e-42ef-4868-a697-8e0be9cffc23 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.352883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bba9d066-77e8-49e9-8f02-8368dd4aa56b tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:58.353982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bba9d066-77e8-49e9-8f02-8368dd4aa56b tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.322991 Oct 10 10:37:58.354633 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 74/180] 10.222.0.16 () {60 vars in 1191 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:58.360267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b33bd08-8395-4a39-a261-9f61caeadd98 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.382960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33bd08-8395-4a39-a261-9f61caeadd98 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.383307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33bd08-8395-4a39-a261-9f61caeadd98 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.383852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33bd08-8395-4a39-a261-9f61caeadd98 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.389930 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d12a850e-42ef-4868-a697-8e0be9cffc23 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.063113 Oct 10 10:37:58.390595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 107/181] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:58.396355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-08b3cc77-dbb1-4ccb-aa05-5d7284ee28ec tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.410688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:UPDATE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:37:58.439582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-08b3cc77-dbb1-4ccb-aa05-5d7284ee28ec tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.047615 Oct 10 10:37:58.440327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 108/182] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:58.460689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b7b4a51c-eacd-4b46-b3d4-b82b67240f54 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1560513013"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.466208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-b7b4a51c-eacd-4b46-b3d4-b82b67240f54 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Generated uuid 92563f0d-0760-46f8-a567-4b1fc0193ea0 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:58.520879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b7b4a51c-eacd-4b46-b3d4-b82b67240f54 tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073344 Oct 10 10:37:58.523471 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 109/183] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.542850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-adf91c8f-1481-4a47-9d02-68fe99c1a3e0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-305180109"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.556083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-adf91c8f-1481-4a47-9d02-68fe99c1a3e0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid a5f00003-6096-4962-940e-23f631126a2f for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:58.594893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b33bd08-8395-4a39-a261-9f61caeadd98 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 314 microversion: 2.41 time: 0.238568 Oct 10 10:37:58.597835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-adf91c8f-1481-4a47-9d02-68fe99c1a3e0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072173 Oct 10 10:37:58.605042 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 110/184] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.605220 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 75/185] 10.222.0.16 () {62 vars in 1235 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:58.610565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdeae648-2ab7-4f9e-a66f-51722d19910d tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.613768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-476c570d-2899-47cd-bb20-c494fc89c72a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.629058 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-476c570d-2899-47cd-bb20-c494fc89c72a tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 698 microversion: 2.1 time: 0.026481 Oct 10 10:37:58.629852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 111/186] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:37:58 2022] GET /compute/v2.1/os-aggregates => generated 698 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.631180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdeae648-2ab7-4f9e-a66f-51722d19910d tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.632251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdeae648-2ab7-4f9e-a66f-51722d19910d tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.634880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-488664282"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:58.635055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdeae648-2ab7-4f9e-a66f-51722d19910d tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.652803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.653219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.653694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.669717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.670212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.671035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.682450 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-488664282 could not be found. Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 57 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:58.700575 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: {"add_host": {"host": "tempest-nonexist_host-488664282"}} Oct 10 10:37:58.701905 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: exception: Compute host tempest-nonexist_host-488664282 could not be found. Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-488664282'}}} Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-488664282' is not mapped to any cell Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.702629 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 10 10:37:58.703744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-488664282 could not be found. Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-488664282 could not be found. Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.704780 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-488664282 could not be found. Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.705919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-488664282 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:58.706634 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24c0564d-9922-4079-9659-2d09c90e2d5f tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.071627 Oct 10 10:37:58.711339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 112/187] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:58.720628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-993d95b6-0051-4be9-994c-f1b84700763e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.755028 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-993d95b6-0051-4be9-994c-f1b84700763e tempest-AggregatesAdminTestJSON-1970345712 tempest-AggregatesAdminTestJSON-1970345712-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041583 Oct 10 10:37:58.755918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 113/188] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:58.780982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82e23fb3-f6db-4216-b103-68ab5531ef5d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.861449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdeae648-2ab7-4f9e-a66f-51722d19910d tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 299 microversion: 2.41 time: 0.255843 Oct 10 10:37:58.862077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 76/189] 10.222.0.16 () {62 vars in 1235 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:37:58.863807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82e23fb3-f6db-4216-b103-68ab5531ef5d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.100478 Oct 10 10:37:58.865969 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 114/190] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:58.873837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.874856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:58.883672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.884579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:58.889604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.893598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.894057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.894783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.896571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.898614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.899116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.899818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.900428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.900691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:58.901180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:58.901609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:58.927626 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] HTTP exception thrown: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Request method failure captured: Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 HTTP/1.1 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xae2ZEkyMsqpBXQtdqPKEychlRkAn6kl9OW-zpzfKtI0p_0n-i4Z_C5RocT78FmuCnf87x4S4kzF-WIqzkBGRgdZ3qabbZhbDcqwMnc-BnFyC5roQdUqS3NKdijLYX7rGxjludqzxeU9tPFF6OGDqNV-7UN8E-d48hg33g7qHo43E Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:58.930013 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6175c446137541038f09aaaab284c740", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6175c446137541038f09aaaab284c740"}]}] Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 93f8ecd3f474408e8d76257499ccc2e7 Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:58.931477 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c6c5737f-51c0-42aa-a158-a8f6db83fa51'} Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:58.932125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:58.933147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:58.940421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Returning 404 to user: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:58.941548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f39ef95f-fbc9-48fb-bc6f-df1cf0484a47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 404 len: 111 microversion: 2.1 time: 0.078568 Oct 10 10:37:58.942326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 77/191] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:58.950075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-778f588c-da10-4b4d-b984-74b95b5cb435 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:58.982500 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-778f588c-da10-4b4d-b984-74b95b5cb435 tempest-AggregatesAdminTestV241-294317890 tempest-AggregatesAdminTestV241-294317890-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.035537 Oct 10 10:37:58.985366 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 78/192] 10.222.0.16 () {60 vars in 1196 bytes} [Mon Oct 10 10:37:58 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:58.994551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62386ccb-065c-488b-ad47-2b4ab1c256c0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62386ccb-065c-488b-ad47-2b4ab1c256c0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 283 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:59.008362 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.009557 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:37:59.010121 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.010682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.011619 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.012450 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:37:59.012450 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:37:59.012450 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:37:59.012450 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.012450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62386ccb-065c-488b-ad47-2b4ab1c256c0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.013015 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62386ccb-065c-488b-ad47-2b4ab1c256c0 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026414 Oct 10 10:37:59.014481 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 79/193] 10.222.0.16 () {60 vars in 1165 bytes} [Mon Oct 10 10:37:58 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:37:59.026360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.028658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] [instance: c6c5737f-51c0-42aa-a158-a8f6db83fa51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:37:59.048627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:59.050490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:59.051957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:59.052678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:59.054742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:59.055218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:59.090496 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] HTTP exception thrown: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Request method failure captured: Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 HTTP/1.1 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xae2ZEkyMsqpBXQtdqPKEychlRkAn6kl9OW-zpzfKtI0p_0n-i4Z_C5RocT78FmuCnf87x4S4kzF-WIqzkBGRgdZ3qabbZhbDcqwMnc-BnFyC5roQdUqS3NKdijLYX7rGxjludqzxeU9tPFF6OGDqNV-7UN8E-d48hg33g7qHo43E Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:59.093728 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6175c446137541038f09aaaab284c740", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6175c446137541038f09aaaab284c740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6175c446137541038f09aaaab284c740"}]}] Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 6175c446137541038f09aaaab284c740 Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-583116092 Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 93f8ecd3f474408e8d76257499ccc2e7 Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-583116092-project Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:59.095396 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c6c5737f-51c0-42aa-a158-a8f6db83fa51'} Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.096255 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. Oct 10 10:37:59.097520 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.098571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] Returning 404 to user: Instance c6c5737f-51c0-42aa-a158-a8f6db83fa51 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.098571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ae730ae-ff3c-44b0-8f90-ed7aeba9af47 tempest-AggregatesAdminTestJSON-583116092 tempest-AggregatesAdminTestJSON-583116092-project] 10.222.0.16 "GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51" status: 404 len: 111 microversion: 2.1 time: 0.081339 Oct 10 10:37:59.098571 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 80/194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:37:59 2022] GET /compute/v2.1/servers/c6c5737f-51c0-42aa-a158-a8f6db83fa51 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:59.109835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.112224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6cdc70d-a54d-4fab-b023-068b693bee83 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.120988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.122545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.123939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-faf572bb-b97b-4429-9db9-bf130fc62aa7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.255985 Oct 10 10:37:59.124704 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 115/195] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:37:58 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6cdc70d-a54d-4fab-b023-068b693bee83 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 27 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:59.130551 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: {"aggregate": {"name": ""}} Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.132173 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.132880 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:37:59.134066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.135996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6cdc70d-a54d-4fab-b023-068b693bee83 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.135996 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6cdc70d-a54d-4fab-b023-068b693bee83 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.029142 Oct 10 10:37:59.135996 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 81/196] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:37:59.147334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79878a66-28f2-4f99-af1d-495bd277448d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1141190930"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.153130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79878a66-28f2-4f99-af1d-495bd277448d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79878a66-28f2-4f99-af1d-495bd277448d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 60 Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:59.154888 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: {"aggregate": {"name": "tempest-test_aggregate-1141190930"}} Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:59.156434 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1141190930'}}} Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:59.157326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:59.158608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 10:37:59.159927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.160116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79878a66-28f2-4f99-af1d-495bd277448d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.161043 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79878a66-28f2-4f99-af1d-495bd277448d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.022062 Oct 10 10:37:59.162035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 116/197] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:59.173144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e620e372-ba4e-4a06-a6d4-f5785be94cef tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659008137"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.176620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-e620e372-ba4e-4a06-a6d4-f5785be94cef tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid 5adf9d3b-41a6-4676-9f2c-d4a5c569e9e0 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:59.199807 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e620e372-ba4e-4a06-a6d4-f5785be94cef tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030122 Oct 10 10:37:59.200955 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 82/198] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:59.213411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659008137"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.216718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid d5cdf4ed-6f59-47f7-a891-d69cae71d831 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:59.229130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-659008137 already exists. Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 59 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:37:59.230861 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: {"aggregate": {"name": "tempest-test_aggregate-659008137"}} Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:59.232295 n-d-860687-2 devstack@n-api.service[128800]: exception: Aggregate tempest-test_aggregate-659008137 already exists. Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-659008137'}}} Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 10 10:37:59.233051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-659008137 already exists. Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.234041 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-659008137 already exists. Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-659008137 already exists. Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-659008137 already exists. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.235560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4adc7eb9-8224-42c0-841e-dff43b11d84d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.023547 Oct 10 10:37:59.236373 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 117/199] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 25 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:59.242313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cab6e91-8886-459f-ae97-4f96f5dba0e4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.263324 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cab6e91-8886-459f-ae97-4f96f5dba0e4 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.025098 Oct 10 10:37:59.264232 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 83/200] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:59 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:59.273415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7859a6c-f309-4a24-ba8d-627b655f27dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1591354188"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.277427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-a7859a6c-f309-4a24-ba8d-627b655f27dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid 05b291a0-f067-4941-bfb7-40dd7040a04a for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:59.304778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7859a6c-f309-4a24-ba8d-627b655f27dd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034814 Oct 10 10:37:59.305576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 118/201] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:37:59.316491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a2e247f-8ff7-4efe-b61c-906f960c2779 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.317986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a2e247f-8ff7-4efe-b61c-906f960c2779 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a2e247f-8ff7-4efe-b61c-906f960c2779 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:59.319614 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 10:37:59.320848 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '15'} Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.321525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.322564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a2e247f-8ff7-4efe-b61c-906f960c2779 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.323548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a2e247f-8ff7-4efe-b61c-906f960c2779 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.008307 Oct 10 10:37:59.323548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 84/202] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:59.331907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ec635ca-496c-4971-94c9-92b6daa1c553 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.354440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ec635ca-496c-4971-94c9-92b6daa1c553 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.026550 Oct 10 10:37:59.355147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 119/203] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:59.368069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0152a6d-8e07-4495-86ac-858da299ff56 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.390612 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f0152a6d-8e07-4495-86ac-858da299ff56 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0152a6d-8e07-4495-86ac-858da299ff56 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:59.392862 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: exception: Aggregate -1 could not be found. Oct 10 10:37:59.394173 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '-1'} Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:59.394904 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.395998 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0152a6d-8e07-4495-86ac-858da299ff56 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0152a6d-8e07-4495-86ac-858da299ff56 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030467 Oct 10 10:37:59.397148 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 85/204] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:59 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:59.404795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36a8847a-1579-4dc6-91b2-838a2bdabfdd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214076557"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.408900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-36a8847a-1579-4dc6-91b2-838a2bdabfdd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid b62971c4-0a82-4eb5-a521-475682765411 for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:59.436191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36a8847a-1579-4dc6-91b2-838a2bdabfdd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035333 Oct 10 10:37:59.437939 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 120/205] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:59.450154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94f18176-1780-4cf3-be29-16c37fdeb4b1 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.451996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94f18176-1780-4cf3-be29-16c37fdeb4b1 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94f18176-1780-4cf3-be29-16c37fdeb4b1 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:59.453827 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 10:37:59.455312 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '16'} Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.456055 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 10:37:59.457050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.459359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94f18176-1780-4cf3-be29-16c37fdeb4b1 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.461834 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94f18176-1780-4cf3-be29-16c37fdeb4b1 tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015541 Oct 10 10:37:59.462371 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 86/206] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:59 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:37:59.473755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb04022c-b52c-4239-af29-208de8b710bd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.501321 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb04022c-b52c-4239-af29-208de8b710bd tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.031250 Oct 10 10:37:59.501978 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 121/207] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:37:59 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:37:59.511181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-715bee66-8ab5-4465-8fac-31b6176e04bf tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.519615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-715bee66-8ab5-4465-8fac-31b6176e04bf tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-715bee66-8ab5-4465-8fac-31b6176e04bf tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:37:59.521167 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: exception: Aggregate -1 could not be found. Oct 10 10:37:59.522900 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '-1'} Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.523780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 10:37:59.524842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.525785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-715bee66-8ab5-4465-8fac-31b6176e04bf tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.525785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-715bee66-8ab5-4465-8fac-31b6176e04bf tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015372 Oct 10 10:37:59.525785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 87/208] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:37:59 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:37:59.532752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e7c406b-a2d5-4853-80bb-05602b65633d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:37:59.534523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e7c406b-a2d5-4853-80bb-05602b65633d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e7c406b-a2d5-4853-80bb-05602b65633d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:37:59.536123 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 10:37:59.537478 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.538715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 10:37:59.541378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.543443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e7c406b-a2d5-4853-80bb-05602b65633d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.544428 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e7c406b-a2d5-4853-80bb-05602b65633d tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015710 Oct 10 10:37:59.544957 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 122/209] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:37:59 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:37:59.557410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e5d0d15-e5ac-4635-91c0-d4e08124097d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1181715889"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.560934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-3e5d0d15-e5ac-4635-91c0-d4e08124097d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid cb993971-555b-466b-8e51-4399de228cca for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:37:59.584333 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e5d0d15-e5ac-4635-91c0-d4e08124097d tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.031386 Oct 10 10:37:59.586059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 88/210] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:59.597807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91cfce1e-db57-4ee4-b962-be2637f3db64 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.610490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91cfce1e-db57-4ee4-b962-be2637f3db64 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:59.610988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91cfce1e-db57-4ee4-b962-be2637f3db64 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:59.611507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91cfce1e-db57-4ee4-b962-be2637f3db64 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:37:59.773113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91cfce1e-db57-4ee4-b962-be2637f3db64 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.179243 Oct 10 10:37:59.775253 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 123/211] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:37:59.786758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7f8aaf9-243c-44b3-bc79-9e391e179e5a tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.791918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7f8aaf9-243c-44b3-bc79-9e391e179e5a tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9c140bb5945f4409a5046acfee18ae12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444fd351461749f385c16a8d1148c84f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7f8aaf9-243c-44b3-bc79-9e391e179e5a tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Request method failure captured: Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 42 Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XaBZFd7_GAh4GtJTmkbqPkAIAD6OTQsL1HWm5yvlaLFpWk3WXy078gTzXdXqMXpI38Be0vA5fCPeTHQ4pm3lT9TbxF1h69aFSF6KrJChT1UcGHjzgrMu58Gju2kMuQn-AKgIiz4Wdq8r-FVGUpF-qF2YdzZN__KhCOwCVgHJyWDXA Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:37:59.793617 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_444fd351461749f385c16a8d1148c84f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/444fd351461749f385c16a8d1148c84f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/444fd351461749f385c16a8d1148c84f"}]}] Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 444fd351461749f385c16a8d1148c84f Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-819276150 Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9c140bb5945f4409a5046acfee18ae12 Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-819276150-project Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: {"remove_host": {"host": "n-h1-860687-2"}} Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:37:59.795038 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-860687-2'}}} Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:37:59.795955 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 10:37:59.797188 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:37:59.798329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7f8aaf9-243c-44b3-bc79-9e391e179e5a tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:37:59.798329 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7f8aaf9-243c-44b3-bc79-9e391e179e5a tempest-AggregatesAdminNegativeTestJSON-819276150 tempest-AggregatesAdminNegativeTestJSON-819276150-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014669 Oct 10 10:37:59.799194 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 89/212] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:37:59.808631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79649cac-9e29-4c90-b9a5-ab4a81718c05 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:37:59.833707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79649cac-9e29-4c90-b9a5-ab4a81718c05 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:37:59.834224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79649cac-9e29-4c90-b9a5-ab4a81718c05 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:37:59.835309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79649cac-9e29-4c90-b9a5-ab4a81718c05 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:00.000653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79649cac-9e29-4c90-b9a5-ab4a81718c05 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.195943 Oct 10 10:38:00.018772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 124/213] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 10:37:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:00.035707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-21e84953-2cb3-465c-b6a2-6af992f8ec2c tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:00.080468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-21e84953-2cb3-465c-b6a2-6af992f8ec2c tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.054184 Oct 10 10:38:00.081416 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 125/214] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:38:00 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 10:38:00.097378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6721002-935d-4233-a88e-8d5fada7cea7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-845319879"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:00.103908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.aggregate [None req-c6721002-935d-4233-a88e-8d5fada7cea7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Generated uuid 3e5d136a-0c36-459c-bb84-09bae10aa83d for aggregate {{(pid=128800) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 10:38:00.140587 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6721002-935d-4233-a88e-8d5fada7cea7 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052647 Oct 10 10:38:00.142523 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 126/215] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 10:38:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:00.161593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:00.164098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:00.175299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:00.176790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:00.177433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:00.178404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:00.180137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:00.180817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:00.476222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:00.484327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:00.485953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:00.487521 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9ed5471-470f-404f-b866-ce5bdff54a05 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.336181 Oct 10 10:38:00.488502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 127/216] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:00 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:00.496140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:00.513033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:00.515517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:00.516983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:00.534792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:00.535381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:00.535870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:00.553460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc407f7c-02a3-4062-912f-09a877c6edde tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Calling method '.version_select at 0x7f677d6bf040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:00.554686 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.compute.aggregates [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 10:38:00.557092 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Request method failure captured: Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 42 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Xdn7lEJ6ylsUGkOrcoLmXmP7tP40cNDAGng_E5-xDEVtzy1GcE1jYcF28sQQyjtFadUAY6ArCJVuyDE4cg_vnzZqTSxHzN3SlW6fX82j9mFb6Mbum-hQXOMxYLOaXQZxKffCa_lfWSvj2MLhN6ZLHraw_osW7dpoWs5k9TK09MgcQ Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:38:00.563188 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98ca42359455481abe5617a997b23da0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98ca42359455481abe5617a997b23da0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98ca42359455481abe5617a997b23da0"}]}] Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98ca42359455481abe5617a997b23da0 Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981 Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bf7caa5a340641eaacaad08f4dad5428 Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: {"remove_host": {"host": "nonexist_host"}} Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:00.564515 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 10:38:00.568342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 10 10:38:00.570875 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.573169 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 10 10:38:00.574479 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:00.576918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:00.577988 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9dfd6434-e893-4cf5-bde1-4172df579a26 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.088187 Oct 10 10:38:00.578870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 128/217] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 10:38:00 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:38:01.025687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1449471447", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:01.079788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc407f7c-02a3-4062-912f-09a877c6edde tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 371 microversion: 2.1 time: 1.118670 Oct 10 10:38:01.080348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 90/218] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:37:59 2022] GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 371 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:01.083898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:01.086332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60be6671-ce50-4bb3-b544-bb72150d7486", "name": "network-vif-plugged", "status": "completed", "tag": "ea4a8da1-fc9a-4946-96aa-444543b59f2e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:01.096908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.097382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.097993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.111443 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] Creating event network-vif-plugged:ea4a8da1-fc9a-4946-96aa-444543b59f2e for instance 60be6671-ce50-4bb3-b544-bb72150d7486 on n-h2-860687-2 Oct 10 10:38:01.118326 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e1e3a2c6-0b2c-4e93-a10b-9dbe39cbeb39 req-9de86931-ad98-47c6-8e42-a6ef84ff3e40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036455 Oct 10 10:38:01.118915 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 91/219] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:01.125831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcc20c4f-3568-4d39-9a54-3110e8332291 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:01.154214 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcc20c4f-3568-4d39-9a54-3110e8332291 tempest-AggregatesAdminNegativeTestJSON-1101745981 tempest-AggregatesAdminNegativeTestJSON-1101745981-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.033625 Oct 10 10:38:01.155546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 92/220] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 10:38:01 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:38:01.161239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d720820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:01.584579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:01.585732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:01.586221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:01.586649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:01.587162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:01.596597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.597196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.597732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.599088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.599857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.601512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.621829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Getting quotas for project 4a59a0029fe648e3b94ef0355ba56118. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:01.626628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Getting quotas for user 66f6cf49e42242a887ee40e71649b54b and project 4a59a0029fe648e3b94ef0355ba56118. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:01.638503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:01.640842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:01.706447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb933ab3-6f20-463c-af86-0d5912d0850e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126161 Oct 10 10:38:01.714904 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 129/221] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:01.721216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:01.722038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:01.729385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.729886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.730318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.732060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.732656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.733501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.997888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:01.998381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:01.998826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:01.999596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:02.003612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:02.004330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:02.084175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:02.096181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:02.100970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:02.102096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27733c92-84e2-4b0f-8617-1cb6a0db52b6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.385927 Oct 10 10:38:02.117322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 130/222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:01 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:02.133531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bdd381d7-9a84-4f50-97d3-6483b7581f73 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:02.134368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bdd381d7-9a84-4f50-97d3-6483b7581f73 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:02.142894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1579cec8-27fa-4016-b0a6-a8072ae9014e tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 328 microversion: 2.1 time: 0.986044 Oct 10 10:38:02.145743 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 93/223] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:01 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 328 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:02.164819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:02.285910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bdd381d7-9a84-4f50-97d3-6483b7581f73 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:02.304245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bdd381d7-9a84-4f50-97d3-6483b7581f73 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1223 microversion: 2.1 time: 0.183615 Oct 10 10:38:02.305481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 131/224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:02 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:02.993781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-69428469", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:03.054618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:03.133301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:03.134466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:03.143721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.144627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.145973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.152524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.153061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.153506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.508447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:03.509571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:03.510377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:03.511024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:03.511654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:03.525011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.525897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.527417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.528872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.530478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.532573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.565764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:03.571326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:03.576299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for user b88186da37ce43b4a0b8dbee960fef05 and project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:03.584201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:03.588864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:03.593549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd426789-d737-4779-acbb-3a454ab9d908 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1359 microversion: 2.25 time: 0.465702 Oct 10 10:38:03.594661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 132/225] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:03 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.utils [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] cores quota exceeded for 98d2958bed7c49bbb1613864bd70c078, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128801) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Request method failure captured: Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 143 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YFKTV56py088ZHm3ysk8YE3C_atH1SaVWsoLOT5vGYjIR6Hy0RDSYl2OllfGk6U7gRYIJ3-FXMe4WTd0rZkd3oAeKDlthf5o4SOfdfmortPuku5QUdAs1E8RoXxUn2HJBp1eQ_mwWqkqTGqDTfO7jl8ZlkEXKbHh3WVQkmNAGzIYw Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:03.606411 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d2958bed7c49bbb1613864bd70c078", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d2958bed7c49bbb1613864bd70c078"}]}] Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: b88186da37ce43b4a0b8dbee960fef05 Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-69428469", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} Oct 10 10:38:03.607981 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-69428469', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452'}}} Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 10:38:03.610435 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:03.619507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.621533 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b6bbdf4-1485-43bb-8fb4-fee2bbb1fe92 tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.171468 Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 94/226] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:02 2022] POST /compute/v2.1/servers => generated 111 bytes in 1173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:03.623879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:03.624743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:03.624743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.624743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.625199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.626870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:03.626870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:03.627939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:03.642127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d695160>, body: {"quota_set": {"cores": 20}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:03.654476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:03.744690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:03.759417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4b0ee21-76bf-44ca-b3d0-5e34c9262958 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1281 microversion: 2.1 time: 0.149630 Oct 10 10:38:03.776960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 95/227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:03 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:04.484021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:04.484648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:04.485085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:04.486062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:04.486519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:04.486963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:04.633230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:04.634092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:04.655128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:04.657697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:04.658273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:04.661760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:04.662384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:04.663440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:04.666730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4fa26662-1429-40e1-9ffb-5a482c4a4632 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 329 microversion: 2.1 time: 1.038195 Oct 10 10:38:04.668602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 133/228] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:03 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 329 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:04.686916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92fe1bc0-3093-45e7-a9f2-d1433062ddcc tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Calling method '.version_select at 0x7f677d502a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:04.997230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:05.012049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:05.018411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:05.021463 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b9fcd56-6d68-417b-8cec-5a5a1a0da4a5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1555 microversion: 2.25 time: 0.399540 Oct 10 10:38:05.039509 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 96/229] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:04 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:38:05.039509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:05.039509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:05.075586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:05.093170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:05.101536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:05.102466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:05.104955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:05.105787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:05.455142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92fe1bc0-3093-45e7-a9f2-d1433062ddcc tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 371 microversion: 2.1 time: 0.776803 Oct 10 10:38:05.455460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:05.466397 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 134/230] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:38:04 2022] GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 371 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:38:05.507253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d580c08-b966-4cbe-aff2-5a34eddd3d3e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 0.474131 Oct 10 10:38:05.510484 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 97/231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:05 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:05.532830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d486550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:05.871657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:05.872376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:05.880552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:05.889213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:05.892012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:05.892819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:05.893291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:05.893716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.187829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 60be6671-ce50-4bb3-b544-bb72150d7486 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:06.357221 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0506cdb1-be88-4e2f-a2f2-6b97d14234aa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 2045 microversion: 2.25 time: 0.894972 Oct 10 10:38:06.357810 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 135/232] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:05 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 2045 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:06.388927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184307ff-6be6-48b6-b38a-7790cae55499", "tag": "0a6acf71-cf64-483e-9189-387743cc82ad"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:06.401068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.401864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.403459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.419478 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] Creating event network-changed:0a6acf71-cf64-483e-9189-387743cc82ad for instance 184307ff-6be6-48b6-b38a-7790cae55499 on n-h1-860687-2 Oct 10 10:38:06.427767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-67962c3b-61b3-40f5-b775-fe32a19c50e9 req-7e87ad9b-4356-4672-8c48-99e6c7a4b16f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067532 Oct 10 10:38:06.432667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 136/233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:06.440745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:06.441743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:06.451388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.452204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.452709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.453529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.454085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.454592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.486712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:06.516514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.517021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.517468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.518214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.518808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.519273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.629871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3cc4fc84-0087-4fdd-ae7f-9ced5e312c9a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 328 microversion: 2.1 time: 1.117702 Oct 10 10:38:06.632703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 98/234] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:05 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 328 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:06.643254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:06.644916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:06.652018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.654403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.655413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.656339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:06.656948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:06.658204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:06.864473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 60be6671-ce50-4bb3-b544-bb72150d7486 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:06.868966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:06.886876 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f121c1b-790e-48ed-bea2-e1cd55906cc8 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 2045 microversion: 2.25 time: 0.451738 Oct 10 10:38:06.891074 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 137/235] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:06 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 2045 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:07.015628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d695670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:07.017421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.017911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.018352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.060872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.062906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.065450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.090698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.091209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:07.091357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.091691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.105640 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf47403a-36a0-47c4-92d2-77647eca0d05 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.216733 Oct 10 10:38:07.107144 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 138/236] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:38:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:07.122876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b31abe2-0f6e-46c6-adaa-75c15d80bb16 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 0.488907 Oct 10 10:38:07.135025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 99/237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:06 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:07.135405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1266344885", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:07.152003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:07.156447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.156864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.163879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.165152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.167140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.171362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.248969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:07.272472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ab6dfc4-4ff0-4591-a979-25adf1c3ca1f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.138519 Oct 10 10:38:07.274642 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 100/238] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Oct 10 10:38:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:07.285689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d486af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:07.287506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.288572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.289009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.323941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.324941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.325530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.356035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.356528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.356971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.380160 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c5559dd-06dd-4e5d-a76b-e74ca791584b tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.104400 Oct 10 10:38:07.381814 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 101/239] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:38:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:07.386477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": "auto"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:07.398567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:07.406062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.411765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.412412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.413819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:07.417213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:07.417890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:07.579450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'flavor' on Instance uuid 60be6671-ce50-4bb3-b544-bb72150d7486 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:07.954364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:38:07.981346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:07.982335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:07.982969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:07.983545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:07.984116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:08.005671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:08.009343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:08.011674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:08.012927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:08.014767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:08.015666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:08.123167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:08.139749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for user b88186da37ce43b4a0b8dbee960fef05 and project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:08.174253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.utils [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] instances quota exceeded for 98d2958bed7c49bbb1613864bd70c078, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128800) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 10:38:08.178986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Request method failure captured: Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 145 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YFKTV56py088ZHm3ysk8YE3C_atH1SaVWsoLOT5vGYjIR6Hy0RDSYl2OllfGk6U7gRYIJ3-FXMe4WTd0rZkd3oAeKDlthf5o4SOfdfmortPuku5QUdAs1E8RoXxUn2HJBp1eQ_mwWqkqTGqDTfO7jl8ZlkEXKbHh3WVQkmNAGzIYw Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:08.190831 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d2958bed7c49bbb1613864bd70c078", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d2958bed7c49bbb1613864bd70c078"}]}] Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b88186da37ce43b4a0b8dbee960fef05 Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1266344885", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} Oct 10 10:38:08.192091 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1266344885', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452'}}} Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 10:38:08.192892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:08.194453 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.195865 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 10:38:08.197018 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:08.199905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:08.203287 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57af6a08-b297-487c-82d6-c9bf8e40391c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.094928 Oct 10 10:38:08.211998 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 139/240] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:07 2022] POST /compute/v2.1/servers => generated 119 bytes in 1104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:08.226889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d55ef70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:08.237169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:08.238548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:08.244263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:08.312868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:08.313608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:08.314366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:08.328574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:08.329604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:08.330386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:08.343127 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b13daa2-519f-4318-b029-cebee78b3ddb tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127128 Oct 10 10:38:08.344372 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 140/241] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:38:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:08.617432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-70070694", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:08.721066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:09.072529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:09.073711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:09.074342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:09.074895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:09.075491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:09.092946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:09.093704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:09.098097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:09.099147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:09.099780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:09.101194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:09.145664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Getting quotas for project 8f9b3653c3204aa69ed5178fef1e45ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:09.150677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Getting quotas for user b49c6dc16297446d8cac3f1cdc24cb26 and project 8f9b3653c3204aa69ed5178fef1e45ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:09.163709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:09.166324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:09.272616 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3265bb5-a199-4ca6-af33-9ab1446e9ee6 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925927 Oct 10 10:38:09.273672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 141/242] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:09.283139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:09.283751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:09.296806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:09.300349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:09.301059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:09.301994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:09.307521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:09.308188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.059782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:10.090030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0b63dcb-5cb8-4b45-ae27-1140c0497574 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 0.810232 Oct 10 10:38:10.093955 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 142/243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:09 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:10.111918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d7e3550>, body: {"quota_set": {"instances": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:10.531508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.533901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.540489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.549231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.551292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.553708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.727270 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f4d0e86-b3de-44ec-b038-6f97ccb32937 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 329 microversion: 2.1 time: 0.630466 Oct 10 10:38:10.732953 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 143/244] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:10 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 329 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:10.738891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d49a160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:10.741538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.742109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.748532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.788561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.789779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.790447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.814959 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fafc8fdb-4528-4100-829d-b7f8e0dcb4b4 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.083885 Oct 10 10:38:10.829267 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 144/245] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:38:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:10.838458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:10.839125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:10.846493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.847526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.848294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.849338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:10.850091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:10.851190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:10.969736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:10.981310 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0bb28c20-8000-4df7-9375-4bbac551dde4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1270 microversion: 2.1 time: 0.148919 Oct 10 10:38:10.998393 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 145/246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:10 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:11.329563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:11.331341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:11.331954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:11.332253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:11.332987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:11.333436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:11.333853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:11.354551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=29 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:11.439277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1797269c-2632-47df-a7da-0875201bc728 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.439382 Oct 10 10:38:11.443670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 146/247] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Oct 10 10:38:10 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:11.465726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9c9f876-4381-4872-9d1d-cf0905fbd4b8 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Calling method '.version_select at 0x7f677d3c70d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:11.924306 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32c4b94f-2a9c-4a3f-b421-f7521e56e0fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486/action" status: 202 len: 0 microversion: 2.25 time: 4.541166 Oct 10 10:38:11.925053 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 102/248] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:38:07 2022] POST /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486/action => generated 0 bytes in 4543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:38:11.931224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6268a872-2941-48f2-b8d4-3131b70d272a tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d373790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:11.936858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9c9f876-4381-4872-9d1d-cf0905fbd4b8 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 371 microversion: 2.1 time: 0.490784 Oct 10 10:38:11.937949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6268a872-2941-48f2-b8d4-3131b70d272a tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:11.938728 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 147/249] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:38:11 2022] GET /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:11.939803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6268a872-2941-48f2-b8d4-3131b70d272a tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:11.941970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6268a872-2941-48f2-b8d4-3131b70d272a tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:11.952850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:11.953885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:11.971290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:11.973583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:11.974552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:11.975670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:11.976510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:11.977293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.030328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6268a872-2941-48f2-b8d4-3131b70d272a tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.103765 Oct 10 10:38:12.033836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 103/250] 10.222.0.16 () {58 vars in 1179 bytes} [Mon Oct 10 10:38:11 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:12.044445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:12.046224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.046948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.050751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.051654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.055140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.055649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.076498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=31 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:12.114349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-460bcbe3-c779-423d-a21f-0aaa906a2f02 tempest-AZAdminV2TestJSON-1137616426 tempest-AZAdminV2TestJSON-1137616426-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.079423 Oct 10 10:38:12.119441 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 104/251] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:38:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:12.126176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:12.126674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:12.145337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.145771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.146383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.147375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.147837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.148262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.327964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:12.339308 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c4b5d16-43c5-4251-8e47-ad4b10165bf3 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 0.398103 Oct 10 10:38:12.351478 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 148/252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:11 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:12.363361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d49a3a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:12.707402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:12.724699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:12.737626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:12.742534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1e604d4-c976-4507-9d14-410c7e1f15f4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.621932 Oct 10 10:38:12.743901 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 105/253] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:12 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:12.770020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:12.770645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:12.777329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.777882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.778386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.779387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.780016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.780420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.791180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.791992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.793314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.794069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.794530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.794967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.825446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:12.880799 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48b2390b-1689-4f39-b81a-17c4fb69f05a tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 325 microversion: 2.1 time: 0.527911 Oct 10 10:38:12.882343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 149/254] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:12 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 325 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:12.887467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d4c30d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:12.889785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.890725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.891384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.898118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:12.910360 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bf5065b-0831-4ff3-ad77-92b709cad57a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1276 microversion: 2.1 time: 0.153805 Oct 10 10:38:12.911919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 106/255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:12 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:12.951560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.958023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.958478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:12.994045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:12.994552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:12.996251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.005958 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd262bda-ca5b-4e01-b2b3-842a9a8e7f19 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.122011 Oct 10 10:38:13.008886 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 150/256] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:38:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:13.020186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d3c7b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:13.023148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.023792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.024240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.044332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.045665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.046277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.058317 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8bd12f7a-0f2a-4d5d-96e9-4e8d8f80a7d0 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042964 Oct 10 10:38:13.059465 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 151/257] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:38:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:38:13.078685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d3c7a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:13.087569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.088365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.090538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.122658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.125010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.126795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.147890 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1cd359d5-1f57-43e3-8411-070959b735d1 tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.075480 Oct 10 10:38:13.171982 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 152/258] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:38:13 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:13.171982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-108615598", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:13.247895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:13.458888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-468f75fc-e61c-4ca5-840d-a769745ac1ef tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Calling method '.version_select at 0x7f677dacbd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:13.607987 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-468f75fc-e61c-4ca5-840d-a769745ac1ef tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.691359 Oct 10 10:38:13.608856 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 107/259] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:38:12 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:13.616468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Calling method '.version_select at 0x7f677d486790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:13.655680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.660545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.663373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.699965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.701445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.702251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.721971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.722845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.723941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.781041 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b683eca2-e42a-46c5-8295-c0a61c58cfbd tempest-HypervisorAdminTestJSON-252153580 tempest-HypervisorAdminTestJSON-252153580-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.170015 Oct 10 10:38:13.784061 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 108/260] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Oct 10 10:38:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:13.881196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:13.881752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:13.882086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:13.882589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:13.883298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:13.902222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.904357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.904970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.906609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:13.907894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:13.909239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:13.958448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:13.974667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Getting quotas for user b88186da37ce43b4a0b8dbee960fef05 and project 98d2958bed7c49bbb1613864bd70c078. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:13.995943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.utils [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] ram quota exceeded for 98d2958bed7c49bbb1613864bd70c078, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128800) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 10:38:13.997083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Request method failure captured: Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 144 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YFKTV56py088ZHm3ysk8YE3C_atH1SaVWsoLOT5vGYjIR6Hy0RDSYl2OllfGk6U7gRYIJ3-FXMe4WTd0rZkd3oAeKDlthf5o4SOfdfmortPuku5QUdAs1E8RoXxUn2HJBp1eQ_mwWqkqTGqDTfO7jl8ZlkEXKbHh3WVQkmNAGzIYw Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:13.999451 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d2958bed7c49bbb1613864bd70c078", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d2958bed7c49bbb1613864bd70c078"}]}] Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b88186da37ce43b4a0b8dbee960fef05 Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-108615598", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} Oct 10 10:38:14.000714 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-108615598', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452'}}} Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 10:38:14.002023 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:14.003656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.006894 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 10:38:14.009022 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.011371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:14.012439 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55b2e6a8-b7cc-41d6-9a6a-c7b69854969a tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.857791 Oct 10 10:38:14.013319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 153/261] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 861 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:14.020432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:14.021710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:14.031084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.031794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.032434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:14.033408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.034589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.035498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:14.401705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c70ce863-b9a4-4e4e-a992-954057a10052 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1074319869", "ram": 512, "vcpus": 1, "disk": 10, "id": 1782641422, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:14.435100 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c70ce863-b9a4-4e4e-a992-954057a10052 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.648933 Oct 10 10:38:14.443804 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 109/262] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:13 2022] POST /compute/v2.1/flavors => generated 416 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:14.443804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c01f7f13-9bc6-4b4c-b5e4-409fbf266d47 tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Action: 'create', calling method: .version_select at 0x7f677d309af0>, body: {"pool": "non_exist_pool"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:14.590970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c01f7f13-9bc6-4b4c-b5e4-409fbf266d47 tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] HTTP exception thrown: Floating IP pool not found. Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c01f7f13-9bc6-4b4c-b5e4-409fbf266d47 tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Request method failure captured: Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 26 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YU2HvJ6L17hS5yL_w78h3eoxG-kowvOeSU1zscFzqcbkptACji1L2MTM41siKJgLj0urwj2_YMB1YoHWTadiX2d_bNGcMMRtlOO9D5S7WlJGP5u1wX-E3eIxlKLG5rTDnUDQTY4lYesegY5pxSO1qTY9cOeo4EpD6PbpBhkz4Bgz0 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 40fa69fc556346a199362e661ae94144 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:14.595986 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40fa69fc556346a199362e661ae94144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40fa69fc556346a199362e661ae94144", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40fa69fc556346a199362e661ae94144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40fa69fc556346a199362e661ae94144"}]}] Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 40fa69fc556346a199362e661ae94144 Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsNegativeTestJSON-1858167056-project Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a65c5917778d43e5a6c8a7352e780814 Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1858167056-project Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: {"pool": "non_exist_pool"} Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: exception: Floating IP pool not found. Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 10 10:38:14.597513 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:14.598606 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c01f7f13-9bc6-4b4c-b5e4-409fbf266d47 tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Returning 404 to user: Floating IP pool not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:14.601844 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c01f7f13-9bc6-4b4c-b5e4-409fbf266d47 tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.163898 Oct 10 10:38:14.602713 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 110/263] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:38:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:38:14.610263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:14.619522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:14.636819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.637574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.638012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:14.639230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.640094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.640943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:14.790585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:14.800415 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1d47383e-5348-4d06-b705-c0b732a2bd1b tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 0.785869 Oct 10 10:38:14.801251 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 154/264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:14 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:14.807102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:14.807964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:14.814427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.815136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.815756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:14.816736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:14.817345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:14.819068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.077000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:15.092797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:15.094579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:15.095887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fdd3918-60c0-4409-bc7e-076e9f918c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.492174 Oct 10 10:38:15.096522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 111/265] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:14 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:15.111172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Action: 'update', calling method: .version_select at 0x7f677d3099d0>, body: {"quota_set": {"ram": 51200}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:15.165477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:15.175699 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-53a4cdb7-4ca5-4c2c-9c29-9d1af67a3552 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 0.373221 Oct 10 10:38:15.192291 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 155/266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:14 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:15.213132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184307ff-6be6-48b6-b38a-7790cae55499", "name": "network-vif-plugged", "status": "completed", "tag": "0a6acf71-cf64-483e-9189-387743cc82ad"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:15.251949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.253183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.254328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.271014 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] Creating event network-vif-plugged:0a6acf71-cf64-483e-9189-387743cc82ad for instance 184307ff-6be6-48b6-b38a-7790cae55499 on n-h1-860687-2 Oct 10 10:38:15.278182 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-82b3a0e5-5278-41be-9fc9-44a7878889fe req-897011dd-c96a-4bd7-8fad-1125849eda83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084430 Oct 10 10:38:15.279373 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 156/267] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:15.284942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f83904b4-bc3b-4e49-83b6-f434c8aa46f5 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:15.348993 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f83904b4-bc3b-4e49-83b6-f434c8aa46f5 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066595 Oct 10 10:38:15.356318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 157/268] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:15 2022] POST /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:15.367571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Calling method '.version_select at 0x7f677d4c35e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:15.541346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 38954ceb-a759-4c32-9522-cf78adecf845 could not be found", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:38:15.542391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] HTTP exception thrown: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Request method failure captured: Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-floating-ips/38954ceb-a759-4c32-9522-cf78adecf845 HTTP/1.1 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YU2HvJ6L17hS5yL_w78h3eoxG-kowvOeSU1zscFzqcbkptACji1L2MTM41siKJgLj0urwj2_YMB1YoHWTadiX2d_bNGcMMRtlOO9D5S7WlJGP5u1wX-E3eIxlKLG5rTDnUDQTY4lYesegY5pxSO1qTY9cOeo4EpD6PbpBhkz4Bgz0 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 40fa69fc556346a199362e661ae94144 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:15.558795 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40fa69fc556346a199362e661ae94144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40fa69fc556346a199362e661ae94144", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40fa69fc556346a199362e661ae94144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40fa69fc556346a199362e661ae94144"}]}] Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 40fa69fc556346a199362e661ae94144 Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1858167056 Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsNegativeTestJSON-1858167056-project Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a65c5917778d43e5a6c8a7352e780814 Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1858167056-project Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: exception: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845 Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '38954ceb-a759-4c32-9522-cf78adecf845'} Oct 10 10:38:15.560417 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:38:15.561318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 38954ceb-a759-4c32-9522-cf78adecf845 could not be found Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c459a2e-d726-4711-a3f1-fd44e0c61b21'] Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845. Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:15.562582 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845 Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:15.564125 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:15.565449 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845 Oct 10 10:38:15.565449 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:15.565449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] Returning 404 to user: Floating IP not found for ID 38954ceb-a759-4c32-9522-cf78adecf845 {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:15.566062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-646fe6e9-234d-43b1-9a63-c3387f8c03dd tempest-FloatingIPsNegativeTestJSON-1858167056 tempest-FloatingIPsNegativeTestJSON-1858167056-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/38954ceb-a759-4c32-9522-cf78adecf845" status: 404 len: 111 microversion: 2.1 time: 0.210758 Oct 10 10:38:15.567379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 158/269] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:38:15 2022] DELETE /compute/v2.1/os-floating-ips/38954ceb-a759-4c32-9522-cf78adecf845 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:15.604817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=57 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:15.623484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.623998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.624454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.625204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.625659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.626081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.807395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff1d2b8d-adb6-4176-a63f-6fa931258c44 tempest-QuotasAdminNegativeTest-389223120 tempest-QuotasAdminNegativeTest-389223120-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 200 len: 329 microversion: 2.1 time: 0.709586 Oct 10 10:38:15.816962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 112/270] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:15 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 329 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:15.823150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60be6671-ce50-4bb3-b544-bb72150d7486", "name": "network-vif-unplugged", "status": "completed", "tag": "ea4a8da1-fc9a-4946-96aa-444543b59f2e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:15.840027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.841105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.841990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.857134 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] Creating event network-vif-unplugged:ea4a8da1-fc9a-4946-96aa-444543b59f2e for instance 60be6671-ce50-4bb3-b544-bb72150d7486 on n-h2-860687-2 Oct 10 10:38:15.864720 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cafe356c-475f-4442-8617-c1a8e65365fa req-614bcf6b-d355-4112-9af9-7aa0cc0d7efc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046311 Oct 10 10:38:15.865954 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 113/271] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:15.873805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:15.875420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:15.885004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.885863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.887042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:15.888076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:15.889041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:15.890001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:16.060194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d005465b-2b9a-45bb-bb1b-6b70e208751a tempest-FlavorsExtraSpecsTestJSON-1972881223 tempest-FlavorsExtraSpecsTestJSON-1972881223-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:16.070814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d005465b-2b9a-45bb-bb1b-6b70e208751a tempest-FlavorsExtraSpecsTestJSON-1972881223 tempest-FlavorsExtraSpecsTestJSON-1972881223-project] 10.222.0.16 "GET /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.502191 Oct 10 10:38:16.071977 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 159/272] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Oct 10 10:38:15 2022] GET /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:16.077551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b057e8d-e7c6-4977-bcfd-8d505dd5d72c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Action: 'update', calling method: .version_select at 0x7f677d2e6ee0>, body: {"quota_set": {"ram": 0}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:16.085886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b057e8d-e7c6-4977-bcfd-8d505dd5d72c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b88186da37ce43b4a0b8dbee960fef05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d2958bed7c49bbb1613864bd70c078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b057e8d-e7c6-4977-bcfd-8d505dd5d72c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Request method failure captured: Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 HTTP/1.1 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 25 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YFKTV56py088ZHm3ysk8YE3C_atH1SaVWsoLOT5vGYjIR6Hy0RDSYl2OllfGk6U7gRYIJ3-FXMe4WTd0rZkd3oAeKDlthf5o4SOfdfmortPuku5QUdAs1E8RoXxUn2HJBp1eQ_mwWqkqTGqDTfO7jl8ZlkEXKbHh3WVQkmNAGzIYw Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:16.088614 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d2958bed7c49bbb1613864bd70c078", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d2958bed7c49bbb1613864bd70c078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d2958bed7c49bbb1613864bd70c078"}]}] Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 98d2958bed7c49bbb1613864bd70c078 Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-274836224 Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b88186da37ce43b4a0b8dbee960fef05 Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-QuotasAdminNegativeTest-274836224-project Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: {"quota_set": {"ram": 0}} Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 10:38:16.089874 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '98d2958bed7c49bbb1613864bd70c078', 'body': {'quota_set': {'ram': 0}}} Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:16.090659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:16.092225 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b057e8d-e7c6-4977-bcfd-8d505dd5d72c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:16.094782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b057e8d-e7c6-4977-bcfd-8d505dd5d72c tempest-QuotasAdminNegativeTest-274836224 tempest-QuotasAdminNegativeTest-274836224-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078" status: 403 len: 116 microversion: 2.1 time: 0.019850 Oct 10 10:38:16.096145 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 160/273] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:38:16 2022] PUT /compute/v2.1/os-quota-sets/98d2958bed7c49bbb1613864bd70c078 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:16.110076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58d7f331-71e1-4dad-895b-df3d234e41e4 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:16.144582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58d7f331-71e1-4dad-895b-df3d234e41e4 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043326 Oct 10 10:38:16.145968 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 161/274] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:16 2022] POST /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:16.153134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:16.154099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:16.162373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:16.163357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:16.164057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:16.164934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:16.165534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:16.167126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:16.988800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:17.008315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd48a12f-513f-4544-a342-8326f30255b0 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1323 microversion: 2.1 time: 1.139151 Oct 10 10:38:17.009570 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 114/275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:15 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1323 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:17.017349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da8a5d19-9830-403f-94b0-1bfe87bb83f5 tempest-FlavorsExtraSpecsTestJSON-1972881223 tempest-FlavorsExtraSpecsTestJSON-1972881223-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.028535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da8a5d19-9830-403f-94b0-1bfe87bb83f5 tempest-FlavorsExtraSpecsTestJSON-1972881223 tempest-FlavorsExtraSpecsTestJSON-1972881223-project] 10.222.0.16 "GET /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015962 Oct 10 10:38:17.031816 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 115/276] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:17.044711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.045342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:17.061682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:17.062624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:17.063596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:17.064718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:17.066217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:17.070596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:17.127773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:17.136506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:17.139639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:17.141554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b715df42-9073-46d1-8004-956074062c56 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.993725 Oct 10 10:38:17.143647 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 162/277] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:16 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:17.153129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6407703-a85f-48be-a578-3d026e556e19 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:17.196233 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6407703-a85f-48be-a578-3d026e556e19 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051298 Oct 10 10:38:17.197465 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 163/278] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:17 2022] POST /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:17.212268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75571979-2ace-4e3c-94b6-84fa9cf87717 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.222612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75571979-2ace-4e3c-94b6-84fa9cf87717 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019436 Oct 10 10:38:17.223522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 164/279] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:17.233623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c45a918e-1478-414e-ad53-571751ed2374 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:17.270630 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c45a918e-1478-414e-ad53-571751ed2374 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040808 Oct 10 10:38:17.271841 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 165/280] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Oct 10 10:38:17 2022] PUT /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes => generated 22 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:38:17.283522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e3fad13-40f8-4fc2-bbf3-1703bae0488f tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.292582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e3fad13-40f8-4fc2-bbf3-1703bae0488f tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015193 Oct 10 10:38:17.293451 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 166/281] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/flavors/1782641422/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:17.305732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-53541c9c-fc87-428e-8684-3198bd7d1eb8 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.371450 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-53541c9c-fc87-428e-8684-3198bd7d1eb8 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.070237 Oct 10 10:38:17.374312 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 167/282] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:38:17 2022] DELETE /compute/v2.1/flavors/1782641422/os-extra_specs/hw:numa_nodes => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 10:38:17.387060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e61ad0f0-8759-452f-a04c-a2999291e30d tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.404951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:17.438291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e61ad0f0-8759-452f-a04c-a2999291e30d tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1782641422/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.055223 Oct 10 10:38:17.443928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 168/283] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:38:17 2022] DELETE /compute/v2.1/flavors/1782641422/os-extra_specs/hw:cpu_policy => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 10:38:17.454263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f114667-48f3-42b6-a303-0365f9e82598 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.467627 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f114667-48f3-42b6-a303-0365f9e82598 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1782641422/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018784 Oct 10 10:38:17.468726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 169/284] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/flavors/1782641422/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:38:17.483205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e7974b87-4519-4b84-9a91-7cabc2fd8755 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.533893 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e7974b87-4519-4b84-9a91-7cabc2fd8755 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1782641422" status: 202 len: 0 microversion: 2.1 time: 0.057046 Oct 10 10:38:17.536056 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 170/285] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:38:17 2022] DELETE /compute/v2.1/flavors/1782641422 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:38:17.550569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9d34a03-3039-4396-b527-b26ad0849a97 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:17.582948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9d34a03-3039-4396-b527-b26ad0849a97 tempest-FlavorsExtraSpecsTestJSON-1808607308 tempest-FlavorsExtraSpecsTestJSON-1808607308-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043277 Oct 10 10:38:17.584296 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 171/286] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:17.654692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:17.664017 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94c3b932-94ae-4a40-bcc3-352a38aa7e60 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 0.625863 Oct 10 10:38:17.679796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 116/287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:17 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:17.945316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68e8bdd-3297-441e-b005-73316716f59a", "tag": "aeb261d2-64a6-4434-b098-35f424267773"}, {"name": "network-changed", "server_uuid": "60be6671-ce50-4bb3-b544-bb72150d7486", "tag": "ea4a8da1-fc9a-4946-96aa-444543b59f2e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:17.966790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:17.970317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:17.971329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.006413 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Creating event network-changed:aeb261d2-64a6-4434-b098-35f424267773 for instance f68e8bdd-3297-441e-b005-73316716f59a on n-h2-860687-2 Oct 10 10:38:18.008960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] Creating event network-changed:ea4a8da1-fc9a-4946-96aa-444543b59f2e for instance 60be6671-ce50-4bb3-b544-bb72150d7486 on n-h2-860687-2 Oct 10 10:38:18.031352 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-13d3fae3-bd05-48ee-935c-58bf4f4b28cc req-afb729a7-86ee-40e1-864c-2270d154b7e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086176 Oct 10 10:38:18.032034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 172/288] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:38:18.037803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:18.040052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:18.057372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.058095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.058716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.059607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.060218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.060794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.175029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:18.176186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:18.188410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.189252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.189902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.191721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.195086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.195770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.688281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:18.713067 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b77d2fe7-224b-482e-a10f-a1982987bebd tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1472 microversion: 2.1 time: 0.675456 Oct 10 10:38:18.715880 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 117/289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:18 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:18.724578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:18.726035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:18.742635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:18.750304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.750596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.751673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.752978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.753149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:18.754488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.754624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:18.755242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.765431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:18.768065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ebd642c-969f-4eb9-9bf7-64c5716e4f0e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.597448 Oct 10 10:38:18.768708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 173/290] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:18 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:18.783290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:18.783290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:18.794146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.794647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.795122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.795855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.796342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.796774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.845102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Request method failure captured: Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499/diagnostics HTTP/1.1 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YFNWqIe0zyeG80LM3cue0-u8GUDBdR93P7Idm5z4quZ34BYP61WfbTeJZVPGIyBSA6o9_Q7Ad9Izg5a6lI8Nlh-C-XdTLlEok-7yb-GvwYkjU6EnDO15qafbV3L11GPseDdSp7kdUaKNM5RRtzyFZNqNyJ-mUi2O7frPkvzk4ipvA Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4a59a0029fe648e3b94ef0355ba56118 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:18.846972 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a59a0029fe648e3b94ef0355ba56118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a59a0029fe648e3b94ef0355ba56118", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a59a0029fe648e3b94ef0355ba56118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a59a0029fe648e3b94ef0355ba56118"}]}] Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4a59a0029fe648e3b94ef0355ba56118 Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerDiagnosticsNegativeTest-399701019-project Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 66f6cf49e42242a887ee40e71649b54b Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-399701019-project Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:18.848687 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': '184307ff-6be6-48b6-b38a-7790cae55499'} Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:18.850714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:18.851845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:18.852752 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3944790f-9545-43f3-a24c-e891338b407e tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.078781 Oct 10 10:38:18.852752 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 174/291] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:38:18 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499/diagnostics => generated 117 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:18.863379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:18.863885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:18.877373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.877878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.878316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.892057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:18.892800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:18.893431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:18.952002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:38:19.017089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:19.118752 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e7bab20-9021-4307-800c-6d1da54ff515 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "DELETE /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 204 len: 0 microversion: 2.1 time: 0.259335 Oct 10 10:38:19.120272 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 175/292] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:38:18 2022] DELETE /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:38:19.128845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:19.130259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:19.149039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:19.149882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:19.150528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:19.151491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:19.152141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:19.152757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:19.778123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:19.793937 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdcd9da2-dfb6-4255-87fc-6f65b6a693bd tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 1.075321 Oct 10 10:38:19.795745 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 118/293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:18 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:19.811820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:19.813802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:19.831373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:19.831899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:19.835350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:19.836406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:19.836879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:19.837302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:20.452187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:20.465226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5eca5a67-6bdf-4a01-8cd4-bbe87b2b9e1a tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1478 microversion: 2.1 time: 1.340489 Oct 10 10:38:20.468848 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 176/294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:19 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1478 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:20.514860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:20.536128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:20.541273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:20.543904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d4e3c77-8725-45a7-aff6-8aaf2fd4a582 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.746454 Oct 10 10:38:20.545523 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 119/295] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:19 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:20.825560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:20.827690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:20.855922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:20.856445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:20.856892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:20.857620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:20.858078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:20.858506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.199048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Calling method '.version_select at 0x7f677d1ff670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:21.201191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.201844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.202299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.231266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.231770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.232210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.268311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.270238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.275206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.289620 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-596da902-6c69-4f78-bb8e-9e6fb796a00f tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.468566 Oct 10 10:38:21.299231 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 120/296] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:38:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:21.306310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Calling method '.version_select at 0x7f677d385280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:21.310546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.312160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.314745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.384808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.385678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.386623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.401835 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa190616-6128-466d-862d-6078817f68ae tempest-HypervisorAdminV228Test-1169676960 tempest-HypervisorAdminV228Test-1169676960-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.098802 Oct 10 10:38:21.403122 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 121/297] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:38:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:21.493947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:21.495895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:21.504881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.506237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.507100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.508301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.509293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.509950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.930660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:21.944339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04a26556-df2d-4d89-88ef-653bf200757d tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 1.124676 Oct 10 10:38:21.944967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 177/298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:20 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:21.961325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:21.969350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:21.982579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:21.995719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:21.997147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:21.998571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:22.002097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:22.002689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:22.621849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:22.642066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbcb1d7c-a1bd-4394-a5bb-803c2ce68467 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1478 microversion: 2.1 time: 1.154207 Oct 10 10:38:22.667024 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 122/299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:21 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1478 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:23.001162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:23.036212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:23.040783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:23.041997 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ebd57a3-ec3b-46ae-bb72-7c864cb395b0 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 1.096077 Oct 10 10:38:23.042549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 178/300] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:21 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:23.084525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:23.085677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:23.116988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.118663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.121799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.122806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.123448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.124018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.389571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1613357596", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:23.515538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:23.519196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:23.523491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:23.524278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:23.525061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:23.552374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.555202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.561187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.562637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.564126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.565157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.628867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Getting quotas for project eed541f09ff74833b043530ada9f819a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:23.635058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Getting quotas for user 4380ac95681141f29d1db6b20666cbf2 and project eed541f09ff74833b043530ada9f819a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:23.648744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:23.651445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:23.721101 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af4e7ff5-c518-46a7-bc1e-b26a0f02eba3 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.063539 Oct 10 10:38:23.722658 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 123/301] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:38:23.733757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:23.734807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:23.745242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:23.751291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.753637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.757663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.758952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:23.759917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:23.760657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:23.931255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:23.988080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=70 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:24.444438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:24.453058 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eaed154d-a0c0-4447-8ffd-26bb6232fdd4 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1436 microversion: 2.1 time: 0.729068 Oct 10 10:38:24.458133 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 124/302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:23 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1436 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:24.470211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:24.472741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:24.688159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:24.698838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:24.700330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:24.723527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc599639-4d14-45de-9de9-60b5bd3e3620 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "PUT /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1359 microversion: 2.75 time: 0.265634 Oct 10 10:38:24.731899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 125/303] 10.222.0.16 () {62 vars in 1297 bytes} [Mon Oct 10 10:38:24 2022] PUT /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:24.774968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:24.777610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:24.792071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:24.793913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:24.795896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:24.798196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:24.798823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:24.801133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:24.969498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:24.985974 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5e17f47-4788-499d-88bf-123179ecdff5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 1.930776 Oct 10 10:38:24.988448 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 179/304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:23 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:24.997226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184307ff-6be6-48b6-b38a-7790cae55499", "name": "network-vif-deleted", "tag": "0a6acf71-cf64-483e-9189-387743cc82ad"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:25.039872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.040619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.041426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.071100 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] Creating event network-vif-deleted:0a6acf71-cf64-483e-9189-387743cc82ad for instance 184307ff-6be6-48b6-b38a-7790cae55499 on n-h1-860687-2 Oct 10 10:38:25.085165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-160457d5-02b0-410c-b8cd-b3030b57400b req-c273e500-ff21-4f42-a584-421ddfdf6f21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093633 Oct 10 10:38:25.086745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 180/305] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:25.102712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:25.106604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:25.122764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.123394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.123991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.124884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.126635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.127111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.393691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.407136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.410740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.431440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe9fceaf-a9ef-4c9c-b227-6d4d01046017 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1363 microversion: 2.75 time: 0.339643 Oct 10 10:38:25.437667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 181/306] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:25 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:25.484151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:25.484769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:25.497288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.502015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.502577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.503444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.503812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.504234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.643340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:25.644224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:25.644932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:25.648983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lazy-loading 'fault' on Instance uuid 184307ff-6be6-48b6-b38a-7790cae55499 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:25.761695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.778008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.781069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.783009 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e247281a-6535-4080-b6f2-b77fe6dbd92d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 1.031140 Oct 10 10:38:25.784327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 126/307] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:24 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:25.968027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6cf49e42242a887ee40e71649b54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a59a0029fe648e3b94ef0355ba56118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:25.979262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e59ce3a-4950-4793-9f5f-2c95154c0228 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 200 len: 1313 microversion: 2.1 time: 0.499559 Oct 10 10:38:25.997057 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 182/308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:25 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:26.012764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:26.014502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:26.025558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:26.029552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:26.030212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:26.032461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:26.034071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:26.035533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:26.887721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:26.901211 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30d6e7f7-2d7a-4371-a965-a9c616e4aa41 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 0.892453 Oct 10 10:38:26.914962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 127/309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:26 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:26.938940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:26.940767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:26.952018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:26.952807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:26.953417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:26.954312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:26.955064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:26.955724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.033247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a1fc5d0-fe56-4f1c-bd14-010308d14fac tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1472953845", "ram": 512, "vcpus": 1, "disk": 10, "id": 1642916514, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:27.061719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a1fc5d0-fe56-4f1c-bd14-010308d14fac tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.604210 Oct 10 10:38:27.065554 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 183/310] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:26 2022] POST /compute/v2.1/flavors => generated 416 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:38:27.080162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68e8bdd-3297-441e-b005-73316716f59a", "name": "network-vif-plugged", "status": "completed", "tag": "aeb261d2-64a6-4434-b098-35f424267773"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:27.116420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.116994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.117505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.138060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.138547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] Creating event network-vif-plugged:aeb261d2-64a6-4434-b098-35f424267773 for instance f68e8bdd-3297-441e-b005-73316716f59a on n-h2-860687-2 Oct 10 10:38:27.147608 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6d51da58-ffea-4289-a138-7de944f14531 req-59ea70b2-e33c-4bc3-a83f-aef6365bbf66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080700 Oct 10 10:38:27.148380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 184/311] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:27.159599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.160820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:27.162687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.166423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:27.172104 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce663ca9-e486-45e8-a8b6-520512162c02 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1417 microversion: 2.75 time: 0.243800 Oct 10 10:38:27.174469 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 128/312] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:26 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1417 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:27.184361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.185148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.185833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.186779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.189509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.190239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.208131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:27.209844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] [instance: 184307ff-6be6-48b6-b38a-7790cae55499] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:27.217263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.218314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.219261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.220215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.220979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.221510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.259225 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] HTTP exception thrown: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Request method failure captured: Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 HTTP/1.1 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YFNWqIe0zyeG80LM3cue0-u8GUDBdR93P7Idm5z4quZ34BYP61WfbTeJZVPGIyBSA6o9_Q7Ad9Izg5a6lI8Nlh-C-XdTLlEok-7yb-GvwYkjU6EnDO15qafbV3L11GPseDdSp7kdUaKNM5RRtzyFZNqNyJ-mUi2O7frPkvzk4ipvA Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4a59a0029fe648e3b94ef0355ba56118 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:27.261518 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a59a0029fe648e3b94ef0355ba56118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a59a0029fe648e3b94ef0355ba56118", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a59a0029fe648e3b94ef0355ba56118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a59a0029fe648e3b94ef0355ba56118"}]}] Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4a59a0029fe648e3b94ef0355ba56118 Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-399701019 Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiagnosticsNegativeTest-399701019-project Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66f6cf49e42242a887ee40e71649b54b Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-399701019-project Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. Oct 10 10:38:27.262782 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '184307ff-6be6-48b6-b38a-7790cae55499'} Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:27.263519 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. Oct 10 10:38:27.264601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.268278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] Returning 404 to user: Instance 184307ff-6be6-48b6-b38a-7790cae55499 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:27.269556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-917b4435-8a4b-45ec-91ce-72d63e788a54 tempest-ServerDiagnosticsNegativeTest-399701019 tempest-ServerDiagnosticsNegativeTest-399701019-project] 10.222.0.16 "GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499" status: 404 len: 111 microversion: 2.1 time: 0.093689 Oct 10 10:38:27.274389 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 129/313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:27 2022] GET /compute/v2.1/servers/184307ff-6be6-48b6-b38a-7790cae55499 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:27.806316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.811598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92484aad-46d1-49da-9cf3-a3eb66b6d873 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:27.829490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.832949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.842632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54ac57cb-086e-4e1e-ac26-72c1a5449581 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.690865 Oct 10 10:38:27.843185 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-92484aad-46d1-49da-9cf3-a3eb66b6d873 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] HTTP exception thrown: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:27.848094 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 185/314] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:27 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92484aad-46d1-49da-9cf3-a3eb66b6d873 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Request method failure captured: Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yg7kzuU8O8QYSOH1h7sWnlnf41lJxw4D-0kuktOauTlw4x7htOitaH_Tef4zTdxwaF09GLuo4kRF4eKIXsTMgea_Ary0SsIidz6d7Al3vQKM_t9SjxmuLAtCFSzxXYF9-7Jqjg6_Dp98RFoX_hsmFjdFptDuoabmUjcRl5GiHcslw Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:27.851060 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84f9023054154d34bc811e92679e7424", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84f9023054154d34bc811e92679e7424"}]}] Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5eeff6370f20459796cf0f53d0727579 Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:27.852320 n-d-860687-2 devstack@n-api.service[128801]: exception: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'flavor_id': '1642916514', 'id': 'hw:cpu_thread_policy'} Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:27.852981 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:27.854143 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.856148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92484aad-46d1-49da-9cf3-a3eb66b6d873 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Returning 404 to user: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:27.857812 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92484aad-46d1-49da-9cf3-a3eb66b6d873 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] 10.222.0.16 "GET /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.581891 Oct 10 10:38:27.881303 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 130/315] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 10:38:27 2022] GET /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 585 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:27.883354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69f511ac-eeb9-46be-a1ba-edc607f22575 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:27.890169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69f511ac-eeb9-46be-a1ba-edc607f22575 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5eeff6370f20459796cf0f53d0727579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9023054154d34bc811e92679e7424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69f511ac-eeb9-46be-a1ba-edc607f22575 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Request method failure captured: Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/flavors/1642916514/os-extra_specs HTTP/1.1 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 66 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Yg7kzuU8O8QYSOH1h7sWnlnf41lJxw4D-0kuktOauTlw4x7htOitaH_Tef4zTdxwaF09GLuo4kRF4eKIXsTMgea_Ary0SsIidz6d7Al3vQKM_t9SjxmuLAtCFSzxXYF9-7Jqjg6_Dp98RFoX_hsmFjdFptDuoabmUjcRl5GiHcslw Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:27.895291 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84f9023054154d34bc811e92679e7424", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84f9023054154d34bc811e92679e7424"}]}] Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 5eeff6370f20459796cf0f53d0727579 Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 10 10:38:27.897202 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'flavor_id': '1642916514', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:27.898175 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 10:38:27.899221 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:27.904062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69f511ac-eeb9-46be-a1ba-edc607f22575 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:27.906400 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69f511ac-eeb9-46be-a1ba-edc607f22575 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] 10.222.0.16 "POST /compute/v2.1/flavors/1642916514/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.029635 Oct 10 10:38:27.909545 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 186/316] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:27 2022] POST /compute/v2.1/flavors/1642916514/os-extra_specs => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:27.927915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:27.928887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:27.931194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73a2b57d-8209-416f-b0a7-42ce0ade83c8 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:27.941600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.944266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.945736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:27.948713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:27.949445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:27.951182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:28.025437 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73a2b57d-8209-416f-b0a7-42ce0ade83c8 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1642916514/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.107637 Oct 10 10:38:28.028781 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 131/317] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:27 2022] POST /compute/v2.1/flavors/1642916514/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:28.041752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0090488c-bc99-4257-add0-00b0f5583608 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.046399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0090488c-bc99-4257-add0-00b0f5583608 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5eeff6370f20459796cf0f53d0727579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9023054154d34bc811e92679e7424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0090488c-bc99-4257-add0-00b0f5583608 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Request method failure captured: Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yg7kzuU8O8QYSOH1h7sWnlnf41lJxw4D-0kuktOauTlw4x7htOitaH_Tef4zTdxwaF09GLuo4kRF4eKIXsTMgea_Ary0SsIidz6d7Al3vQKM_t9SjxmuLAtCFSzxXYF9-7Jqjg6_Dp98RFoX_hsmFjdFptDuoabmUjcRl5GiHcslw Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:28.054946 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84f9023054154d34bc811e92679e7424", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84f9023054154d34bc811e92679e7424"}]}] Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5eeff6370f20459796cf0f53d0727579 Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:28.056420 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'flavor_id': '1642916514', 'id': 'hw:numa_nodes'} Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:28.057191 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 10:38:28.058482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.065509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0090488c-bc99-4257-add0-00b0f5583608 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:28.066599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0090488c-bc99-4257-add0-00b0f5583608 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032894 Oct 10 10:38:28.074806 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 132/318] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:38:28 2022] DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:28.080490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5b219bf-6a2e-44d2-a6e6-b1cbb310f09b tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:28.156652 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5b219bf-6a2e-44d2-a6e6-b1cbb310f09b tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1642916514/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080525 Oct 10 10:38:28.157310 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 133/319] 10.222.0.16 () {60 vars in 1224 bytes} [Mon Oct 10 10:38:28 2022] POST /compute/v2.1/flavors/1642916514/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:28.179793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c098f31-4fed-42ff-a78e-e76d087a2b52 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:28.186518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c098f31-4fed-42ff-a78e-e76d087a2b52 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5eeff6370f20459796cf0f53d0727579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f9023054154d34bc811e92679e7424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c098f31-4fed-42ff-a78e-e76d087a2b52 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Request method failure captured: Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 22 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yg7kzuU8O8QYSOH1h7sWnlnf41lJxw4D-0kuktOauTlw4x7htOitaH_Tef4zTdxwaF09GLuo4kRF4eKIXsTMgea_Ary0SsIidz6d7Al3vQKM_t9SjxmuLAtCFSzxXYF9-7Jqjg6_Dp98RFoX_hsmFjdFptDuoabmUjcRl5GiHcslw Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:38:28.194031 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84f9023054154d34bc811e92679e7424", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84f9023054154d34bc811e92679e7424"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84f9023054154d34bc811e92679e7424"}]}] Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84f9023054154d34bc811e92679e7424 Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5eeff6370f20459796cf0f53d0727579 Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: {"hw:numa_nodes": "1"} Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:28.195968 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'flavor_id': '1642916514', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:28.196693 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 10:38:28.198048 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.200911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c098f31-4fed-42ff-a78e-e76d087a2b52 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:28.202699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c098f31-4fed-42ff-a78e-e76d087a2b52 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010 tempest-FlavorsExtraSpecsNegativeTestJSON-1392944010-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035813 Oct 10 10:38:28.212243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 134/320] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Oct 10 10:38:28 2022] PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes => generated 124 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:28.221997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.227634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:28.245195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:28.247065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:28.248522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:28.249681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:28.252795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:28.253633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:28.457525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.474096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.476248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.494015 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d63cddd-bc6f-4ec8-935c-956ced48d39d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1417 microversion: 2.75 time: 0.280066 Oct 10 10:38:28.505199 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 135/321] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:28 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1417 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:28.548234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e9a3da3-ebc9-4adf-a2da-fb7c407c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.567400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1e9a3da3-ebc9-4adf-a2da-fb7c407c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] HTTP exception thrown: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e9a3da3-ebc9-4adf-a2da-fb7c407c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Request method failure captured: Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yi1fhy3M9DptAO1NjKHVuOWwYbvZZu-qqa1LzHLR90ESKhV3PnmXeIxrsrWjcl37A10SgVeDCVt1LBv6dCAjjGdM1b_-U9lnimQulL-D-sO9gIIG_Qn8BbZXSWKiJXZ3h5NnxUKcvwtufm75n5ExlNOA4OSQJmJ7jP5btEo47_CUI Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:28.600904 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92a42e1be03f49628d05362077a3c146", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92a42e1be03f49628d05362077a3c146"}]}] Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3428bc3c43894628ab5f5aa7d156d8b1 Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:28.602170 n-d-860687-2 devstack@n-api.service[128801]: exception: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'flavor_id': '1642916514', 'id': 'hw:cpu_thread_policy'} Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.602807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.604022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e9a3da3-ebc9-4adf-a2da-fb7c407c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Returning 404 to user: Flavor 1642916514 has no extra specs with key hw:cpu_thread_policy. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:28.606448 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e9a3da3-ebc9-4adf-a2da-fb7c407c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.076736 Oct 10 10:38:28.607824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:28.612260 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 136/322] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:38:28 2022] DELETE /compute/v2.1/flavors/1642916514/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:28.628437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-447c1a77-73eb-4c6c-acf4-78bf9e042421 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:28.635632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22f6b807-18a1-4e0e-94fe-d32173d375ed tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1318 microversion: 2.1 time: 0.707972 Oct 10 10:38:28.636907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 187/323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:27 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:28.641165 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-447c1a77-73eb-4c6c-acf4-78bf9e042421 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-447c1a77-73eb-4c6c-acf4-78bf9e042421 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Request method failure captured: Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 27 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yi1fhy3M9DptAO1NjKHVuOWwYbvZZu-qqa1LzHLR90ESKhV3PnmXeIxrsrWjcl37A10SgVeDCVt1LBv6dCAjjGdM1b_-U9lnimQulL-D-sO9gIIG_Qn8BbZXSWKiJXZ3h5NnxUKcvwtufm75n5ExlNOA4OSQJmJ7jP5btEo47_CUI Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:28.644281 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92a42e1be03f49628d05362077a3c146", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92a42e1be03f49628d05362077a3c146"}]}] Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3428bc3c43894628ab5f5aa7d156d8b1 Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: {"hw:cpu_policy": "shared"} Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:28.645729 n-d-860687-2 devstack@n-api.service[128801]: exception: Request body and URI mismatch Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'flavor_id': '1642916514', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.647151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.648382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:28.648382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:28.648382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 10 10:38:28.648382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.651930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-447c1a77-73eb-4c6c-acf4-78bf9e042421 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:28.655357 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-447c1a77-73eb-4c6c-acf4-78bf9e042421 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.037511 Oct 10 10:38:28.658086 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 137/324] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Oct 10 10:38:28 2022] PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:38:28.670739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb93eca6-d3c2-4d46-a177-0042598eaaa4 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb93eca6-d3c2-4d46-a177-0042598eaaa4 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Request method failure captured: Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 49 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Yi1fhy3M9DptAO1NjKHVuOWwYbvZZu-qqa1LzHLR90ESKhV3PnmXeIxrsrWjcl37A10SgVeDCVt1LBv6dCAjjGdM1b_-U9lnimQulL-D-sO9gIIG_Qn8BbZXSWKiJXZ3h5NnxUKcvwtufm75n5ExlNOA4OSQJmJ7jP5btEo47_CUI Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:38:28.677406 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_92a42e1be03f49628d05362077a3c146", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/92a42e1be03f49628d05362077a3c146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/92a42e1be03f49628d05362077a3c146"}]}] Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 92a42e1be03f49628d05362077a3c146 Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3428bc3c43894628ab5f5aa7d156d8b1 Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 10 10:38:28.678960 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'flavor_id': '1642916514', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance: Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 10 10:38:28.679655 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.689653 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb93eca6-d3c2-4d46-a177-0042598eaaa4 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb93eca6-d3c2-4d46-a177-0042598eaaa4 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012632 Oct 10 10:38:28.693040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 188/325] 10.222.0.16 () {60 vars in 1265 bytes} [Mon Oct 10 10:38:28 2022] PUT /compute/v2.1/flavors/1642916514/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:38:28.696396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7eeb790-4bc1-42fe-b444-8e6382e38ef1 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.729896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7eeb790-4bc1-42fe-b444-8e6382e38ef1 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1642916514" status: 202 len: 0 microversion: 2.1 time: 0.043945 Oct 10 10:38:28.734759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 138/326] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:38:28 2022] DELETE /compute/v2.1/flavors/1642916514 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:38:28.743659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e2d9641-e51d-4733-8af1-1f74e7187605 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.805632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e2d9641-e51d-4733-8af1-1f74e7187605 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412 tempest-FlavorsExtraSpecsNegativeTestJSON-652661412-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069759 Oct 10 10:38:28.824528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 189/327] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:38:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:28.879089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:28.879711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:28.891583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:28.893134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:28.893585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:28.901518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:28.901518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:28.901518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.249625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.259285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.261379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.263088 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7581062-7f0a-42a8-a908-6a7de68420bb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1565 microversion: 2.25 time: 0.390573 Oct 10 10:38:29.280026 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 139/328] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:28 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1565 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:29.532953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:29.534012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:29.553037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.553804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.554460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.555978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.558591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.559227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.668872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:29.669849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:29.688442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.689907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.690357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.695426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.699168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.699654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.830104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.844936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.846417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:29.861866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-012cf525-8b57-43fd-a197-4f2d9d7d1912 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1438 microversion: 2.75 time: 0.332844 Oct 10 10:38:29.889485 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 190/329] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:29 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1438 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:29.897755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:29.910500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:29.928159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.929090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.930348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:29.933009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:29.933658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:29.934660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.086679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:30.087619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:30.088374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:30.089081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:30.089909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:30.231968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:30.249779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.251351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.252602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.254761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.256558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.257014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.538616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:30.551577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:30.557449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:30.568727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9fda9bae-cfc6-4fbf-be31-e2286f480e50 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "POST /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a/action" status: 202 len: 1495 microversion: 2.75 time: 0.675480 Oct 10 10:38:30.571859 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 191/330] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:38:29 2022] POST /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a/action => generated 1495 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 10:38:30.588811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:30.589977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:30.611165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.613752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.617352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.620173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.620786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.622759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.737549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:30.749395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d2a4013-121e-407d-9679-ea5aa6945fda tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1468 microversion: 2.1 time: 1.084378 Oct 10 10:38:30.802700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 140/331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:29 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1468 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:30.824181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:30.827833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:30.846615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.847997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.848442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:30.849937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:30.850570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:30.850992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:31.049740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.061036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.063388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.073006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a9cc89c-c799-4951-9a1c-685cf93d0f2e tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.267257 Oct 10 10:38:31.074433 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 141/332] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:30 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:31.275897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.288611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.290096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:31.296990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37e609af-43d9-4871-aa32-98884dd32294 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1555 microversion: 2.25 time: 0.722915 Oct 10 10:38:31.299092 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 192/333] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:30 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1555 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:31.410758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:31.412438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:31.464315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:31.467723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:31.468305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:31.469677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:31.470912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:31.475114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:31.602226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ab36052-6de3-4912-9fa7-4c11d3fc15aa tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] Calling method '.version_select at 0x7f677d2daca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:31.633603 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ab36052-6de3-4912-9fa7-4c11d3fc15aa tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.331574 Oct 10 10:38:31.635402 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 193/334] 10.222.0.16 () {60 vars in 1226 bytes} [Mon Oct 10 10:38:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:31.647966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b3d602b-b1a7-4ff9-976a-493eb0bc1c81 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '.version_select at 0x7f677d2dadc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:31.653388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3d602b-b1a7-4ff9-976a-493eb0bc1c81 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:31.654210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3d602b-b1a7-4ff9-976a-493eb0bc1c81 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:31.654916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3d602b-b1a7-4ff9-976a-493eb0bc1c81 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:31.674613 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5b3d602b-b1a7-4ff9-976a-493eb0bc1c81 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.034763 Oct 10 10:38:31.676787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 194/335] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Oct 10 10:38:31 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:31.686728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d080a88b-61b2-47d8-b89b-0f15d851c079 tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] Action: 'update', calling method: .version_select at 0x7f677d2ad160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:31.691446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:38:31.914970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cc3869b-e224-48d8-87e3-5f528df0cf66 tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 204 len: 0 microversion: 2.1 time: 0.838905 Oct 10 10:38:31.915717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 142/336] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:38:31 2022] DELETE /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:38:31.926684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:31.930478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:31.955727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:31.957593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:31.960062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:31.961026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:31.962907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:31.965094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:32.113408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=84,nova_api:UPDATE=6,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:32.231507 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d080a88b-61b2-47d8-b89b-0f15d851c079 tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.551131 Oct 10 10:38:32.238895 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 195/337] 10.222.0.16 () {62 vars in 1247 bytes} [Mon Oct 10 10:38:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:32.244925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:32.245875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:32.253002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:32.253552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:32.254017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:32.254762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:32.255904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:32.256636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:32.279708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:32.743279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:32.761445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 60be6671-ce50-4bb3-b544-bb72150d7486 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:32.923529 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5f91c45-0319-4c60-93ee-e05c1d4bf671 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 2045 microversion: 2.25 time: 1.005049 Oct 10 10:38:32.928624 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 143/338] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:31 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 2045 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:32.942762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:32.944594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:32.983319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:32.984545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:32.985260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:32.986380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:32.987172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:32.987598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:32.997387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:33.005793 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6bf8ecb-057c-4310-8a1a-68a69b174aa3 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1474 microversion: 2.1 time: 0.765105 Oct 10 10:38:33.006625 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 196/339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:32 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1474 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:33.020751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-534e30d4-f391-459a-af8f-6fbb384980fa tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] Calling method '.version_select at 0x7f677d1ef670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:33.043755 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-534e30d4-f391-459a-af8f-6fbb384980fa tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.031934 Oct 10 10:38:33.050766 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 197/340] 10.222.0.16 () {60 vars in 1226 bytes} [Mon Oct 10 10:38:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:33.060033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d10b6ee2-5d34-4b2e-9434-702026c0c7df tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] Action: 'update', calling method: .version_select at 0x7f677d1ef790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:33.143912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:33.158135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:33.163253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:33.174973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abd08fbf-780a-4c26-90f5-392757bc0331 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.237613 Oct 10 10:38:33.177163 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 144/341] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:32 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:33.184282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-422503288", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "62cb77a7-f0f1-4c26-8da8-dc077cf999d2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:33.195533 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d10b6ee2-5d34-4b2e-9434-702026c0c7df tempest-QuotaClassesAdmin257Test-885882463 tempest-QuotaClassesAdmin257Test-885882463-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.141294 Oct 10 10:38:33.196484 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 198/342] 10.222.0.16 () {62 vars in 1247 bytes} [Mon Oct 10 10:38:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:33.290081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] validate_networks() for [('62cb77a7-f0f1-4c26-8da8-dc077cf999d2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:33.588632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:34.030427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:34.031179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:34.044185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.046845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.047632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.049103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.049853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.050397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.340940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:34.341510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:34.341853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:34.342266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:34.342670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:34.365331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.365821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.366271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.366984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.367479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.367864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.408712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:34.417165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:34.421433 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e35335d-43f5-4283-84a7-9ddd311b449b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1474 microversion: 2.1 time: 0.395030 Oct 10 10:38:34.423080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 199/343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:34 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:34.441316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for user 78daecbab97943d5a26534e791ae8107 and project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:34.472903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:34.477130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:34.573691 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4140c4a1-09ed-4b31-a895-050e63206259 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.393129 Oct 10 10:38:34.574904 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 145/344] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:38:34.594754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:34.600055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:34.611326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.612115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.613653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.618893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:34.619707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:34.621782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:34.816955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:34.831572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:34.835490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:34.847307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a11980e2-2789-442a-b58a-9768b8554487 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.271074 Oct 10 10:38:34.850713 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 146/345] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:34 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:34.865814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:34.866631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:34.869104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:35.039071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:35.047335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-166580399", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:35.058633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:35.072905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:35.075328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-978a4249-cf72-40b6-b6d9-2dc7527f47d5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1261 microversion: 2.25 time: 0.221821 Oct 10 10:38:35.075328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 147/346] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:34 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:35.089912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68e8bdd-3297-441e-b005-73316716f59a", "name": "network-vif-deleted", "tag": "aeb261d2-64a6-4434-b098-35f424267773"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:35.125473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.125868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.132929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.148466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:35.167210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] Creating event network-vif-deleted:aeb261d2-64a6-4434-b098-35f424267773 for instance f68e8bdd-3297-441e-b005-73316716f59a on n-h2-860687-2 Oct 10 10:38:35.182829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-35af1062-3762-4467-bf0c-309fb65167cf req-5823a6ae-7c95-4e0b-a0c0-3eea55e02e49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106248 Oct 10 10:38:35.184008 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 148/347] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:35.450171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:35.450742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:35.461944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.467367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.472511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.476228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.478266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.480312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.641921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.642604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.643357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.643990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lazy-loading 'fault' on Instance uuid f68e8bdd-3297-441e-b005-73316716f59a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:35.698588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:35.699105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:35.699629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:35.700039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:35.700711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:35.735650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.742349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.743288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.744934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.747957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.749881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.807187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:35.816792 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82e8caf5-380a-4d24-b54d-5fd581c7e222 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 200 len: 1308 microversion: 2.1 time: 0.371778 Oct 10 10:38:35.832581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Getting quotas for project 3a7b536c2b1842e490b840f442fac134. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:35.833056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 149/348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:35 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:35.833164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Getting quotas for user fbd60d84d4684de5930c85bb8364c918 and project 3a7b536c2b1842e490b840f442fac134. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:35.879810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:35.882211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:35.884367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:35.885031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:35.916317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.917117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.931304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:35.945725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:35.950532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:35.951536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:36.036511 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6bd2b4a0-8995-44da-99de-2a211c1ec8f6 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603707 Oct 10 10:38:36.039763 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 200/349] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:36.050850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69bb336d-4b02-44d0-bd25-60019b233c27 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:36.054544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69bb336d-4b02-44d0-bd25-60019b233c27 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:36.204051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.215599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.223603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.236322 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cc5b08a-be98-4cd4-92c9-8079a6aa32b9 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.357303 Oct 10 10:38:36.257634 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 150/350] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:35 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:36.274928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:36.276119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:36.278767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69bb336d-4b02-44d0-bd25-60019b233c27 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.289089 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69bb336d-4b02-44d0-bd25-60019b233c27 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1221 microversion: 2.1 time: 0.243278 Oct 10 10:38:36.290435 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 201/351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:36 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1221 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:36.293075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:36.293572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:36.299322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:36.300124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:36.300757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:36.303592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:36.474955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.491378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.494000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:36.498599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eade8cc5-9b25-4f66-a902-474820b4a83c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1313 microversion: 2.25 time: 0.237465 Oct 10 10:38:36.499223 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 151/352] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:36 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:36.842298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:36.843082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:36.857910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:36.861939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:36.863016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:36.863786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:36.864261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:36.864831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:36.919981 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a HTTP/1.1 Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:36.922587 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:38:36.924069 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f68e8bdd-3297-441e-b005-73316716f59a'} Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:36.924969 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:38:36.926351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:36.927750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:36.934838 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4977332a-cfb7-44d2-942f-8e77e12885b4 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 404 len: 111 microversion: 2.1 time: 0.088674 Oct 10 10:38:36.950004 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 202/353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:36 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:37.213390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1366034111", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:37.241966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-582a141b-cb5b-4e09-a6fb-1878cd372153 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d1ef430>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:37.310164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-582a141b-cb5b-4e09-a6fb-1878cd372153 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc" status: 200 len: 637 microversion: 2.1 time: 0.072286 Oct 10 10:38:37.319129 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 203/354] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:38:37 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc => generated 637 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:37.327457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:37.328075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:37.362466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:37.366681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:37.367199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:37.367639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:37.368342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:37.368796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:37.369221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:37.645788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:37.662757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:37.664805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:37.680017 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85d9b507-c6ed-4848-88f8-235466e65186 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.367176 Oct 10 10:38:37.681234 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 204/355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:37 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:37.690536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:37.691420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:37.711410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:37.712251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:37.713534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:37.714827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:37.715556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:37.716416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:37.894728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:37.903699 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f4f7a43-41ec-460d-9a4b-9e9984084930 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1273 microversion: 2.1 time: 0.221015 Oct 10 10:38:37.908146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 205/356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:37 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:37.920871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-273a651f-be20-4b07-9581-c64469c930ee tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d1f1a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:38.018487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-273a651f-be20-4b07-9581-c64469c930ee tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:38.030406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-273a651f-be20-4b07-9581-c64469c930ee tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:38.217340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:38.219202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:38.219416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:38.219950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:38.220464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:38.237825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:38.239992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:38.240771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:38.242617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:38.244017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:38.245238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:38.307223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Getting quotas for project 8f9b3653c3204aa69ed5178fef1e45ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:38.321438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Getting quotas for user b49c6dc16297446d8cac3f1cdc24cb26 and project 8f9b3653c3204aa69ed5178fef1e45ff. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:38.353109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:38.362275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:38.474653 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4395160b-9b70-4227-954c-c4978d4d070a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266267 Oct 10 10:38:38.479264 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 152/357] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:38.764514 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-273a651f-be20-4b07-9581-c64469c930ee tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.851363 Oct 10 10:38:38.765940 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 206/358] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:37 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:38.770819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:38.771930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:38.790273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:38.790755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:38.797060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:38.797246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:38.802145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:38.802586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:38.967272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:38.982096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:38.987200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:38.988615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8bd412dd-7469-49e8-a1c7-cd0def79f0f8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1319 microversion: 2.25 time: 0.221753 Oct 10 10:38:39.000101 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 207/359] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:38 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:39.008258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5e82446-13af-4586-9184-dde9ec61e992 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:39.009194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5e82446-13af-4586-9184-dde9ec61e992 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:39.061385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de42ac13-8fea-4f8c-b32e-2d7362ea2551 tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1442050232", "id": 616965783, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:39.125823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a5e82446-13af-4586-9184-dde9ec61e992 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:39.133902 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de42ac13-8fea-4f8c-b32e-2d7362ea2551 tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.653118 Oct 10 10:38:39.137412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 153/360] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:38:38 2022] POST /compute/v2.1/flavors => generated 465 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:39.144242 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5e82446-13af-4586-9184-dde9ec61e992 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1220 microversion: 2.1 time: 0.141886 Oct 10 10:38:39.164005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 208/361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:39 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:39.167843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:39.168616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:39.179417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-71a35a32-1d5c-4e30-b90d-4731d422318f tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d1f11f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:39.189197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:39.192247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:39.197481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:39.200569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:39.201272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:39.205382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:39.415625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:39.423871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:39.430673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:39.438038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4facf467-c349-4e23-a32c-eee0b7adab0d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.280095 Oct 10 10:38:39.439492 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 154/362] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:39 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:39.454810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:39.455573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:39.468385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:39.469397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:39.469997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:39.472142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:39.474066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:39.474676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:39.721897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-71a35a32-1d5c-4e30-b90d-4731d422318f tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "DELETE /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.549918 Oct 10 10:38:39.722571 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 209/363] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Oct 10 10:38:39 2022] DELETE /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_version => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:38:39.812530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:39.831194 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e92e32cd-4572-4c81-b1f7-37b46b37e8d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1279 microversion: 2.1 time: 0.386839 Oct 10 10:38:39.852015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 155/364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:39 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1279 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:39.857314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cad95b3e-c955-41ab-aab3-dda46519218b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d07e1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:39.905212 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cad95b3e-c955-41ab-aab3-dda46519218b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 37 microversion: 2.1 time: 0.051596 Oct 10 10:38:39.906174 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 156/365] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:38:39 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 37 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:39.920742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50d5e85b-11a5-4432-9e0f-7ef42e816969 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d093e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:40.045503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-50d5e85b-11a5-4432-9e0f-7ef42e816969 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:40.079766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-50d5e85b-11a5-4432-9e0f-7ef42e816969 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:40.510779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eaf053c4-03fe-460f-a147-b8ef088c5c0a tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:40.523062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eaf053c4-03fe-460f-a147-b8ef088c5c0a tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] 10.222.0.16 "GET /compute/v2.1/flavors/616965783" status: 200 len: 465 microversion: 2.61 time: 0.798893 Oct 10 10:38:40.535771 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 210/366] 10.222.0.16 () {60 vars in 1196 bytes} [Mon Oct 10 10:38:39 2022] GET /compute/v2.1/flavors/616965783 => generated 465 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:40.543973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:40.547973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:40.558919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:40.559690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:40.560412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:40.561639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:40.562298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:40.563024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:40.625191 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50d5e85b-11a5-4432-9e0f-7ef42e816969 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712041 Oct 10 10:38:40.627632 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 157/367] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:39 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:38:40.639845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:40.640906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:40.656835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:40.657756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:40.659729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:40.660751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:40.662087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:40.662773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:40.866044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:40.873576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a73f4c4-f9ad-412b-9319-5340e1fc822a tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1272 microversion: 2.1 time: 0.243515 Oct 10 10:38:40.887526 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 158/368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:40 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:40.993299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e454dee8-e273-425d-87e8-e949c44c0efa tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] Calling method '.version_select at 0x7f677d02c430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:41.007993 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e454dee8-e273-425d-87e8-e949c44c0efa tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.119321 Oct 10 10:38:41.015474 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 159/369] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:38:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:41.015474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:41.015474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:41.023490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:41.024850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:41.025302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:41.026156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:41.027978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:41.030012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:41.206034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.210056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.216152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.217595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.220381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.222860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:41.224954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f4b74b3-4c0e-4149-bb56-f9e6ff01ce32 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.214724 Oct 10 10:38:41.225729 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 160/370] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:41 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:41.231094 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-102866bf-03a2-4d2a-af54-4db27616003d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 0.693079 Oct 10 10:38:41.231342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f685bfd-3545-4511-884d-e2b3319f140f tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] Action: 'update', calling method: .version_select at 0x7f677e93cb80>, body: {"flavor": {"description": "new"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:41.232360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 211/371] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:40 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:41.237588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b1ea781-1d58-4c3f-9f7d-296a2ec4096d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d1efe50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:41.296987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b1ea781-1d58-4c3f-9f7d-296a2ec4096d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.063173 Oct 10 10:38:41.298545 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 212/372] 10.222.0.16 () {58 vars in 1290 bytes} [Mon Oct 10 10:38:41 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_distro => generated 33 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:41.307863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:41.308860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:41.316034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:41.316912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:41.318258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:41.319399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:41.320078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:41.320708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:41.335420 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f685bfd-3545-4511-884d-e2b3319f140f tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/616965783" status: 200 len: 466 microversion: 2.61 time: 0.108041 Oct 10 10:38:41.336819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 161/373] 10.222.0.16 () {62 vars in 1216 bytes} [Mon Oct 10 10:38:41 2022] PUT /compute/v2.1/flavors/616965783 => generated 466 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:41.343442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c70d1e4-f8eb-4fb0-8ce2-e247f1b5f2d9 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] Action: 'update', calling method: .version_select at 0x7f677d259040>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:41.618890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:UPDATE=11 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:41.712515 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c70d1e4-f8eb-4fb0-8ce2-e247f1b5f2d9 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.373821 Oct 10 10:38:41.720013 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 162/374] 10.222.0.16 () {60 vars in 1206 bytes} [Mon Oct 10 10:38:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:41.735820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bf3de2b-00c0-49e5-91a1-7e736451ca1b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d212550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:41.837970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6bf3de2b-00c0-49e5-91a1-7e736451ca1b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:41.844682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6bf3de2b-00c0-49e5-91a1-7e736451ca1b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:42.087405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:42.097016 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-070ad0d7-b76f-4f52-b2e6-1db5b5e58094 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.797079 Oct 10 10:38:42.097949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 213/375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:41 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:42.098676 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bf3de2b-00c0-49e5-91a1-7e736451ca1b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.375617 Oct 10 10:38:42.100041 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 163/376] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:41 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:42.108306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-252a684f-7b9b-4c20-b1c0-72c8273adac1 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] Calling method '.version_select at 0x7f677d192c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.109772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-31c3d4f1-895b-405a-b529-1b3b25df5603 tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.124657 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-252a684f-7b9b-4c20-b1c0-72c8273adac1 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023455 Oct 10 10:38:42.125795 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 164/377] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:42.142576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.143450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:42.153402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.154197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.154862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.155851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.156936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.157542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.158598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-31c3d4f1-895b-405a-b529-1b3b25df5603 tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.058553 Oct 10 10:38:42.160502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 214/378] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:42.169373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e3bc880-fb59-4664-a331-d2583f3ee062 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d23f5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.226717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e3bc880-fb59-4664-a331-d2583f3ee062 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.063216 Oct 10 10:38:42.227892 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 215/379] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:42.240063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af02ed3a-ffd0-4337-866d-5c58f6898516 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] Action: 'update', calling method: .version_select at 0x7f677d49aaf0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:42.363024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:UPDATE=17,nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:42.420123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af02ed3a-ffd0-4337-866d-5c58f6898516 tempest-QuotaClassesAdminTestJSON-48763831 tempest-QuotaClassesAdminTestJSON-48763831-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.190898 Oct 10 10:38:42.421280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 216/380] 10.222.0.16 () {60 vars in 1206 bytes} [Mon Oct 10 10:38:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:42.528334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de629cf-61f6-4e7f-8199-edf01fad5986", "tag": "78894261-78aa-4f5d-9071-5bfcca65dc6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:42.540784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.541391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.541889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.555803 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] Creating event network-changed:78894261-78aa-4f5d-9071-5bfcca65dc6e for instance 2de629cf-61f6-4e7f-8199-edf01fad5986 on n-h2-860687-2 Oct 10 10:38:42.561919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1d7d8225-1245-44e2-91af-c7b2f47a1722 req-5be27e19-9e7d-4714-a180-9c4608c715ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138982 Oct 10 10:38:42.562829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 217/381] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:42.575204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36e0d13f-965d-44cd-9d89-328731c7b7b0 tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.605426 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36e0d13f-965d-44cd-9d89-328731c7b7b0 tempest-FlavorsV261TestJSON-1821189668 tempest-FlavorsV261TestJSON-1821189668-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.040860 Oct 10 10:38:42.606242 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 218/382] 10.222.0.16 () {60 vars in 1166 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:42.620754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3b5f3e1-b193-4fab-9485-648a4554b8c9 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d1f1550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:42.652414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:42.662689 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5d230d9-2b5e-4134-8afe-bc6dfc4b85d5 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1278 microversion: 2.1 time: 0.524492 Oct 10 10:38:42.667687 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 165/383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1278 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:42.672839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.674016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:42.680932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.682058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.682839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.683837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.684621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.685579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.715395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e3b5f3e1-b193-4fab-9485-648a4554b8c9 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:42.728184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e3b5f3e1-b193-4fab-9485-648a4554b8c9 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:42.830338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:42.846380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:42.849361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:42.859493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2cfce9f-27be-4d3e-a831-905825c8f564 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.190341 Oct 10 10:38:42.860855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 166/384] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:42.868944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.869819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:42.887193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.888129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.888775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.889642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:42.890254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:42.891143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:42.951424 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3b5f3e1-b193-4fab-9485-648a4554b8c9 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.343954 Oct 10 10:38:42.952017 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 219/385] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:42 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:42.956881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d3950df-8328-45a9-b91c-52a37a3d5b33 tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:42.982338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d3950df-8328-45a9-b91c-52a37a3d5b33 tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/616965783" status: 202 len: 0 microversion: 2.61 time: 0.029005 Oct 10 10:38:42.983679 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 220/386] 10.222.0.16 () {60 vars in 1199 bytes} [Mon Oct 10 10:38:42 2022] DELETE /compute/v2.1/flavors/616965783 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:38:42.992018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-141dea5a-56b9-41d8-bc19-905137351cf6 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d1f1c10>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:43.068872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-141dea5a-56b9-41d8-bc19-905137351cf6 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:43.074671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-141dea5a-56b9-41d8-bc19-905137351cf6 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:43.283620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:43.300253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:43.301757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:43.303904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c81503d1-673c-478e-b254-45c1ee7193da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 0.439699 Oct 10 10:38:43.305032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 167/387] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:42 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:43.312983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20ea4257-7651-4409-b445-8ae5ec9e515d tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:43.361581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20ea4257-7651-4409-b445-8ae5ec9e515d tempest-FlavorsV261TestJSON-1954249151 tempest-FlavorsV261TestJSON-1954249151-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.055301 Oct 10 10:38:43.375393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 168/388] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:38:43 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:43.388044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa7ac3b-acd8-472b-a082-8e435744e011", "tag": "9fff3ba3-54aa-4917-b308-c59cff22c210"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:43.399187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:43.399930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:43.400559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:43.424197 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] Creating event network-changed:9fff3ba3-54aa-4917-b308-c59cff22c210 for instance caa7ac3b-acd8-472b-a082-8e435744e011 on n-h2-860687-2 Oct 10 10:38:43.440648 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3c06cbad-49db-4130-9ae4-a67f61b2b89c req-55faf1e7-a568-4c60-aa28-f04ec22678b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063649 Oct 10 10:38:43.441248 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 169/389] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:43.450976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:43.456241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:43.473493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:43.474664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:43.477548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:43.478600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:43.480568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:43.482259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:43.780605 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-141dea5a-56b9-41d8-bc19-905137351cf6 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.795417 Oct 10 10:38:43.785398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 221/390] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:42 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 64 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:43.790231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:43.791011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:43.815171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:43.815923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:43.819601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:43.820652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:43.821157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:43.821588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:44.207671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:44.224693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab8a4ac5-26b2-44b2-b251-08ce1ce99f9f tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.780958 Oct 10 10:38:44.225417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 170/391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:43 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:44.235991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bff309c4-490c-4867-95be-d4865cbf7a7b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d25eca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:44.309635 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bff309c4-490c-4867-95be-d4865cbf7a7b tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.081158 Oct 10 10:38:44.311858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 171/392] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:38:44 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:44.321552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:44.323365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:44.336322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:44.340213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:44.340907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:44.341796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:44.342443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:44.343428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:44.431500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:44.440303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7513164d-be53-43fe-9817-345e1dd277e7 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.657652 Oct 10 10:38:44.441705 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 222/393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:43 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:44.450817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b875bd7-8713-442e-85eb-4504382d7f95 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d1f1dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:44.527553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3b875bd7-8713-442e-85eb-4504382d7f95 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:44.535323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3b875bd7-8713-442e-85eb-4504382d7f95 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:44.583951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:44.623766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:44.625842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:44.635999 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7840fc10-f118-4cfe-975b-6e0ba9b00e61 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.322580 Oct 10 10:38:44.651027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 172/394] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:44 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:44.653120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:44.666034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:44.686467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:44.687235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:44.687832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:44.688769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:44.689444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:44.690026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:44.762409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:45.030416 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b875bd7-8713-442e-85eb-4504382d7f95 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.586574 Oct 10 10:38:45.035720 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 223/395] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:44 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:45.040891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c7179f8-62dd-4aef-95d5-5e93d00555c5 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update', calling method: .version_select at 0x7f677d1f1e50>, body: {"meta": {"os_version": "alt"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:45.131900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4c7179f8-62dd-4aef-95d5-5e93d00555c5 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:45.148438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4c7179f8-62dd-4aef-95d5-5e93d00555c5 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:45.610651 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c7179f8-62dd-4aef-95d5-5e93d00555c5 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.573707 Oct 10 10:38:45.611841 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 224/396] 10.222.0.16 () {60 vars in 1313 bytes} [Mon Oct 10 10:38:45 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata/os_version => generated 31 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:45.621471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:45.624144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:45.640466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:45.643858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:45.644633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:45.647203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:45.649856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:45.650342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:45.774203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:46.058579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.066873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.068927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.070059 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-379d9f55-21be-4786-9326-a12a4057840d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 1.431967 Oct 10 10:38:46.070617 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 173/397] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:44 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:46.093463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:46.095070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:46.103487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:46.104006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:46.104550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:46.108210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:46.108210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:46.108210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:46.256447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.265310 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b25f209f-ae94-4f33-bced-6dc9c6d58b0b tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.652342 Oct 10 10:38:46.272924 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 225/398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:45 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:46.615989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.627169 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8018ab14-c6aa-4c30-9cde-0d16d7ef1367 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.542399 Oct 10 10:38:46.630797 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 174/399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:46 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:46.639313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6650740e-b32e-484d-b1c2-065821649359 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:46.662228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6650740e-b32e-484d-b1c2-065821649359 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.387889 Oct 10 10:38:46.669946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa37a04f-eb87-47a0-a608-f94a0f1d6cf8 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d2593a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:46.677538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 226/400] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:38:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:46.688064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:46.688968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:46.707072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:46.708301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:46.709555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:46.710430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:46.711070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:46.711713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:46.755601 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa37a04f-eb87-47a0-a608-f94a0f1d6cf8 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 58 microversion: 2.1 time: 0.103268 Oct 10 10:38:46.757583 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 175/401] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:38:46 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 58 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:46.955138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.967904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.970047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:46.989421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-034c3118-7ea2-4b7c-b7d4-ffda94169e78 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.310138 Oct 10 10:38:47.007292 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 227/402] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:46 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:47.022874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-899a73e2-fef8-447f-8df8-cf70f9e71b3d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'update_all', calling method: .version_select at 0x7f677d1f1430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:47.111200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-899a73e2-fef8-447f-8df8-cf70f9e71b3d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:47.124525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-899a73e2-fef8-447f-8df8-cf70f9e71b3d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:47.180029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f555fa74-3b61-4725-a2c0-fd3bcadab1d5 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1296067197", "id": 1045431188, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:47.226374 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f555fa74-3b61-4725-a2c0-fd3bcadab1d5 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.465499 Oct 10 10:38:47.229324 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 176/403] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:46 2022] POST /compute/v2.1/flavors => generated 425 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:47.243209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:47.248554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:47.266394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:47.267158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:47.267854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:47.273208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:47.274082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:47.275050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:47.621585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-899a73e2-fef8-447f-8df8-cf70f9e71b3d tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.612847 Oct 10 10:38:47.622192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 228/404] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:38:47 2022] PUT /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 61 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:47.627666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6034ee18-2458-450b-a1cd-787fe23a1913 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:47.641620 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6034ee18-2458-450b-a1cd-787fe23a1913 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018364 Oct 10 10:38:47.644360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 229/405] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Oct 10 10:38:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:47.656956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:47.661065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:47.680329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:47.681170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:47.681831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:47.682785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:47.687638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:47.688396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:47.709165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:47.727732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:47.742134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:47.744738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5bee755-a671-44c5-bcf3-ec221c1a1fb8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 0.513608 Oct 10 10:38:47.748349 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 177/406] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:47 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:47.764219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f54bef3d-85f8-49cd-b7d5-619fe55099d3", "tag": "daf3f15e-bda6-4b3c-8e52-5df468dc499a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:47.793672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:47.794082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:47.794683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:47.810461 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] Creating event network-changed:daf3f15e-bda6-4b3c-8e52-5df468dc499a for instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 on n-h1-860687-2 Oct 10 10:38:47.822571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3179bab7-d96a-4a0a-8056-0e94175165e9 req-83352d02-b909-4029-b92b-ffa2af20ffbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069648 Oct 10 10:38:47.824066 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 178/407] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:47.829605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0d3ab1c-eb68-4bde-9975-84503ab29e46 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Action: 'create', calling method: .version_select at 0x7f677d053820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:47.901059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:47.908016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c0d3ab1c-eb68-4bde-9975-84503ab29e46 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:47.915919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c0d3ab1c-eb68-4bde-9975-84503ab29e46 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Getting quotas for user 7219061fd5ed43acbb49052f19c0712c and project 0b6f49f625dc4181ae10b9f2b45184b1. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:48.098785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:48.113241 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8ca6011-5550-4956-8202-ae0ce46ccb41 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.466709 Oct 10 10:38:48.114309 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 230/408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:47 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:48.126198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83a404b9-d97e-40ab-89c3-9f0f6b0df729 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1750226307", "id": 1668527963, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:48.175524 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83a404b9-d97e-40ab-89c3-9f0f6b0df729 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.057501 Oct 10 10:38:48.176134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 231/409] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:48 2022] POST /compute/v2.1/flavors => generated 425 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:48.189748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:48.195803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:48.207396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.208470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.208940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.209651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.210102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.210522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.283667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:48.452438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:48.460483 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-886b52b7-6029-467e-b2bf-a66a56c11961 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.280156 Oct 10 10:38:48.461049 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 232/410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:48 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:48.466027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:48.466858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:48.480257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.480818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.481321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.482099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.482225 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0d3ab1c-eb68-4bde-9975-84503ab29e46 tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "POST /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.656731 Oct 10 10:38:48.482633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.482759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 179/411] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Oct 10 10:38:47 2022] POST /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 85 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:48.483531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.493507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6dfb2d00-9151-44a1-a452-4d5d0cd3426b tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:48.502871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6dfb2d00-9151-44a1-a452-4d5d0cd3426b tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019082 Oct 10 10:38:48.505372 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 180/412] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Oct 10 10:38:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:48.566678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:48.577535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:48.580195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:48.585779 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6046d6c5-1ff2-4028-82ee-c2514a3ff665 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.123313 Oct 10 10:38:48.586530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 233/413] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:48 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:48.592225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16aefea8-5bd1-4316-baa3-3b1ec587951e tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] Calling method '.version_select at 0x7f677d1f1940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:48.642734 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16aefea8-5bd1-4316-baa3-3b1ec587951e tempest-ImagesMetadataTestJSON-1902945512 tempest-ImagesMetadataTestJSON-1902945512-project] 10.222.0.16 "GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.054808 Oct 10 10:38:48.644326 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 234/414] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:38:48 2022] GET /compute/v2.1/images/438fbffd-cf16-4a8c-8c7c-c78e172f24dc/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:38:48.650753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90a7a6f4-542d-499e-8721-a4db64f40a1f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Action: 'create', calling method: .version_select at 0x7f677d1f1e50>, body: {"keypair": {"name": "tempest-keypair-202871567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3SNPqRHfHCZYqviySjj2NuqYs4PNYKmy4yIuOds/4lxts1q8j4bmcXKFloQ/cg1zEMBbcKVreU9b4xCBcSzq2AH5bIkDlJHAg7anzodEyRISGLJK7RcwH96V0nDlnfdA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:48.679847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-90a7a6f4-542d-499e-8721-a4db64f40a1f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for project c87ea9779ea549d8a893c36bbe69d962. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:48.700306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-90a7a6f4-542d-499e-8721-a4db64f40a1f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for user c0b9f90c3fc24f4fb0e03e557230db65 and project c87ea9779ea549d8a893c36bbe69d962. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:48.733305 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90a7a6f4-542d-499e-8721-a4db64f40a1f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087618 Oct 10 10:38:48.734429 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 235/415] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:38:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:48.776433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:48.778316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:48.787953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.788628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.789071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.789587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Action: 'update', calling method: .version_select at 0x7f677d059430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:48.789771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.790224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.790703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.796112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.796612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.797056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.819844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.820344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.820791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.837646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] HTTP exception thrown: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Request method failure captured: Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d HTTP/1.1 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 56 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Y4-ofCKZRYHeRu3CUneUt4_eNgYBHUNsf5KJ7cBPwmkR-kitPL6QAgNRIn1kgXqzKy9mfpz-n3w18j5ZoGXV5gVBMAOG_LSwcUhARgHzEmyT4G25BcbM8U4nlwnDDSUg3xeu65vkoB-CyG1MMZgKIAntZRzzkWOH-_8CJYIbwPtYA Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:48.842481 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d92e72a41884cae8d8a955605cb005f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d92e72a41884cae8d8a955605cb005f"}]}] Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 563520ed2429405caaa2d086fd934abb Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:38:48.844667 n-d-860687-2 devstack@n-api.service[128801]: exception: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd5ccfe45-800f-43f1-8769-e4a62499189d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.845481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:48.846672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:48.850799 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:48.850799 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.850799 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.850799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Returning 404 to user: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:48.850799 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48bac052-aa61-4f7b-abe8-83ca72884be0 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d" status: 404 len: 110 microversion: 2.53 time: 0.341139 Oct 10 10:38:48.852086 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 181/416] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Oct 10 10:38:48 2022] PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d => generated 110 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:38:48.862094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Action: 'update', calling method: .version_select at 0x7f677d053ee0>, body: {"status": "disabled"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:48.872622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.875105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.876467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.890930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.893502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.893970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.905541 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] HTTP exception thrown: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Request method failure captured: Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d HTTP/1.1 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 22 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Y4-ofCKZRYHeRu3CUneUt4_eNgYBHUNsf5KJ7cBPwmkR-kitPL6QAgNRIn1kgXqzKy9mfpz-n3w18j5ZoGXV5gVBMAOG_LSwcUhARgHzEmyT4G25BcbM8U4nlwnDDSUg3xeu65vkoB-CyG1MMZgKIAntZRzzkWOH-_8CJYIbwPtYA Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:48.907931 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d92e72a41884cae8d8a955605cb005f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d92e72a41884cae8d8a955605cb005f"}]}] Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 563520ed2429405caaa2d086fd934abb Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: {"status": "disabled"} Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: exception: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.909212 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd5ccfe45-800f-43f1-8769-e4a62499189d', 'body': {'status': 'disabled'}} Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.910024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:48.911813 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:48.912915 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.912915 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:48.928499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Returning 404 to user: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:48.930472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fc42fa0-d665-4cde-a977-6cee198adcea tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d" status: 404 len: 110 microversion: 2.53 time: 0.075813 Oct 10 10:38:48.935686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 182/417] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Oct 10 10:38:48 2022] PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d => generated 110 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:38:48.953336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Action: 'update', calling method: .version_select at 0x7f677d259d30>, body: {"status": "enabled"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:48.965524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.966401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.967375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.982253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:48.985487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:48.986223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:48.995943 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] HTTP exception thrown: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Request method failure captured: Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d HTTP/1.1 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 21 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Y4-ofCKZRYHeRu3CUneUt4_eNgYBHUNsf5KJ7cBPwmkR-kitPL6QAgNRIn1kgXqzKy9mfpz-n3w18j5ZoGXV5gVBMAOG_LSwcUhARgHzEmyT4G25BcbM8U4nlwnDDSUg3xeu65vkoB-CyG1MMZgKIAntZRzzkWOH-_8CJYIbwPtYA Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:48.998733 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d92e72a41884cae8d8a955605cb005f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d92e72a41884cae8d8a955605cb005f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d92e72a41884cae8d8a955605cb005f"}]}] Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 3d92e72a41884cae8d8a955605cb005f Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483 Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 563520ed2429405caaa2d086fd934abb Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: {"status": "enabled"} Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: exception: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:49.000177 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd5ccfe45-800f-43f1-8769-e4a62499189d', 'body': {'status': 'enabled'}} Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:49.000995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:49.002413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:49.006679 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. Oct 10 10:38:49.006679 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:49.006679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Returning 404 to user: Service d5ccfe45-800f-43f1-8769-e4a62499189d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:49.006679 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5588c8c4-f239-4cfc-a1c4-caad05a644b7 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d" status: 404 len: 110 microversion: 2.53 time: 0.057398 Oct 10 10:38:49.006679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 183/418] 10.222.0.16 () {62 vars in 1309 bytes} [Mon Oct 10 10:38:48 2022] PUT /compute/v2.1/os-services/d5ccfe45-800f-43f1-8769-e4a62499189d => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:38:49.017163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.024864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.025816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.025816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.026600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.027274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.028594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.060589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49946717-9591-472c-ac41-077dd2b14099 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049383 Oct 10 10:38:49.077357 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 184/419] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:49.089272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.092925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.095345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:49.106164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.106768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.108077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.108556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.109044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.109176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:49.111844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:49.113316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f36994a-4fa1-40b0-9229-eaa9b59a91fa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 0.344585 Oct 10 10:38:49.114850 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 236/420] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:48 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:38:49.141952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.143743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:49.151861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:49.164013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.165840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.167150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.168420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.170892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.171734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.174156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99198386-a4e3-4118-9bcd-b76e6837944a tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.087323 Oct 10 10:38:49.209663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 185/421] 10.222.0.16 () {60 vars in 1211 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:49.227818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.246568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.250626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.251438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.252527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.253188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.255433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.304976 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd0b0996-ca9f-4ea5-8549-4bb3ae3e15e8 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.082277 Oct 10 10:38:49.306151 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 186/422] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:49.323478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.332425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.336633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.338071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.339751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.341860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.346637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.398215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a432dbc5-97d0-4f75-b519-3b4cab5e8164 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-860687-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.073608 Oct 10 10:38:49.399787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 187/423] 10.222.0.16 () {60 vars in 1235 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/os-services?host=n-d-860687-2&binary=xxx => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:49.410155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa7ac3b-acd8-472b-a082-8e435744e011", "name": "network-vif-plugged", "status": "completed", "tag": "9fff3ba3-54aa-4917-b308-c59cff22c210"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:49.433137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.436969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.441003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.469900 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] Creating event network-vif-plugged:9fff3ba3-54aa-4917-b308-c59cff22c210 for instance caa7ac3b-acd8-472b-a082-8e435744e011 on n-h2-860687-2 Oct 10 10:38:49.480658 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-662dda51-6689-4beb-a41b-0c9a92758735 req-c4627da4-f7aa-4501-a909-5d1055a4d2cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079025 Oct 10 10:38:49.481689 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 188/424] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:49.512518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.532217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.533164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.535179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.536922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.540373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.541088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.583582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a8e6b7f-091f-421d-99e1-921970f02f37 tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.099871 Oct 10 10:38:49.584747 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 189/425] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:49.591447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:49.597277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:49.605529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.606884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.607512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:49.608410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:49.609007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:49.609585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.010846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.022920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10776ad1-76ad-4381-9bef-4e97159770e5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.884560 Oct 10 10:38:50.023944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 237/426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:50.033962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.040995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.044238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.044952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.045734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.046200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.046624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.109696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94d36cbc-42b8-49e3-bb82-fe2dd945d88f tempest-ServicesAdminNegativeV253TestJSON-604054483 tempest-ServicesAdminNegativeV253TestJSON-604054483-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.084409 Oct 10 10:38:50.110365 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 238/427] 10.222.0.16 () {60 vars in 1239 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:50.130099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.136114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:50.155457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.156166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.156828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.157560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.158023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.158453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.240762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.249073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76d47b99-39af-4851-8270-7865b6875d40 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.663077 Oct 10 10:38:50.249648 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 190/428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:49 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:50.304204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.308488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:50.314545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.318431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.325700 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4fe37ae2-5bf5-4386-b882-644faf73990d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.198657 Oct 10 10:38:50.326385 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 239/429] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:50.552693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0064b9cf-9df3-4461-8ca0-aae53dd7f862 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.555521 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0064b9cf-9df3-4461-8ca0-aae53dd7f862 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0064b9cf-9df3-4461-8ca0-aae53dd7f862 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin] Request method failure captured: Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Y5hwqIPXxIJVAAIUeB-HEcuWzOHVCfmZm2pPLvIjbZ6xfrV8KZn9EC-qQDZDo94TkXZtjXj0o8APZ9ZnmJEbcIp_7Xzef1ZtVSGNHO5ZLfRIyLpjXCu1JUvQe-qLIrS_DiXo6nPBE_sOOkgMSiMmcMenFgUxl5aQ2vfJjg4-Fm7hw Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 45e5f4b617824989b4533a51ae9896e2 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:38:50.562310 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45e5f4b617824989b4533a51ae9896e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45e5f4b617824989b4533a51ae9896e2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45e5f4b617824989b4533a51ae9896e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45e5f4b617824989b4533a51ae9896e2"}]}] Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 45e5f4b617824989b4533a51ae9896e2 Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6be536491fbb451382d68df7b669d0eb Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:38:50.563667 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid timestamp for date invalid_time Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'invalid_time'} Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:50.564460 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 10 10:38:50.565562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.571859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0064b9cf-9df3-4461-8ca0-aae53dd7f862 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:50.573705 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0064b9cf-9df3-4461-8ca0-aae53dd7f862 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489 tempest-InstanceUsageAuditLogNegativeTestJSON-1310728489-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.322778 Oct 10 10:38:50.574892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 191/430] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:38:50.586252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.586986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:50.590900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02088af7-5910-44f8-add7-bbb1d9f02b95 tempest-ServicesAdminNegativeV253TestJSON-1350443897 tempest-ServicesAdminNegativeV253TestJSON-1350443897-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.595015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.595518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.595951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.596482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02088af7-5910-44f8-add7-bbb1d9f02b95 tempest-ServicesAdminNegativeV253TestJSON-1350443897 tempest-ServicesAdminNegativeV253TestJSON-1350443897-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '00a6f19c688a41b582114c92101bc11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04752657fd24da699e5e1ecaf1c4a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.596925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:50.597549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:50.598006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02088af7-5910-44f8-add7-bbb1d9f02b95 tempest-ServicesAdminNegativeV253TestJSON-1350443897 tempest-ServicesAdminNegativeV253TestJSON-1350443897-project] Request method failure captured: Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Y2lNQMpHx8Cm_UkRWE0F7dMJ4P6HaQEhctLl1E21F3bxbMrJ1KCujssO3j41TV9wCOZYyR4_Ncr9QqsFLvERdILRpzqZ1pKD_Y1UAcYlM1VD4hnIRY7R7wSwuPpYgZ5pzFuyMEHn0TmrJiO-zmcYblNKDrT38cgjkPGPT6ncj6q3I Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d04752657fd24da699e5e1ecaf1c4a67 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1350443897 Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:50.599087 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d04752657fd24da699e5e1ecaf1c4a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d04752657fd24da699e5e1ecaf1c4a67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d04752657fd24da699e5e1ecaf1c4a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d04752657fd24da699e5e1ecaf1c4a67"}]}] Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1350443897 Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d04752657fd24da699e5e1ecaf1c4a67 Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1350443897 Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1350443897-project Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 00a6f19c688a41b582114c92101bc11c Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1350443897-project Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:38:50.600875 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:50.601602 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:38:50.602985 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.604284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02088af7-5910-44f8-add7-bbb1d9f02b95 tempest-ServicesAdminNegativeV253TestJSON-1350443897 tempest-ServicesAdminNegativeV253TestJSON-1350443897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:50.604284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02088af7-5910-44f8-add7-bbb1d9f02b95 tempest-ServicesAdminNegativeV253TestJSON-1350443897 tempest-ServicesAdminNegativeV253TestJSON-1350443897-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.264217 Oct 10 10:38:50.610272 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 240/431] 10.222.0.16 () {60 vars in 1178 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:38:50.786013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5badb19a-2f96-4386-8922-daf1181f1cf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.788268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5badb19a-2f96-4386-8922-daf1181f1cf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '09d4f52a84f14cad82c5b7d5443945a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad36938385941f2b42a077b79abb209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5badb19a-2f96-4386-8922-daf1181f1cf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Request method failure captured: Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Y4i5grN1LDIrdz99yvPNU76ysS36pUehgjxrnFmNe3By6oEXy8_Pl-oCKGcsw3WK_NFnl-AdIeDuWS0FiiStz7I00zwmyNo9AhYLnfntl9205zzsYbuo4zGc0lWN3sdLGOZHlmVkb6MwjyxcmW4biZpK5bIYJY3sdmOKJJ_vvtW_w Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3ad36938385941f2b42a077b79abb209 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:50.790027 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ad36938385941f2b42a077b79abb209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ad36938385941f2b42a077b79abb209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ad36938385941f2b42a077b79abb209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ad36938385941f2b42a077b79abb209"}]}] Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3ad36938385941f2b42a077b79abb209 Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 09d4f52a84f14cad82c5b7d5443945a2 Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project Oct 10 10:38:50.791713 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:50.792513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 10:38:50.793713 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.797646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5badb19a-2f96-4386-8922-daf1181f1cf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:50.798499 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5badb19a-2f96-4386-8922-daf1181f1cf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.187174 Oct 10 10:38:50.799058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 241/432] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:50.817784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5c28545-bddc-4ca1-a5af-5b7813a49a23 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:50.821667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b5c28545-bddc-4ca1-a5af-5b7813a49a23 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '09d4f52a84f14cad82c5b7d5443945a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad36938385941f2b42a077b79abb209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5c28545-bddc-4ca1-a5af-5b7813a49a23 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Request method failure captured: Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2010:38:50 HTTP/1.1 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Y4i5grN1LDIrdz99yvPNU76ysS36pUehgjxrnFmNe3By6oEXy8_Pl-oCKGcsw3WK_NFnl-AdIeDuWS0FiiStz7I00zwmyNo9AhYLnfntl9205zzsYbuo4zGc0lWN3sdLGOZHlmVkb6MwjyxcmW4biZpK5bIYJY3sdmOKJJ_vvtW_w Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3ad36938385941f2b42a077b79abb209 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:38:50.823822 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ad36938385941f2b42a077b79abb209"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ad36938385941f2b42a077b79abb209", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ad36938385941f2b42a077b79abb209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ad36938385941f2b42a077b79abb209"}]}] Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3ad36938385941f2b42a077b79abb209 Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 09d4f52a84f14cad82c5b7d5443945a2 Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project Oct 10 10:38:50.825095 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2022-10-10 10:38:50'} Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:38:50.825795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 10:38:50.826950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:50.830000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5c28545-bddc-4ca1-a5af-5b7813a49a23 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:50.831110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b5c28545-bddc-4ca1-a5af-5b7813a49a23 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242 tempest-InstanceUsageAuditLogNegativeTestJSON-1118238242-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 10:38:50" status: 403 len: 128 microversion: 2.1 time: 0.018022 Oct 10 10:38:50.831932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 242/433] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2010%3A38%3A50 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:50.893400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.903945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.905329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:50.906449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-742de2de-718a-429f-b97e-f38e02cd4c9b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1361 microversion: 2.25 time: 0.329926 Oct 10 10:38:50.918872 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 192/434] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:50 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:51.046535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:51.047185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:51.054370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.054860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.055323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.056072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.056686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.057105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.209242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:51.219057 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aadb34e0-d5f8-4bea-abf8-3b20c052d8fc tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.176806 Oct 10 10:38:51.222325 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 243/435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:51 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:51.248917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1783160691", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "1668527963", "adminPass": "***", "networks": [{"uuid": "5a8bf198-e3f9-4d29-a436-b32671d2b5ea"}], "security_groups": [{"name": "tempest-securitygroup--428833452"}], "key_name": "tempest-keypair-202871567", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:51.276777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:51.277544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:51.284909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.285575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.286878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.287744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.288376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.288921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.474531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] validate_networks() for [('5a8bf198-e3f9-4d29-a436-b32671d2b5ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:51.703315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:51.717456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19077681-2e03-4ea4-b1df-fb1146bfe10c tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.447092 Oct 10 10:38:51.719677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 244/436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:51 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:38:51.730647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:51.733403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:51.745112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.745880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.746703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.747649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:51.748300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:51.748918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:51.902418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:51.915501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:51.918499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:51.958039 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-06c5eaa7-9020-44de-894b-b0975c5002fe tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.236665 Oct 10 10:38:51.959616 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 245/437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:51 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:51.972140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de629cf-61f6-4e7f-8199-edf01fad5986", "name": "network-vif-plugged", "status": "completed", "tag": "78894261-78aa-4f5d-9071-5bfcca65dc6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:52.003660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.006622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.009739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.025688 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] Creating event network-vif-plugged:78894261-78aa-4f5d-9071-5bfcca65dc6e for instance 2de629cf-61f6-4e7f-8199-edf01fad5986 on n-h2-860687-2 Oct 10 10:38:52.035391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a9ccf255-c6a7-4efb-9f02-640e3e5ab5d7 req-c9a80a55-82b0-49a3-a954-4e8272b05cd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071562 Oct 10 10:38:52.039693 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 246/438] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:52.048951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:52.050631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:52.064263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.064887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.065981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.067058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.067797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.068515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.699845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:52.700898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:52.702031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:52.702768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:52.704113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:52.705639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:52.711988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:52.713433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:52.714606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a281bb9-014c-4fbb-aafa-eac24277e63c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1557 microversion: 2.25 time: 0.673766 Oct 10 10:38:52.718308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.719240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.719683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.720415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.720872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.721292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.736579 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 247/439] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:52 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1557 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:52.742583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:52.742934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for project c87ea9779ea549d8a893c36bbe69d962. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:52.743584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:52.750222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for user c0b9f90c3fc24f4fb0e03e557230db65 and project c87ea9779ea549d8a893c36bbe69d962. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:52.750954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.751692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.752276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.753166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.754182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.755528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.764234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:52.769144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:52.773382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:52.848606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99968717-4b3f-408e-8892-69e8a9e33834 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.603382 Oct 10 10:38:52.855597 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 193/440] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:52.857658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:52.860318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:52.868704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.869228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.869657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:52.870385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:52.870834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:52.871275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.094207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.105611 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d25178d-4966-4677-b8d9-c78c48cd0808 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1321 microversion: 2.1 time: 0.367971 Oct 10 10:38:53.123263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 248/441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:52 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:53.138187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:53.139212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:53.152102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.154439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.155822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.156556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.158284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.160225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.230633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:53.258661 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d5e30ad-710f-441a-a8ae-cf657b9aac2c tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 2049 microversion: 2.25 time: 0.406928 Oct 10 10:38:53.291249 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 194/442] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:52 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 2049 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:53.316290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edb2cfc7-ae84-4853-af3b-7f51dff260c3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:53.320002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edb2cfc7-ae84-4853-af3b-7f51dff260c3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:53.357885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.368235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fa8d993-2512-4df1-8943-b9e91ba0cb64 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.243716 Oct 10 10:38:53.369505 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 249/443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:53 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:53.375357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:53.376248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:53.384484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.385273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.385932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.387278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.387979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.388672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.486602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edb2cfc7-ae84-4853-af3b-7f51dff260c3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.497812 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edb2cfc7-ae84-4853-af3b-7f51dff260c3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1264 microversion: 2.1 time: 0.201137 Oct 10 10:38:53.514511 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 195/444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:53 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:53.521669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:53.525391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:53.528698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.540142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.541244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.541390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.542740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:53.545848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.546838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.548442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.550824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.555212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-701b11d9-1c00-4dbd-9e2a-a227b7ae1d44 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.184194 Oct 10 10:38:53.555808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 250/445] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:53 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:53.864888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:53.886236 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55a3c6da-c1a9-4d96-b2b1-9430ad82f0f7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 2049 microversion: 2.25 time: 0.374492 Oct 10 10:38:53.896912 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 196/446] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:53 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 2049 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:53.925532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:53.930766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.931288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.935440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.936215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:53.936684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:53.937294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:53.990902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1912e0de-0f69-4ded-8f77-29666367a52f tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076742 Oct 10 10:38:53.994042 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 251/447] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Oct 10 10:38:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:38:54.010016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:54.010588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.024810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.025559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.027715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.029510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.031521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.032202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.131901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:54.132816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.148489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.151889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.152618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.154429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.156431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.157781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.256074 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7865a15-a011-4732-ab89-1f5764414ef6 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011/action" status: 202 len: 0 microversion: 2.25 time: 0.254782 Oct 10 10:38:54.258442 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 197/448] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:38:53 2022] POST /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:38:54.275044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54bef3d-85f8-49cd-b7d5-619fe55099d3", "name": "network-vif-plugged", "status": "completed", "tag": "daf3f15e-bda6-4b3c-8e52-5df468dc499a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:54.300957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.304086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.304816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.338261 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] Creating event network-vif-plugged:daf3f15e-bda6-4b3c-8e52-5df468dc499a for instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 on n-h1-860687-2 Oct 10 10:38:54.367219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-286028e8-bb8e-4f2a-bfbc-25677040d38f req-3d14a2d6-eac7-4036-a82e-bcf9ff8cb532 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107085 Oct 10 10:38:54.371493 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 198/449] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:38:54.377016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:54.389374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.412578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.413090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.415296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.419292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.419821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.420433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.484608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:54.494425 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1cafe244-8534-4608-ae71-e09153fc6a70 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1470 microversion: 2.1 time: 0.367476 Oct 10 10:38:54.498501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 252/450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:54 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:54.512885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:54.514479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.526456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.529009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.529665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.537613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.538100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.538544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.782113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:54.811533 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-475b2246-2867-4ae7-8f47-25629b056c06 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 2054 microversion: 2.25 time: 0.438317 Oct 10 10:38:54.812197 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 199/451] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:54 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 2054 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:54.823654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:54.824277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.841657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:54.842622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.843140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.843824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.845061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.845061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.845356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.857570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8df71ece-3a3f-4d75-ae65-245326d00349 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1320 microversion: 2.1 time: 0.354085 Oct 10 10:38:54.872434 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 253/452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:54 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:54.947822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:54.960300 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f380592b-f757-4dce-895f-b6f6c2302dea tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1316 microversion: 2.1 time: 0.146760 Oct 10 10:38:54.961157 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 200/453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:54 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:54.975632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:54.976553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:54.983358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.984146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.984791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:54.985675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:54.986925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:54.987587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:55.069354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:55.080118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:55.084468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:55.118954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c5ef928-22f4-415d-aa90-6fcfab6dfd80 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.156418 Oct 10 10:38:55.152498 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 201/454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:54 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:55.404904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:55.405480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] [instance: 83999bb8-7fcc-4f0f-8e46-dc93a889235a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:55.414338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] HTTP exception thrown: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Request method failure captured: Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/83999bb8-7fcc-4f0f-8e46-dc93a889235a/action HTTP/1.1 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Yp83jQAphw1kDG1iisKNjDkm_XU9CZJWz_FeoRlZe_TUPbunQf1-t1JpIWed1babzcv3d4WxPVRCeij-CHR7sFWwyb1_GwaTyUuUMp9Wi5CEUWnRzTBles6Tu3n2gLDPHE9M4-RRTM-BLN320ScdI1EhFhAjv81Kt68gmTgm41P2o Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:38:55.416520 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3b9726fbec44db799f21401b4919a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3b9726fbec44db799f21401b4919a20"}]}] Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9922a74c9d0c4d55b5f445342b4594ca Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: {"migrate": {}} Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:38:55.417730 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '83999bb8-7fcc-4f0f-8e46-dc93a889235a', 'body': {'migrate': {}}} Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:38:55.418484 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. Oct 10 10:38:55.420268 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:38:55.421268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Returning 404 to user: Instance 83999bb8-7fcc-4f0f-8e46-dc93a889235a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:38:55.421268 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac00badf-1846-439b-ae11-8cf8556f5d10 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/83999bb8-7fcc-4f0f-8e46-dc93a889235a/action" status: 404 len: 111 microversion: 2.1 time: 0.544436 Oct 10 10:38:55.421268 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 254/455] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:38:54 2022] POST /compute/v2.1/servers/83999bb8-7fcc-4f0f-8e46-dc93a889235a/action => generated 111 bytes in 546 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:38:55.590153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1155397365", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:55.668611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:38:55.842967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:55.844136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:55.850929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:55.851760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:55.852204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:55.853022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:55.853618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:55.854198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.292304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:38:56.293300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:38:56.294293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:38:56.294875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:38:56.295559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:38:56.310460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:56.338698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.342590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.345676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.349525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.352583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.353104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.371060 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dec23bfe-55f4-4851-941b-c5ecd62c3e73 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 2034 microversion: 2.25 time: 0.531450 Oct 10 10:38:56.373087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 255/456] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:55 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 2034 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:56.412280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:56.417412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:56.421922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:56.443943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.447272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.447873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.448638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.450663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.450663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.462170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Getting quotas for project 3a7b536c2b1842e490b840f442fac134. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:38:56.472693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Getting quotas for user fbd60d84d4684de5930c85bb8364c918 and project 3a7b536c2b1842e490b840f442fac134. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:38:56.503799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:38:56.510076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:38:56.589838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af3d4f82-90a1-4644-8642-d2fe1d00261c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003489 Oct 10 10:38:56.591045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 202/457] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:38:56.596435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:56.597426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:56.605886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.606666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.607372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.608287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.608929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.609831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.839214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:56.904797 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75a9fd8f-3886-4e53-b622-b314bc803961 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1322 microversion: 2.1 time: 0.312292 Oct 10 10:38:56.922601 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 203/458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:56 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:56.937856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:56.938952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:56.950294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.951219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.951937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.952879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:56.953828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:56.954479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:56.956698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:56.982155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1c00dfe-f7e3-43be-8d8b-e826ea6b7323 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1470 microversion: 2.1 time: 0.580216 Oct 10 10:38:56.983815 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 256/459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:56 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:56.992173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": "auto"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:57.011948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:57.029207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:57.032978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:57.033439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:57.034220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:57.034744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:57.035174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:57.119681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:57.136788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:57.144780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:57.160128 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d4d80e7-369a-457d-8ca5-650ef721776d tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1447 microversion: 2.75 time: 0.235968 Oct 10 10:38:57.163485 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 204/460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:56 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:38:57.168158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93711df9-4424-4a24-861a-8646709caf60 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:57.168773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93711df9-4424-4a24-861a-8646709caf60 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:57.836562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93711df9-4424-4a24-861a-8646709caf60 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:57.848654 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93711df9-4424-4a24-861a-8646709caf60 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1222 microversion: 2.1 time: 0.683957 Oct 10 10:38:57.851593 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 205/461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:57 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1222 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:57.861790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:38:57.867253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:57.882165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:57.882654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:57.883392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'flavor' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:57.893848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:57.894882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:57.896168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:57.896726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:58.031577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:38:58.063273 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e75fc883-0245-4b77-b46c-42e5ec10561b tempest-DeleteServersAdminTestJSON-2090193206 tempest-DeleteServersAdminTestJSON-2090193206-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3/action" status: 202 len: 0 microversion: 2.1 time: 0.209103 Oct 10 10:38:58.065465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 206/462] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:38:57 2022] POST /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:38:58.077818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:58.079494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:58.091174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:58.093240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:58.094517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:58.095874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:58.096536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:58.097238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:58.710000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=69,nova_cell0:UPDATE=7 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:38:58.976458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:58.989491 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98d10298-4460-40b7-b0f8-045dd2c7e1c6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.922596 Oct 10 10:38:58.990083 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 207/463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:58 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:59.001450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:59.003936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:59.025918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:59.027310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:59.029696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:59.033225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:59.034076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:59.034288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:59.123818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:59.124361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:59.124808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:59.125829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lazy-loading 'fault' on Instance uuid f54bef3d-85f8-49cd-b7d5-619fe55099d3 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:38:59.762899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:59.774594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93df53ac-ca3f-4294-a090-bbd1fe85db1f tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1453 microversion: 2.1 time: 0.782238 Oct 10 10:38:59.776989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 208/464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:38:58 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1453 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:38:59.787924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:38:59.789604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:38:59.806870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:59.808596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:59.809760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:59.811564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:38:59.813274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:38:59.814851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:38:59.977812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:59.992863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:38:59.994581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:00.000205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-035802d4-9759-4993-916d-63816f8c2410 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1438 microversion: 2.75 time: 0.221650 Oct 10 10:39:00.001394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 209/465] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:38:59 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1438 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:00.006242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:00.007145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:00.014841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.015679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.016393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:00.017335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.018010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.018656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:00.178733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:00.196781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa1bb565-d65a-41b6-b99f-8085f2fcc850 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1280 microversion: 2.1 time: 0.194022 Oct 10 10:39:00.198066 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 210/466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:00 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:00.205520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:00.206455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:00.216281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.217151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.217819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:00.219897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.220604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.221243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:00.260103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:00.547898 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d70f91a6-f040-442b-bf93-ad11604d1c99 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 204 len: 0 microversion: 2.1 time: 0.346096 Oct 10 10:39:00.549436 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 211/467] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:00 2022] DELETE /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:00.567808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:00.569017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:00.613550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.614488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.615328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:00.616282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:00.618465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:00.619557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:01.490882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:01.506925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67d630b5-d68b-4b5b-949e-da98cde96ef2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.953538 Oct 10 10:39:01.512110 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 212/468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:00 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:01.907104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:01.911044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:01.936444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:01.936944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:01.937383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:01.938099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:01.938554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:01.938980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.111954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:02.112385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:02.116214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:02.118825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:02.119367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:02.278834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:02.288274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.289149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.289789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.290809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.291486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.292109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.693647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d3b4f12-a6b6-49d0-9eaf-61b01feb18ea tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011/action" status: 202 len: 0 microversion: 2.25 time: 5.705775 Oct 10 10:39:02.694263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 257/469] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:38:56 2022] POST /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011/action => generated 0 bytes in 5710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:02.700245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:02.704479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:02.725348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.727615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.734776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.737274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.738008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.739800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.799263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:02.820692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.833894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.836668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.837516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lazy-loading 'fault' on Instance uuid f54bef3d-85f8-49cd-b7d5-619fe55099d3 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:02.863134 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e35397c-2245-4384-b382-7592a776e3b0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a/action" status: 202 len: 1942 microversion: 2.75 time: 1.344510 Oct 10 10:39:02.865376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 213/470] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:39:01 2022] POST /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a/action => generated 1942 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 10:39:02.870717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:02.871569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:02.893392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.897108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.901289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.903976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:02.905376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:02.907575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:02.970159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:03.945386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:04.418072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:04.431537 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbfd59fc-8e0d-477a-a1da-cd78b6e299e9 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 1.564231 Oct 10 10:39:04.434448 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 214/471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:02 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:04.445538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:04.450339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:04.464852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:04.465345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:04.466004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:04.466911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:04.467682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:04.468774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:04.510492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:04.534075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e506cd49-7adb-41be-baf0-7b6e89666bf2 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1459 microversion: 2.1 time: 1.838288 Oct 10 10:39:04.534667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 258/472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:02 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1459 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:04.557114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:04.560445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:04.583182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:04.584092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:04.585342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:04.588636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:04.589482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:04.590131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:04.598464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:05.193053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:05.212491 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6e044c6-55ea-49eb-a814-bbb8724a74a7 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.774979 Oct 10 10:39:05.214301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 215/473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:04 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:05.219622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:05.220675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:05.228500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.229332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.230654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.231776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.232448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.233080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.321453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:05.336958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:05.342081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:05.345205 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-595cc975-2e9f-4a38-b13e-06f5bb06767c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.805087 Oct 10 10:39:05.346309 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 259/474] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:04 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:05.354261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cff59e5-7804-49cb-a842-394d2de7a908", "tag": "5b84cf1f-746e-4da0-94de-93accd23ecbb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:05.366353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.367831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.368603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.387929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:05.409176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] Creating event network-changed:5b84cf1f-746e-4da0-94de-93accd23ecbb for instance 0cff59e5-7804-49cb-a842-394d2de7a908 on n-h1-860687-2 Oct 10 10:39:05.423978 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-221e4b13-c487-4a73-9308-cd6fe7b3e8ca req-e011f27f-924a-410b-8d62-e8dcc6404d86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075474 Oct 10 10:39:05.425412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 260/475] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:05.428685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc8ad468-98df-4b63-9e47-2033ff86d0a9 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.212637 Oct 10 10:39:05.430100 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 216/476] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:05 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:05.461480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:05.463145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:05.470542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.474979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.479138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.480250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.480938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.483344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.563163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:05.563897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:05.578656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.579199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.579651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.583701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.584278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.592851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.638078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:05.638740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:05.639377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:05.640041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lazy-loading 'fault' on Instance uuid f54bef3d-85f8-49cd-b7d5-619fe55099d3 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:05.858466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:05.868916 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cef58b93-0d8c-4217-899f-3fd075053692 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1417 microversion: 2.1 time: 0.312742 Oct 10 10:39:05.869752 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 217/477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:05 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1417 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:06.105975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f54bef3d-85f8-49cd-b7d5-619fe55099d3", "name": "network-vif-deleted", "tag": "daf3f15e-bda6-4b3c-8e52-5df468dc499a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:06.142524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.145050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:06.146691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.147552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.166393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] Creating event network-vif-deleted:daf3f15e-bda6-4b3c-8e52-5df468dc499a for instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 on n-h1-860687-2 Oct 10 10:39:06.181816 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-958ec11e-e846-40cd-93eb-252a23306290 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.726467 Oct 10 10:39:06.197748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 261/478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:05 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:06.200697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a60e8dca-2baa-4c1a-aa11-113acf0f920a req-5c918d3d-35d1-404e-aaca-ebc1c37c3f3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113701 Oct 10 10:39:06.202918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 218/479] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:06.237444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:06.238412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:06.260338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.261120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.261602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.262368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.262832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.263317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.373461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:06.384932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:06.398502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.399054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.399481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.400202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.400675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.401112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.415163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=20 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:06.907615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:06.919925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:06.938540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:06.942454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:06.944518 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6758d222-a29e-45a9-b675-7048c95fa7e0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.710444 Oct 10 10:39:06.946052 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 262/480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:06 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:06.950311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6303b3cf-3b87-4c87-999c-bc996f2da8f3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.581138 Oct 10 10:39:06.950904 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 219/481] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:06 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:06.958385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:06.959712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:06.968254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:06.969132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:06.978673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:06.980024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.980981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.981673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.982576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.983410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.984286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.996276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.996842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.997336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:06.998046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:06.998562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:06.998986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:07.109879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:07.110370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:07.110808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:07.111316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lazy-loading 'fault' on Instance uuid f54bef3d-85f8-49cd-b7d5-619fe55099d3 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:07.274172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49c6dc16297446d8cac3f1cdc24cb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9b3653c3204aa69ed5178fef1e45ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:07.285177 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adb2f087-dcad-4dec-b553-962300257254 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 200 len: 1310 microversion: 2.1 time: 0.333114 Oct 10 10:39:07.288369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 220/482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:06 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 1310 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:07.294946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:07.310170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:07.313075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:07.333687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:07.339663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:07.339887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:07.340506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:07.340966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:07.341387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:07.357075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1743592f-4f54-447d-9fbb-201ba8166210 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.408297 Oct 10 10:39:07.357550 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 263/483] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:06 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:07.491400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1080485551", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "9f8cc63e-e39b-4453-bfeb-6926ce25b349"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:07.571056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] validate_networks() for [('9f8cc63e-e39b-4453-bfeb-6926ce25b349', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:07.653639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:07.666012 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2939cc4-f8ff-4767-9983-4cbab12550f1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.376224 Oct 10 10:39:07.667223 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 221/484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:07 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:07.683465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b519cada-1555-4d75-8b85-ecafc25f6c51", "tag": "c7103608-8891-4ec8-bdc7-9cd7edd660e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:07.710631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:07.712145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:07.713079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:07.738847 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] Creating event network-changed:c7103608-8891-4ec8-bdc7-9cd7edd660e2 for instance b519cada-1555-4d75-8b85-ecafc25f6c51 on n-h2-860687-2 Oct 10 10:39:07.752195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb2dfffc-5ac2-4094-938a-4ebea76b48c0 req-a24d9be3-ce51-4632-b31e-026f10fc8b57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083531 Oct 10 10:39:07.753382 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 222/485] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:07.972350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:07.977921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:07.979036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:07.996201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:07.998038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:07.999646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:08.000645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:08.002295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:08.006299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:08.747481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:08.748014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:08.748371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:08.748790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:08.749204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:08.765135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:08.766720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:08.772100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:08.773144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:08.773804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:08.774392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:08.813041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Getting quotas for project e4c441bd02ac48c08891cd3231edfb1b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:08.834095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Getting quotas for user bd42ae1f507d4c57baf86bb876a26e1e and project e4c441bd02ac48c08891cd3231edfb1b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:08.859716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:08.862416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:08.914701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:08.924664 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c2dbd00-abcb-4500-a1ae-6c389e7a4ce6 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.953453 Oct 10 10:39:08.934929 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 223/486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:07 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:08.953286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:08.954175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:08.985515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:08.987119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:08.988294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:08.990753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:08.992138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:08.993545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.036860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c73ad3e-be15-4aab-815a-675e601ce20b tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673729 Oct 10 10:39:09.039623 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 264/487] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:39:09.054991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa7ac3b-acd8-472b-a082-8e435744e011", "name": "network-vif-unplugged", "status": "completed", "tag": "9fff3ba3-54aa-4917-b308-c59cff22c210"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:09.094774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.096278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.098515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.195103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] Creating event network-vif-unplugged:9fff3ba3-54aa-4917-b308-c59cff22c210 for instance caa7ac3b-acd8-472b-a082-8e435744e011 on n-h2-860687-2 Oct 10 10:39:09.216960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-517528f9-c35e-4ee9-9486-fa8aaf1af6f2 req-06e394a0-c10b-4663-889d-28ab8a7dc19b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159223 Oct 10 10:39:09.219434 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 265/488] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:09.231816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:09.232534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:09.258590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.258889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.259428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.260041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.260504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.260934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.301299 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 HTTP/1.1 Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:09.303974 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:09.305444 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f54bef3d-85f8-49cd-b7d5-619fe55099d3'} Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:09.306281 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:09.308642 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:09.315805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:09.319840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-62ed4e09-3342-4a51-95ae-68ae306d3750 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 404 len: 111 microversion: 2.1 time: 0.098695 Oct 10 10:39:09.325323 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 266/489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:09 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:09.365551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:09.367329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:09.397045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.397580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.398040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.398773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.405524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.405919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.674080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:09.689146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:09.691703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:09.701286 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06787dca-02f9-4038-acdb-daae71dbdc9a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.759860 Oct 10 10:39:09.706247 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 224/490] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:08 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:09.717149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:09.718115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:09.739739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.742048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.745353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.746625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:09.747338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:09.748728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:09.908167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:10.009034 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9f1b6f6-351b-48df-b696-8d18a2f4187a tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.678467 Oct 10 10:39:10.011817 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 267/491] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:09 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:10.031924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a12946ea-6fad-4fcd-8f72-55eb2a6d0ea0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.039956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a12946ea-6fad-4fcd-8f72-55eb2a6d0ea0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.248615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:10.269110 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b57db4be-55a0-42e4-912d-05403a108437 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.559094 Oct 10 10:39:10.270939 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 225/492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:09 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:10.289002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.290981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.298594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.299489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.300125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.301107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.301909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.302776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.341390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.342835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a12946ea-6fad-4fcd-8f72-55eb2a6d0ea0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 HTTP/1.1 Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:39:10.344542 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.346105 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f54bef3d-85f8-49cd-b7d5-619fe55099d3'} Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:10.346953 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.348897 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.350105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:10.350105 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a223380f-d9cd-493e-89c8-7ec04aea3a8b tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 404 len: 111 microversion: 2.1 time: 0.074346 Oct 10 10:39:10.350105 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 226/493] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:10 2022] DELETE /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:10.357974 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a12946ea-6fad-4fcd-8f72-55eb2a6d0ea0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1216 microversion: 2.1 time: 0.344690 Oct 10 10:39:10.359024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.359829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.361169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 268/494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:10 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1216 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:10.369499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.370176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.371208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.371816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.372676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.373950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.386634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f54bef3d-85f8-49cd-b7d5-619fe55099d3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.388570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.397957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.415173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.415798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.416641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.421759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.425145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.469739 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 HTTP/1.1 Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:10.471457 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.473515 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f54bef3d-85f8-49cd-b7d5-619fe55099d3'} Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:10.474366 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. Oct 10 10:39:10.475595 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.476656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f54bef3d-85f8-49cd-b7d5-619fe55099d3 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:10.485145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c97ba0d7-34a5-46c5-b1b7-5ac2db97f682 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3" status: 404 len: 111 microversion: 2.1 time: 0.114783 Oct 10 10:39:10.485996 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 269/495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:10 2022] GET /compute/v2.1/servers/f54bef3d-85f8-49cd-b7d5-619fe55099d3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:10.495531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.496355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.513293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.529255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.534492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.535930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.536632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.537139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.647727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a HTTP/1.1 Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:10.653439 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.654645 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f68e8bdd-3297-441e-b005-73316716f59a'} Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:10.655511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.656625 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.657761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:10.657761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a32848c-cfee-481c-9e9f-7b59f888e517 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 404 len: 111 microversion: 2.1 time: 0.165946 Oct 10 10:39:10.658900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 270/496] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:10 2022] DELETE /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:10.671283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.671901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] [instance: f68e8bdd-3297-441e-b005-73316716f59a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.685625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.687106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.691246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.692085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.692581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.696464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.786496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] HTTP exception thrown: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Request method failure captured: Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a HTTP/1.1 Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YNVQIO3bpGZcgC2jvgtfXWG2CBdqbEvSIbElpkWd714SisZY_ksoyf1VviGQi3y5Ah_ATed7fR5Z9KVp_kxG0dqUp1qJ8SbYDvouHqxgPc2BhBkjV2tE6DAdpi4WB1aamlk-nTHWJS_30AVzyzGKOlGyxHO1Romumobgl0wm7xutY Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:10.794605 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8f9b3653c3204aa69ed5178fef1e45ff", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8f9b3653c3204aa69ed5178fef1e45ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8f9b3653c3204aa69ed5178fef1e45ff"}]}] Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 8f9b3653c3204aa69ed5178fef1e45ff Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-789762331 Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b49c6dc16297446d8cac3f1cdc24cb26 Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersAdminTestJSON-789762331-project Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.796246 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f68e8bdd-3297-441e-b005-73316716f59a'} Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:10.797059 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. Oct 10 10:39:10.798359 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:10.807828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] Returning 404 to user: Instance f68e8bdd-3297-441e-b005-73316716f59a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:10.809263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ff274a3-78c2-4cac-ba42-116efe05e045 tempest-DeleteServersAdminTestJSON-789762331 tempest-DeleteServersAdminTestJSON-789762331-project] 10.222.0.16 "GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a" status: 404 len: 111 microversion: 2.1 time: 0.141914 Oct 10 10:39:10.818223 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 271/497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:10 2022] GET /compute/v2.1/servers/f68e8bdd-3297-441e-b005-73316716f59a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:10.831590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:10.835884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:10.857457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.858380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.868849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.872138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:10.875677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:10.880543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:10.903970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:10.920989 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4babdd9b-eaca-43c2-9182-289093a85dc8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.570716 Oct 10 10:39:10.931596 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 227/498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:10 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:11.055595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:11.060169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:11.091451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.093622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.094678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.102982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.104882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.109531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.258741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:11.267929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:11.281860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:11.284198 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75a08d83-2557-40b8-bc54-3b6ee319d887 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.464451 Oct 10 10:39:11.285603 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 272/499] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:10 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:11.303957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:11.303957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:11.322894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:11.325836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.326344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.326842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.327798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.328269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.329202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.408549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:11.449830 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-359a10e1-ae3e-455c-ad95-9d9be29400fa tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.407686 Oct 10 10:39:11.461533 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 228/500] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:11 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:11.463502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa7ac3b-acd8-472b-a082-8e435744e011", "tag": "9fff3ba3-54aa-4917-b308-c59cff22c210"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:11.506693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.507341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.507959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.545661 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] Creating event network-changed:9fff3ba3-54aa-4917-b308-c59cff22c210 for instance caa7ac3b-acd8-472b-a082-8e435744e011 on n-h2-860687-2 Oct 10 10:39:11.555502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-16f32fd1-5ef2-423e-9ac1-a39f6ebf15e6 req-a6d608ee-6f31-47a3-bbe9-7b10b489003c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103406 Oct 10 10:39:11.557360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 229/501] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:11.586230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:11.590047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:11.591738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:11.595902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be17fc78-24eb-473d-8400-a81ab493717c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.306081 Oct 10 10:39:11.604358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.607175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.607627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.608361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.609738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.613807 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 273/502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:11 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:11.615113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.903447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:11.927613 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f21e8dbb-6362-4a6b-b850-20532dd45fed tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1268 microversion: 2.1 time: 0.368760 Oct 10 10:39:11.930330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 230/503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:11 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1268 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:11.953795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:11.954856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:11.968114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.969264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.969921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:11.970845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:11.971545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:11.972249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:12.322413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:12.323631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:12.350025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:12.350802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:12.354780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:12.355866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:12.357506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:12.358176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:12.946112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:12.962831 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bdf4180-06ae-495d-b0e0-c74683b56463 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 1.012806 Oct 10 10:39:12.964085 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 274/504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:11 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:12.970848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:12.978236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:12.998434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:12.999240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.000601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.002390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:13.005330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.006032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.063831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:13.075754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:13.086806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:13.092161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46e706d7-8070-4c5e-9de9-4ac6cc4f28e9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.774880 Oct 10 10:39:13.094344 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 231/505] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:12 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:13.117652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:13.121949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:13.154327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:13.154833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.155296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.167548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:13.172922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.173591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.220598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:13.459703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:13.522961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8b8cd64-311c-4fb8-9ac4-9101b516104e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.557518 Oct 10 10:39:13.528281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 275/506] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:12 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:13.536035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:13.536668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:13.552124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:13.560217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.560996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.561940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:13.562591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:13.563247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:13.873185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:13.882732 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-805d2839-a802-4575-a82f-0ffab6b15f60 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1274 microversion: 2.1 time: 0.353339 Oct 10 10:39:13.901808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 276/507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:13 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:13.986110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:13.987547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:14.001521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.002355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.003115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.004183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.006082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.008551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.227403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:14.241386 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a6fc8ee-ac78-4beb-979d-cdbd8f115735 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 1.144026 Oct 10 10:39:14.245376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 232/508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:13 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:14.260607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:14.263192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:14.282609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.283636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.286601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.288208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.291139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.293113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.737058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:14.748173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:14.750558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:14.752118 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b910a30-2af6-4e39-8ba7-cac89ce99b0a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.505507 Oct 10 10:39:14.779066 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 233/509] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:14 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:14.789468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:14.793844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:14.802133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.802886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.803679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.804567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:14.805166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:14.805826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:14.996580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:15.007743 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d18e4444-fcfc-48cf-be78-8d897f839396 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 1.023471 Oct 10 10:39:15.008665 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 277/510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:13 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:15.030422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cff59e5-7804-49cb-a842-394d2de7a908", "name": "network-vif-plugged", "status": "completed", "tag": "5b84cf1f-746e-4da0-94de-93accd23ecbb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:15.058796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:15.059285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:15.059720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:15.094018 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] Creating event network-vif-plugged:5b84cf1f-746e-4da0-94de-93accd23ecbb for instance 0cff59e5-7804-49cb-a842-394d2de7a908 on n-h1-860687-2 Oct 10 10:39:15.110202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:15.119909 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d8a1d466-5c9a-4d76-b273-dbb858076b48 req-2ae89c71-4cd6-4ae3-94fe-5bdaf9370fa3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106778 Oct 10 10:39:15.121741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 278/511] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:15.133161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:15.134535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:15.144276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:15.145276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:15.145944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:15.146934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:15.148316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:15.148995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:15.179954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fafcc787-5ed2-48eb-bc8b-830f150d0cc2 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.391585 Oct 10 10:39:15.180737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 234/512] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:14 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:15.272412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:15.273069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:15.280571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:15.281056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:15.281490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:15.282183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:15.282636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:15.283072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:16.466652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:16.478221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:16.483026 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-377fb615-bbe4-4a6f-ba2a-ffa4751e5190 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 1.215842 Oct 10 10:39:16.484910 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 235/513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:15 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:16.492621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aefa9a-77fb-4139-83cc-80a1acc91467", "tag": "afb008da-7e5d-4923-8379-ecd3f21369c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:16.508424 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e8dd5dc-100f-4ef7-ba30-06b47c077d42 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 1.384538 Oct 10 10:39:16.509614 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 279/514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:15 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:16.511431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:16.514543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:16.515865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:16.532851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:16.533835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:16.542674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:16.543593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:16.544199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:16.545418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:16.546264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:16.546853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:16.550043 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] Creating event network-changed:afb008da-7e5d-4923-8379-ecd3f21369c2 for instance 90aefa9a-77fb-4139-83cc-80a1acc91467 on n-h2-860687-2 Oct 10 10:39:16.564976 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-57347063-955e-4a5b-a07e-833fbef45629 req-ffe84f7f-df80-4630-b028-f20b6fd7e51b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073111 Oct 10 10:39:16.565744 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 236/515] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:16.572317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:16.578847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:16.588615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:16.589376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:16.590007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:16.590894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:16.591542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:16.592132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.210227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:17.227209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:17.234076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:17.235420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65cb4908-6378-4091-b003-35ba5ef29f4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.724186 Oct 10 10:39:17.235974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 280/516] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:16 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:17.261516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:17.264049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:17.264672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:17.276951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.277139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae57e0f0-7fa4-4299-b49f-1462a685952e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1389 microversion: 2.1 time: 0.709027 Oct 10 10:39:17.277452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.277612 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 237/517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:16 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1389 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:17.280389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.281154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.281626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.282061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.294917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b519cada-1555-4d75-8b85-ecafc25f6c51", "name": "network-vif-plugged", "status": "completed", "tag": "c7103608-8891-4ec8-bdc7-9cd7edd660e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:17.298755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:17.311569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.312279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.313952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.363626 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] Creating event network-vif-plugged:c7103608-8891-4ec8-bdc7-9cd7edd660e2 for instance b519cada-1555-4d75-8b85-ecafc25f6c51 on n-h2-860687-2 Oct 10 10:39:17.435380 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-df9403ea-fc40-459c-954a-492b1647338d req-a577f47c-da14-40b0-ba54-7bb32d93368a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118912 Oct 10 10:39:17.436595 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 238/518] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:17.471664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:17.510985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:17.512358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:17.530215 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-01cd7a34-6520-4ad2-a144-de0ee294d054 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.275030 Oct 10 10:39:17.530840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 281/519] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:17 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:17.535572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.537960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.539190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.540417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.545812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.546489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.548630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:17.549507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:17.561801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.566944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.567673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.568585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:17.569202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:17.573963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:17.997878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:18.008479 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-598c40a0-e8eb-494a-89d6-0dfdbc47bb8c tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.503230 Oct 10 10:39:18.009650 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 239/520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:17 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:18.164564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:18.198860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a407e56-66e8-45ef-9878-f40f91979a4e tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 0.662592 Oct 10 10:39:18.200153 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 282/521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:17 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:18.265758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:18.266566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:18.282600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:18.283497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:18.284197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:18.285899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:18.286631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:18.287366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:18.308538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:18.313319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:18.364959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:18.365541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:18.370615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:18.373567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:18.383519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:18.385232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:18.782593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:18.983211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:19.001930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:19.007211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:19.010569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-670f8dd0-33eb-447d-97ba-4b100d557903 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.749500 Oct 10 10:39:19.029351 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 240/522] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:18 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:19.051318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:19.052218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:19.066235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.071332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.073201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:19.075179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.077958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.078716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:19.300485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:19.365815 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8060541-0058-4978-a7f4-3e2b2827d850 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.333175 Oct 10 10:39:19.369040 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 241/523] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:19 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:19.382453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:19.388321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:19.421276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.422072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.422689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:19.432968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.433654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.435118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:19.639268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:19.648099 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc03ccf3-f536-4b74-ab32-9baf5abd91a3 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1588 microversion: 2.1 time: 1.350396 Oct 10 10:39:19.648677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 283/524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:18 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1588 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:19.662634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:19.666979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:19.686259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.687026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.687626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:19.688496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:19.689133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:19.689722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.040442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:20.051497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-562bd07d-805c-4da3-90b9-46c2f985edd2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1322 microversion: 2.1 time: 0.681262 Oct 10 10:39:20.056793 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 242/525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:19 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:20.066943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:20.076964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:20.084054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.084872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.085671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.086615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.095787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.096601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.167613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:20.177262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e91a0b60-4fe8-433b-b63d-f9e874d0421a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 0.527095 Oct 10 10:39:20.195524 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 284/526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:19 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:20.273259 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-124dd100-ce69-4069-8480-df1b4cf9adde tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215042 Oct 10 10:39:20.281851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 243/527] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:39:20 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:20.286589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:20.287145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:20.298109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.300939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.302813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.303732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.305067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.305958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.347697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:20.425284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-681f15a5-3112-4b75-aae6-806d924d2746 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1721763333", "id": 495236502, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:20.465710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-681f15a5-3112-4b75-aae6-806d924d2746 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.268606 Oct 10 10:39:20.467178 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 285/528] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:20 2022] POST /compute/v2.1/flavors => generated 427 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:20.476334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:20.477675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:20.488685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.489379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.511333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.512450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:20.513078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:20.513996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:20.702318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:20.735384 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6edeaed3-8320-4400-909d-d08cd0959fff tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.264970 Oct 10 10:39:20.736506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 286/529] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:20 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:20.757955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b09ef17f-e6d4-454a-ba9b-a2e790d64170 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:20.795050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b09ef17f-e6d4-454a-ba9b-a2e790d64170 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/495236502" status: 202 len: 0 microversion: 2.1 time: 0.057042 Oct 10 10:39:20.797678 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 287/530] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:20 2022] DELETE /compute/v2.1/flavors/495236502 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:20.802616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:20.810430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83d28d72-d639-4ce9-bc10-473cd986725a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:20.813741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:20.822959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:20.830614 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6b54b4a-7162-445c-854f-dc848d810b8f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1567 microversion: 2.25 time: 0.550302 Oct 10 10:39:20.847426 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 244/531] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:20 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1567 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:20.874069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83d28d72-d639-4ce9-bc10-473cd986725a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.070314 Oct 10 10:39:20.874932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 288/532] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:20 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:20.895495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-606a4563-7cf5-4c58-a02c-02e5e919634d tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-234436838", "id": 593848404, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:20.938034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-606a4563-7cf5-4c58-a02c-02e5e919634d tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.046610 Oct 10 10:39:20.938673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 245/533] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:20.952302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab70b28c-5d56-49fc-b993-f83166924f93 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:21.018542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab70b28c-5d56-49fc-b993-f83166924f93 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.069753 Oct 10 10:39:21.019941 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 289/534] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:20 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:21.039410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-442c8cec-1cd7-465e-92f1-b21157bdba15 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:21.082708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-442c8cec-1cd7-465e-92f1-b21157bdba15 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/593848404" status: 202 len: 0 microversion: 2.1 time: 0.046932 Oct 10 10:39:21.083407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 246/535] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:21 2022] DELETE /compute/v2.1/flavors/593848404 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:21.085867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:21.090466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:21.091422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8913ca0-cd4c-41b4-b602-281cbbb83a1c tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:21.106481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:21.111203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:21.111564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:21.112320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:21.112945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:21.113510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:21.139715 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8913ca0-cd4c-41b4-b602-281cbbb83a1c tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.051641 Oct 10 10:39:21.147408 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 247/536] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:21 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:21.163635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e37a9b1-865b-4a0a-9028-1c0241159b77 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1257613935", "id": 2100648923, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:21.201021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e37a9b1-865b-4a0a-9028-1c0241159b77 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.041656 Oct 10 10:39:21.202182 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 248/537] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:21 2022] POST /compute/v2.1/flavors => generated 429 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:21.214351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:21.215268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:21.236249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:21.242955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:21.255439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:21.256623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:21.257284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:21.257894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.245043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:22.260034 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-227884de-3742-4e57-9a59-9653871e92ec tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1472 microversion: 2.1 time: 1.178169 Oct 10 10:39:22.261513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 290/538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:21 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1472 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:22.275791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b90257e9-5879-4ed7-9969-3147a857f4bd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:22.345504 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b90257e9-5879-4ed7-9969-3147a857f4bd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2100648923" status: 202 len: 0 microversion: 2.1 time: 0.082115 Oct 10 10:39:22.346644 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 291/539] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:39:22 2022] DELETE /compute/v2.1/flavors/2100648923 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:22.357263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:22.357263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:22.370770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.371713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.374424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.375328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.375855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.376296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.589644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:22.601617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20506a82-fc39-4d73-85b7-2fd9cf56cc6f tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 1.398154 Oct 10 10:39:22.603773 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 249/540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:21 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:22.612484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:22.630099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:22.630921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:22.640944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.643670 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-133cdb6f-35a2-4811-b15f-2936512a07ab tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.295458 Oct 10 10:39:22.644823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.645638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.646612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.647121 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 292/541] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:22 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:22.647616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.649038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.653796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:22.655176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:22.664455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.665117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.665558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.666440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.667145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.667360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.717630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lazy-loading 'flavor' on Instance uuid b519cada-1555-4d75-8b85-ecafc25f6c51 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:22.890519 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dbb31629-22cf-43a4-8cfd-d6d863f18109 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51/action" status: 202 len: 0 microversion: 2.1 time: 0.242122 Oct 10 10:39:22.893003 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 293/542] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:39:22 2022] POST /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:22.910219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c379e712-b090-48cd-b6fd-1d1a60e95cfd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:22.962027 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c379e712-b090-48cd-b6fd-1d1a60e95cfd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.064157 Oct 10 10:39:22.963036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 294/543] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:22 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:22.979162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:22.979611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:22.996894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.997394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.997833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:22.999674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:22.999674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:22.999674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:23.302705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:23.317778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:23.326447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:23.328034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48a65cf4-8516-4e2f-84b5-6696f9926c85 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1542 microversion: 2.25 time: 0.722978 Oct 10 10:39:23.331819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 250/544] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:22 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1542 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:23.341823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:23.345653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:23.363507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:23.363997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:23.364858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:23.365214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:23.365671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:23.369574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:23.849417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:23.864630 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19680a6b-e6dc-4afa-9259-027f307a1e6c tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 200 len: 1588 microversion: 2.1 time: 0.531245 Oct 10 10:39:23.879691 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 251/545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:23 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 1588 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:23.902619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d08497e-e903-4c20-8e32-2990fe7ae786 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1214378708", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:23.928344 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d08497e-e903-4c20-8e32-2990fe7ae786 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.047408 Oct 10 10:39:23.936111 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 252/546] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:23 2022] POST /compute/v2.1/flavors => generated 507 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:23.941738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cff59e5-7804-49cb-a842-394d2de7a908", "tag": "5b84cf1f-746e-4da0-94de-93accd23ecbb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:23.953193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:23.953968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:23.954623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:23.971307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] Creating event network-changed:5b84cf1f-746e-4da0-94de-93accd23ecbb for instance 0cff59e5-7804-49cb-a842-394d2de7a908 on n-h1-860687-2 Oct 10 10:39:23.978450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7bada844-aea4-471f-8f15-f2d482352932 req-19ad6f89-5d07-46d2-84a0-85d383448558 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040201 Oct 10 10:39:23.979103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 253/547] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:23.985572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee2204c4-9886-4b9f-aebc-9e5cff26c9c3 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '.version_select at 0x7f677ce97f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:23.990214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2204c4-9886-4b9f-aebc-9e5cff26c9c3 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:23.990936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2204c4-9886-4b9f-aebc-9e5cff26c9c3 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:23.991565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2204c4-9886-4b9f-aebc-9e5cff26c9c3 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.013721 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee2204c4-9886-4b9f-aebc-9e5cff26c9c3 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.033154 Oct 10 10:39:24.023703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 254/548] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Oct 10 10:39:23 2022] GET /compute/v2.1/os-migrations => generated 856 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:39:24.031472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:24.040344 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5317bf24-63a0-4918-bd37-ac547c26d857 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1631 microversion: 2.1 time: 1.063800 Oct 10 10:39:24.048523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:24.064501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 295/549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:22 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1631 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:24.071238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:24.072184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:24.072785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.073472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.074014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.074882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.076884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.077353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.083793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.084637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.085326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.086648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.087437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.088266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.323569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:24.394535 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1227715-3361-4456-a8e9-eb51be62d634 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.328607 Oct 10 10:39:24.395350 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 296/550] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:24 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:24.406367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5bbab7b8-87e7-4ed1-b429-17aa7f00aa6a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:24.433690 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5bbab7b8-87e7-4ed1-b429-17aa7f00aa6a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/07a60856-fad5-4f6c-a76f-8a8b26b6e472" status: 202 len: 0 microversion: 2.1 time: 0.034908 Oct 10 10:39:24.437214 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 297/551] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:24 2022] DELETE /compute/v2.1/flavors/07a60856-fad5-4f6c-a76f-8a8b26b6e472 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:24.446018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aefa9a-77fb-4139-83cc-80a1acc91467", "name": "network-vif-plugged", "status": "completed", "tag": "afb008da-7e5d-4923-8379-ecd3f21369c2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:24.458326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.460421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.460858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.491419 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] Creating event network-vif-plugged:afb008da-7e5d-4923-8379-ecd3f21369c2 for instance 90aefa9a-77fb-4139-83cc-80a1acc91467 on n-h2-860687-2 Oct 10 10:39:24.501453 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6af78858-3532-4893-afb7-cb0037edb25d req-7b5cfdbc-5961-440d-b409-822cc3d15738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065849 Oct 10 10:39:24.506827 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 298/552] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:24.513884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:24.514318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:24.527117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.527609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.528029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:24.528730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:24.529216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:24.529653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.033422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:25.048073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-257b8acd-9718-48c8-9f1b-a0189b6be7d0 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 1.022303 Oct 10 10:39:25.069887 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 255/553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:24 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:25.076200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3532dc6-2edd-4c97-a192-f4810f1e1e74 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.106990 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3532dc6-2edd-4c97-a192-f4810f1e1e74 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.034455 Oct 10 10:39:25.108419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 256/554] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:25.114545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.115498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:25.135124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.135957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.136601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.137979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.138629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.139264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.144687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:25.193966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:25.218136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb254111-15fe-4946-924b-a78a0ca3e9d2 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 2034 microversion: 2.25 time: 0.709916 Oct 10 10:39:25.221241 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 299/555] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:24 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 2034 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:25.232889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7a2942d-b467-4e50-a355-5634d4799a74 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1618111991", "id": "356708e0-33b1-45eb-9c7f-0bbf0505373d", "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.267549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7a2942d-b467-4e50-a355-5634d4799a74 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.039878 Oct 10 10:39:25.268384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 300/556] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/flavors => generated 507 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:25.273972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ec44497-30fa-4463-89a3-97ba6076f771 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: .version_select at 0x7f677d1efaf0>, body: {"keypair": {"name": "tempest-keypair-1128519253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbhILPLViEh4G2xtx8JTAoiX9Vlzwe7Ru2IaZLIEpYR2exFGZCjQvvNPxRa0CxMpB7dICha9MsJBkJjSLSh5KHyAuy2GucqBXzn7tuNIojokWD6q7W3L/arZfQwYsXGSg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.292662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-0ec44497-30fa-4463-89a3-97ba6076f771 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:25.299085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-0ec44497-30fa-4463-89a3-97ba6076f771 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for user 78daecbab97943d5a26534e791ae8107 and project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:25.336892 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ec44497-30fa-4463-89a3-97ba6076f771 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.066505 Oct 10 10:39:25.337899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 301/557] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:39:25.344340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e73057bd-769c-4a7c-ae07-aef663f977fb tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.365363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=11 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:25.387204 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e73057bd-769c-4a7c-ae07-aef663f977fb tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/356708e0-33b1-45eb-9c7f-0bbf0505373d" status: 202 len: 0 microversion: 2.1 time: 0.047869 Oct 10 10:39:25.388874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 302/558] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:25 2022] DELETE /compute/v2.1/flavors/356708e0-33b1-45eb-9c7f-0bbf0505373d => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:25.409014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfff2a5d-d65d-4ee5-be29-e5a2dfa489ee tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.462986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62703ff8-ff14-40cd-8552-5a60c352d60d tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1614 microversion: 2.1 time: 0.353188 Oct 10 10:39:25.475411 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfff2a5d-d65d-4ee5-be29-e5a2dfa489ee tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.072112 Oct 10 10:39:25.475411 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 303/559] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:25.475411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.475411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:25.475688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 257/560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1614 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:25.498415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.498942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.500705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.502643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.503627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.504219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:25.509993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.510562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.514923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.515483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.517659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.531727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.532297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.532751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.629409 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] HTTP exception thrown: Cannot 'migrate' instance b519cada-1555-4d75-8b85-ecafc25f6c51 while it is in vm_state suspended Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Request method failure captured: Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51/action HTTP/1.1 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 15 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yp83jQAphw1kDG1iisKNjDkm_XU9CZJWz_FeoRlZe_TUPbunQf1-t1JpIWed1babzcv3d4WxPVRCeij-CHR7sFWwyb1_GwaTyUuUMp9Wi5CEUWnRzTBles6Tu3n2gLDPHE9M4-RRTM-BLN320ScdI1EhFhAjv81Kt68gmTgm41P2o Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:39:25.635220 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3b9726fbec44db799f21401b4919a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3b9726fbec44db799f21401b4919a20"}]}] Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9922a74c9d0c4d55b5f445342b4594ca Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: {"migrate": {}} Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:39:25.636572 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'migrate' instance b519cada-1555-4d75-8b85-ecafc25f6c51 while it is in vm_state suspended Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b519cada-1555-4d75-8b85-ecafc25f6c51', 'body': {'migrate': {}}} Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 in vm_state suspended. Cannot resize while the instance is in this state. Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.637376 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b519cada-1555-4d75-8b85-ecafc25f6c51 while it is in vm_state suspended Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.638537 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b519cada-1555-4d75-8b85-ecafc25f6c51 while it is in vm_state suspended Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Returning 409 to user: Cannot 'migrate' instance b519cada-1555-4d75-8b85-ecafc25f6c51 while it is in vm_state suspended {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf8b5ba5-a1fa-478a-bf65-f96706fd3bc8 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51/action" status: 409 len: 148 microversion: 2.1 time: 0.137693 Oct 10 10:39:25.639732 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 258/561] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51/action => generated 148 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 10:39:25.662318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f442ab87-e1b4-4d7d-971e-877caf4d9985 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2091708372", "id": 1115903767, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.695246 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f442ab87-e1b4-4d7d-971e-877caf4d9985 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053988 Oct 10 10:39:25.695914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 259/562] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:25.700791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8cf8de7-ead4-43c9-98c6-afb244ba1f1c tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8cf8de7-ead4-43c9-98c6-afb244ba1f1c tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Request method failure captured: Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action HTTP/1.1 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 39 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yp83jQAphw1kDG1iisKNjDkm_XU9CZJWz_FeoRlZe_TUPbunQf1-t1JpIWed1babzcv3d4WxPVRCeij-CHR7sFWwyb1_GwaTyUuUMp9Wi5CEUWnRzTBles6Tu3n2gLDPHE9M4-RRTM-BLN320ScdI1EhFhAjv81Kt68gmTgm41P2o Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:39:25.709959 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3b9726fbec44db799f21401b4919a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3b9726fbec44db799f21401b4919a20"}]}] Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9922a74c9d0c4d55b5f445342b4594ca Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: {"os-resetState": {"state": "invalid"}} Oct 10 10:39:25.711537 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2de629cf-61f6-4e7f-8199-edf01fad5986', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.712324 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:39:25.713583 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 10:39:25.714737 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.717049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8cf8de7-ead4-43c9-98c6-afb244ba1f1c tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:25.721178 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8cf8de7-ead4-43c9-98c6-afb244ba1f1c tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action" status: 400 len: 144 microversion: 2.1 time: 0.023850 Oct 10 10:39:25.722003 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 260/563] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:39:25.732216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2a8a6d3-80b9-4443-9100-573746840695 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.737983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:25.743730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2a8a6d3-80b9-4443-9100-573746840695 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1115903767" status: 200 len: 414 microversion: 2.1 time: 0.019865 Oct 10 10:39:25.744470 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 261/564] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/flavors/1115903767 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:25.747255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:25.750830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2d600cc-6f14-4a42-85e7-f3603a459d9f tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2d600cc-6f14-4a42-85e7-f3603a459d9f tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Request method failure captured: Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action HTTP/1.1 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 31 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Yp83jQAphw1kDG1iisKNjDkm_XU9CZJWz_FeoRlZe_TUPbunQf1-t1JpIWed1babzcv3d4WxPVRCeij-CHR7sFWwyb1_GwaTyUuUMp9Wi5CEUWnRzTBles6Tu3n2gLDPHE9M4-RRTM-BLN320ScdI1EhFhAjv81Kt68gmTgm41P2o Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:39:25.755726 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3b9726fbec44db799f21401b4919a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3b9726fbec44db799f21401b4919a20"}]}] Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9922a74c9d0c4d55b5f445342b4594ca Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: {"os-resetState": {"state": 1}} Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:39:25.757101 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2de629cf-61f6-4e7f-8199-edf01fad5986', 'body': {'os-resetState': {'state': 1}}} Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 1 Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:25.757901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 10:39:25.759530 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.762625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2d600cc-6f14-4a42-85e7-f3603a459d9f tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:25.763808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2d600cc-6f14-4a42-85e7-f3603a459d9f tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action" status: 400 len: 120 microversion: 2.1 time: 0.017612 Oct 10 10:39:25.765278 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 262/565] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:39:25.785358 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3893a513-2526-46ee-9d38-9da0a8e1e63f tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.316285 Oct 10 10:39:25.785943 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 304/566] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:25.793681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:25.795893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Failed to fetch instance by id 999 {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:39:25.796412 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Request method failure captured: Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 37 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Yp83jQAphw1kDG1iisKNjDkm_XU9CZJWz_FeoRlZe_TUPbunQf1-t1JpIWed1babzcv3d4WxPVRCeij-CHR7sFWwyb1_GwaTyUuUMp9Wi5CEUWnRzTBles6Tu3n2gLDPHE9M4-RRTM-BLN320ScdI1EhFhAjv81Kt68gmTgm41P2o Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:39:25.804801 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3b9726fbec44db799f21401b4919a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3b9726fbec44db799f21401b4919a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3b9726fbec44db799f21401b4919a20"}]}] Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b3b9726fbec44db799f21401b4919a20 Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1809157329 Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9922a74c9d0c4d55b5f445342b4594ca Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1809157329-project-admin Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: {"os-resetState": {"state": "error"}} Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:25.806183 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 999 could not be found. Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:25.806991 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:25.808312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:25.813124 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c32dbfe6-81df-443e-a889-9e61f5e88b29 tempest-ServersAdminNegativeTestJSON-1809157329 tempest-ServersAdminNegativeTestJSON-1809157329-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026096 Oct 10 10:39:25.816081 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 305/567] 10.222.0.16 () {60 vars in 1179 bytes} [Mon Oct 10 10:39:25 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:39:25.826654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.827092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:25.836530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.837128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.837652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.838450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:25.838991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:25.839568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:25.880833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:25.889531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:25.961002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b81d80b-8da8-4a0d-b805-8c2ab4e900a5 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:25.995680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b81d80b-8da8-4a0d-b805-8c2ab4e900a5 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.228904 Oct 10 10:39:25.997333 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 263/568] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:25 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:26.017977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ceb338af-1593-46b8-8755-2babd10b8cc8 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.040604 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b5e01ff-1090-4b68-9da1-be4c49592be1 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 204 len: 0 microversion: 2.1 time: 0.218643 Oct 10 10:39:26.041240 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 306/569] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:25 2022] DELETE /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:26.047726 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ceb338af-1593-46b8-8755-2babd10b8cc8 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1115903767" status: 202 len: 0 microversion: 2.1 time: 0.033662 Oct 10 10:39:26.050869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.051832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:26.052628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 264/570] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:39:26 2022] DELETE /compute/v2.1/flavors/1115903767 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:26.057858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7be3f33f-88c1-438a-b034-4177f3f16555 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.070502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.071034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.071493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.072207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.072669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.073101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.085383 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7be3f33f-88c1-438a-b034-4177f3f16555 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.030955 Oct 10 10:39:26.100118 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 265/571] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:26.108846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.110020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:26.117251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.118269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.119061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.120461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.121206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.121805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.381487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:26.395267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c4cdcfd-2065-4ba8-a931-b9683530b4d5 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1469 microversion: 2.1 time: 0.345335 Oct 10 10:39:26.396343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 307/572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:26.404784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4eb5b42-7efb-4f38-8d12-5ca4d5b3b298 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1559610748", "id": 886358016, "os-flavor-access:is_public": "False"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:26.452392 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4eb5b42-7efb-4f38-8d12-5ca4d5b3b298 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.052881 Oct 10 10:39:26.453110 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 308/573] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:26.466508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84d132d6-3418-499f-b406-5e0292431991 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "886358016"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:26.496124 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-84d132d6-3418-499f-b406-5e0292431991 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] HTTP exception thrown: Flavor 886358016 could not be found. Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84d132d6-3418-499f-b406-5e0292431991 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Request method failure captured: Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 106 Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZWC1wgcZuLf-0172gdRGPo649mk3J5rf9-R2bQX3PR7seRgaBjBW5UD8Z7VnhK11L9VHVa7WjOGIdjFI-Zl55w08CE-ByzLLTsY2vYe2nrMqOpUvDpvcBgW2BWXvXr8qAZNPII-8V4KaQ-n-LeA482wBAXKUfEK7xOOqwCAEc4Zig Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d9ed4d3dd3884836a21de9205b952e2e Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAdminTestJSON-1731977295 Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:26.498865 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9ed4d3dd3884836a21de9205b952e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9ed4d3dd3884836a21de9205b952e2e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9ed4d3dd3884836a21de9205b952e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9ed4d3dd3884836a21de9205b952e2e"}]}] Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAdminTestJSON-1731977295 Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d9ed4d3dd3884836a21de9205b952e2e Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1731977295 Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAdminTestJSON-1731977295-project Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 287139ae6a514a36bfe3e00554b88e02 Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAdminTestJSON-1731977295-project Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "test", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "886358016"}} Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:26.500470 n-d-860687-2 devstack@n-api.service[128800]: exception: Flavor 886358016 could not be found. Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '886358016'}}} Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 886358016 could not be found. Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:26.501635 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 886358016 could not be found. Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:26.503795 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:26.505321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:26.505321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:26.505321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:26.505321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 886358016 could not be found. Oct 10 10:39:26.505321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:26.507266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84d132d6-3418-499f-b406-5e0292431991 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Returning 400 to user: Flavor 886358016 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:26.507456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84d132d6-3418-499f-b406-5e0292431991 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.045363 Oct 10 10:39:26.508474 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 309/574] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:26 2022] POST /compute/v2.1/servers => generated 80 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 10:39:26.521305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bc415cb-0ddd-435d-9efa-7006d3a4554f tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.585317 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bc415cb-0ddd-435d-9efa-7006d3a4554f tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/886358016" status: 202 len: 0 microversion: 2.1 time: 0.072818 Oct 10 10:39:26.588878 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 310/575] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:26 2022] DELETE /compute/v2.1/flavors/886358016 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:26.594647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:26.597811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8986c4e-cb33-4491-b91f-fd0991424d67 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.608486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f5d6c25-cb7f-4624-877c-32a5d6f8a339 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1316 microversion: 2.1 time: 0.506990 Oct 10 10:39:26.609075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 266/576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:26.642180 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8986c4e-cb33-4491-b91f-fd0991424d67 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.049076 Oct 10 10:39:26.642864 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 311/577] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:26.666259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-111bf42c-f1a8-4e3d-b7c8-939b615d991a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-542343020", "id": 672329352, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:26.691509 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-111bf42c-f1a8-4e3d-b7c8-939b615d991a tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028204 Oct 10 10:39:26.699055 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 267/578] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:26 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:26.708376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5869e1b1-5769-4b7d-99e7-886ae9baa953 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-301655431", "id": 710266689, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:26.776308 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5869e1b1-5769-4b7d-99e7-886ae9baa953 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.072184 Oct 10 10:39:26.777990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 312/579] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:26 2022] POST /compute/v2.1/flavors => generated 410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:39:26.792844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4dbe71b2-0431-43d0-ac05-36779dc3f252 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.822035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.822738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:26.840477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.851079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.851632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.852410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:26.854878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:26.860433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:26.861915 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4dbe71b2-0431-43d0-ac05-36779dc3f252 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.074622 Oct 10 10:39:26.865692 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 268/580] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:26.878578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dd12700-7713-4b80-a4b0-6f76cb73ebdd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.915760 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dd12700-7713-4b80-a4b0-6f76cb73ebdd tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.043492 Oct 10 10:39:26.916946 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 269/581] 10.222.0.16 () {58 vars in 1177 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:39:26.934312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdd622ed-b75d-4ea5-aa6b-ce775cba09d0 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:26.958755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdd622ed-b75d-4ea5-aa6b-ce775cba09d0 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.026071 Oct 10 10:39:26.959763 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 270/582] 10.222.0.16 () {58 vars in 1171 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:39:26.980265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e60c1c73-5704-49b5-b55c-9558d8665516 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.040580 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e60c1c73-5704-49b5-b55c-9558d8665516 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.071357 Oct 10 10:39:27.048541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:27.052898 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 271/583] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:27.061057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d71f5575-a1e4-4077-a272-4c845d49246f tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.077042 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e5bf55e-533c-44ed-af8d-1c9e90d458de tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.261767 Oct 10 10:39:27.078098 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 313/584] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:26 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:27.104784 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d71f5575-a1e4-4077-a272-4c845d49246f tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.048794 Oct 10 10:39:27.117034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 272/585] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.132779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b024b144-d1bb-40a4-9631-a5aa534f8ba4 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.162207 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b024b144-d1bb-40a4-9631-a5aa534f8ba4 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.034169 Oct 10 10:39:27.162808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 314/586] 10.222.0.16 () {58 vars in 1175 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.184217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0881083a-61e1-4356-8e50-2da70a708cc9 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.223436 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0881083a-61e1-4356-8e50-2da70a708cc9 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.044308 Oct 10 10:39:27.224367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 273/587] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:27.244621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f1278ff-96e2-493e-8740-c72bbdab5f91 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.267742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f1278ff-96e2-493e-8740-c72bbdab5f91 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.026725 Oct 10 10:39:27.269230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 315/588] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.288977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e4d0da8-7422-4ba7-a28b-6b95ffee1130 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.314055 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e4d0da8-7422-4ba7-a28b-6b95ffee1130 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/710266689" status: 202 len: 0 microversion: 2.1 time: 0.028552 Oct 10 10:39:27.315423 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 274/589] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:27 2022] DELETE /compute/v2.1/flavors/710266689 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:27.324426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93836bcb-ec69-499e-9a9e-8d70bebac7e8 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.356762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93836bcb-ec69-499e-9a9e-8d70bebac7e8 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036568 Oct 10 10:39:27.358207 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 316/590] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.383478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb9cfef6-3d35-4adf-a874-f188412e45a0 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.412001 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb9cfef6-3d35-4adf-a874-f188412e45a0 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/672329352" status: 202 len: 0 microversion: 2.1 time: 0.032889 Oct 10 10:39:27.413056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 275/591] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:27 2022] DELETE /compute/v2.1/flavors/672329352 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:27.421128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.421510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de973798-81a2-4e84-bda1-3905841d0d19 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.421972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:27.428759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:27.429266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:27.429705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:27.430452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:27.430875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:27.431340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:27.448091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de973798-81a2-4e84-bda1-3905841d0d19 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.030717 Oct 10 10:39:27.449343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 317/592] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.481441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4f72b2d-deea-458f-825c-6b1187b49e18 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-89848782", "id": 839982468, "os-flavor-access:is_public": "False"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:27.501114 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4f72b2d-deea-458f-825c-6b1187b49e18 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.029818 Oct 10 10:39:27.511492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 318/593] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:27 2022] POST /compute/v2.1/flavors => generated 410 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:27.587390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1963460136", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cad63d61-412d-4d6c-9849-4c933c49b65e"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:27.600388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:27.608407 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfd75211-a644-447f-8d5b-d0d1ca53a604 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1469 microversion: 2.1 time: 0.191170 Oct 10 10:39:27.614395 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 276/594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.619998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-854e8cc4-6c92-4c02-ace1-a75c5ec7fd9d tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.653981 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-854e8cc4-6c92-4c02-ace1-a75c5ec7fd9d tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.038019 Oct 10 10:39:27.667031 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 277/595] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:27.667031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:27.667031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:27.668783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:27.669282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:27.673289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:27.673289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:27.673289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:27.673289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:27.673636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] validate_networks() for [('cad63d61-412d-4d6c-9849-4c933c49b65e', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:28.462659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:28.474339 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99ecaba8-2127-4951-90f6-58579dd37417 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1504 microversion: 2.1 time: 0.816678 Oct 10 10:39:28.475652 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 278/596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:27 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1504 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:28.481678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41b7862d-ab92-4c2b-9bc2-0d707bbc46ed tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:28.553175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41b7862d-ab92-4c2b-9bc2-0d707bbc46ed tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.076106 Oct 10 10:39:28.562398 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 279/597] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:28 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:28.582860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:28.583391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:28.604103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:28.604602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:28.610614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:28.613780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:28.617182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:28.617638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:28.912418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:28.972428 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b3da787-f232-45c2-9218-50c2ad29c5fc tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1929 microversion: 2.75 time: 0.408537 Oct 10 10:39:28.973282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 280/598] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:28 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1929 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:29.001860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.006553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:29.025654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.026347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.031151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.032175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.032880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.033333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.097518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:29.098369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:29.100059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:29.100628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:29.101063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:29.101320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:29.116745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.117247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.117842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.118593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.119078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.119690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.142189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:29.149384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for user d2bfae2396ee410c964701fd5d77615e and project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:29.169901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:29.176476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:29.267861 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d02adb1-6791-4253-8250-3b13864a03bc tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 204 len: 0 microversion: 2.1 time: 0.279247 Oct 10 10:39:29.269359 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 281/599] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:28 2022] DELETE /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:29.274956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d296ff26-9ce2-4a17-ba73-4b87689788d3 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.302845 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d296ff26-9ce2-4a17-ba73-4b87689788d3 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/839982468" status: 202 len: 0 microversion: 2.1 time: 0.031934 Oct 10 10:39:29.303504 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8979100a-70d3-4da5-9c21-df2df495374f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790036 Oct 10 10:39:29.304604 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 282/600] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:29 2022] DELETE /compute/v2.1/flavors/839982468 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:29.305416 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 319/601] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:39:29.310493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.313236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:29.317179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b519cada-1555-4d75-8b85-ecafc25f6c51", "name": "network-vif-deleted", "tag": "c7103608-8891-4ec8-bdc7-9cd7edd660e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:29.337093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.337936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.340400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.341395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.342792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.344545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.344900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.345395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.347922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.362082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] Creating event network-vif-deleted:c7103608-8891-4ec8-bdc7-9cd7edd660e2 for instance b519cada-1555-4d75-8b85-ecafc25f6c51 on n-h2-860687-2 Oct 10 10:39:29.370085 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5ff2c8bb-8b11-49fe-9b51-3555054b0c05 req-18ec89e0-24ca-4a8d-86a2-5f38b988ce0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062121 Oct 10 10:39:29.371371 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 320/602] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:29.417453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.418156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.419030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.419894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lazy-loading 'fault' on Instance uuid b519cada-1555-4d75-8b85-ecafc25f6c51 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:29.469048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:29.479043 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1580a624-b293-47e5-b673-1bacf6fe9549 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1312 microversion: 2.1 time: 0.173136 Oct 10 10:39:29.486135 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 283/603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:29 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:29.504355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.505167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:29.513044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.513750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.514363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.515443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:29.516389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:29.524670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:29.641777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-196ad2b3-e397-4f3f-a2df-e7bf0efb6106 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Action: 'create', calling method: .version_select at 0x7f677d118f70>, body: {"keypair": {"name": "tempest-keypair-729539895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYMLUtwwejojfmEeMf2VRVzK5j4MsZQ6U3FlaUODL8r4CSE1kwt4DyXivTSRGSAZbBOxdcQ/DaF7cbwr8c5xt2zOfQyvYkzO6J/OTAs7diBlz6GGsz76Gq1llxZbxGzhA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:29.669316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-196ad2b3-e397-4f3f-a2df-e7bf0efb6106 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for project 257f78a524be47438022f1d676de077e. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:29.694890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-196ad2b3-e397-4f3f-a2df-e7bf0efb6106 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for user 8a76a87cf647471a93969cb2dcfb0f12 and project 257f78a524be47438022f1d676de077e. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:29.724045 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-196ad2b3-e397-4f3f-a2df-e7bf0efb6106 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.351158 Oct 10 10:39:29.732672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 321/604] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:39:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:29.737898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-280d86c1-a1df-4748-b223-d346e827c6b4 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.741899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:29.762414 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-280d86c1-a1df-4748-b223-d346e827c6b4 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.028618 Oct 10 10:39:29.763313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 322/605] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:29 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:29.769012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f326ecdc-3531-43ce-9870-c8b19628d03f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:29.769861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f326ecdc-3531-43ce-9870-c8b19628d03f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:29.773778 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a42f7f3-20c1-476e-86bb-fc2953a26e93 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1510 microversion: 2.1 time: 0.283801 Oct 10 10:39:29.774531 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 284/606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:29 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:29.781648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1555839459", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "62cb77a7-f0f1-4c26-8da8-dc077cf999d2"}], "security_groups": [{"name": "tempest-securitygroup--1514611228"}], "key_name": "tempest-keypair-1128519253", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:29.899152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f326ecdc-3531-43ce-9870-c8b19628d03f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:29.938829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f326ecdc-3531-43ce-9870-c8b19628d03f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1211 microversion: 2.1 time: 0.174097 Oct 10 10:39:29.947055 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 323/607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:29 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:29.951738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aea0adc1-19e6-4d6e-8bbc-2d6a2346f7bb tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1502746738", "id": 129618628, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:30.006715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aea0adc1-19e6-4d6e-8bbc-2d6a2346f7bb tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056994 Oct 10 10:39:30.008926 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 324/608] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:29 2022] POST /compute/v2.1/flavors => generated 411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:30.020576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:30.023953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:30.033311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:30.035410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:30.045355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:30.045355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:30.045355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:30.045355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:30.067342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] validate_networks() for [('62cb77a7-f0f1-4c26-8da8-dc077cf999d2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:30.228737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:30.280135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec5bfa54-a210-4cbe-b2cd-f693cb33d40e tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1935 microversion: 2.75 time: 0.269566 Oct 10 10:39:30.282108 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 325/609] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:30 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1935 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:30.292150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-adaf2a02-b8ec-4d0d-835b-9b161b2a8961 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:30.336292 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-adaf2a02-b8ec-4d0d-835b-9b161b2a8961 tempest-FlavorsAdminTestJSON-1731977295 tempest-FlavorsAdminTestJSON-1731977295-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.052997 Oct 10 10:39:30.356818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 326/610] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:30 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:30.371688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3f3d5b1-7e63-40c3-abb0-4b88e06e2805 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:30.374520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:30.410497 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3f3d5b1-7e63-40c3-abb0-4b88e06e2805 tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/129618628" status: 202 len: 0 microversion: 2.1 time: 0.042284 Oct 10 10:39:30.412950 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 327/611] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:30 2022] DELETE /compute/v2.1/flavors/129618628 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:39:30.423916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c149a7a-4967-4eec-bba3-3a9f574bcb6e tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:30.473693 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c149a7a-4967-4eec-bba3-3a9f574bcb6e tempest-FlavorsAdminTestJSON-768893748 tempest-FlavorsAdminTestJSON-768893748-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.055176 Oct 10 10:39:30.474817 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 328/612] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:30.510808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:30.511542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:30.525589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:30.526178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:30.527317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:30.528823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:30.530218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:30.530846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:30.579624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:30.580855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:30.581795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:30.582905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lazy-loading 'fault' on Instance uuid b519cada-1555-4d75-8b85-ecafc25f6c51 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:31.189166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:31.199625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be778f29-1d44-4bb6-85fa-16db2af08664 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 200 len: 1312 microversion: 2.1 time: 0.692022 Oct 10 10:39:31.200492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 329/613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:30 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 1312 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:31.219951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:31.220674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:31.229286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.229859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.230190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.236246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.236880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.241824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.428539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:31.429099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:31.429422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:31.429897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:31.430239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:31.450646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.453004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.458207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.459038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.460315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.460762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.523822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:31.538192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for user 78daecbab97943d5a26534e791ae8107 and project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:31.575816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:31.584937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:31.729294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41bb0aee-6f7c-4354-ab71-ddda09e096f6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.944513 Oct 10 10:39:31.734542 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 285/614] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:39:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:39:31.744836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:31.745485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:31.754738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.756062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.756741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.759034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.759933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.760608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.855154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:31.869458 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29b39fc0-798f-45dd-a4cc-cb70f639c367 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1510 microversion: 2.1 time: 0.662451 Oct 10 10:39:31.870091 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 330/615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:31 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1510 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:31.883625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:31.884746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:31.901188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.902002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.904534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:31.905541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:31.907448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:31.919649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.085636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:32.115657 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05b5ed12-4311-4cb0-a797-33c82bce74ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1269 microversion: 2.1 time: 0.360315 Oct 10 10:39:32.121460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 286/616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:31 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1269 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:32.135344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:32.139876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:32.172372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:32.374317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:32.438798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-174e921c-7526-4be6-ae07-b4f6cf551d92 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1935 microversion: 2.75 time: 0.562330 Oct 10 10:39:32.439416 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 331/617] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:31 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1935 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:32.462132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:32.472756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: b519cada-1555-4d75-8b85-ecafc25f6c51] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:32.485001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.485457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.485888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.489768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.495756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.496936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.530772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:32.545046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] HTTP exception thrown: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Request method failure captured: Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 HTTP/1.1 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YnuQyIk-6-A9Zytp2lEgF2vjtvavaLHrQKXPk8Z1iv8lcxZMipSZKM86WpD10bYTjNQ7aVx6o_aVHNsccyYHDHj6ihcrwsCmQ1PT3cA9byACiOJqo4jv1mhAOljO4SpQcdGAgYIOT1nuvk5YTpsbDrh_uMQ9MDXmra1EP508ATdow Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3a7b536c2b1842e490b840f442fac134 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:32.547877 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a7b536c2b1842e490b840f442fac134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3a7b536c2b1842e490b840f442fac134", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a7b536c2b1842e490b840f442fac134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3a7b536c2b1842e490b840f442fac134"}]}] Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3a7b536c2b1842e490b840f442fac134 Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-387109653-project Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: fbd60d84d4684de5930c85bb8364c918 Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-387109653-project Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. Oct 10 10:39:32.549298 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b519cada-1555-4d75-8b85-ecafc25f6c51'} Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:32.550378 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. Oct 10 10:39:32.551620 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:32.552687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:32.553162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:32.557847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Returning 404 to user: Instance b519cada-1555-4d75-8b85-ecafc25f6c51 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:32.560306 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d92a28ab-0a4a-4762-a2ca-e9297a6ed564 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51" status: 404 len: 111 microversion: 2.1 time: 0.119894 Oct 10 10:39:32.561060 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ec789af-0162-453c-82a4-1e8c71f8e6b4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1286 microversion: 2.25 time: 0.435590 Oct 10 10:39:32.564768 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 287/618] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:32 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1286 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:32.576201 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 332/619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:32 2022] GET /compute/v2.1/servers/b519cada-1555-4d75-8b85-ecafc25f6c51 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:32.584828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:32.585375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:32.604041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.605047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.605672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.610104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.611056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.611729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.687396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:32.898321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:32.900922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9a0c7ab-fefe-4de1-badb-2c1c4702ad33 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 204 len: 0 microversion: 2.1 time: 0.331452 Oct 10 10:39:32.901787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 288/620] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:32 2022] DELETE /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:32.911694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:32.914181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:32.915237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:32.921323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.921823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.922257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.923142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.923605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.924075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.927570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.928067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.928508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:32.929211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:32.929665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:32.930088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.282083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:33.301166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f524e09-37ad-4122-8851-c2ec9fb9d5cd tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1476 microversion: 2.1 time: 0.394324 Oct 10 10:39:33.302452 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 289/621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:32 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:33.307442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:33.308393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:33.332903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.333827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.334500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.335710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.336375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.337009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.338369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:33.347777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2487c8a7-ef9a-47e9-ace4-cb056ce80159 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1510 microversion: 2.1 time: 0.453741 Oct 10 10:39:33.369968 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 333/622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:32 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:33.474324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:33.475010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:33.485923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.488046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.489769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.492733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.493488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.494081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.644698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] Lazy-loading 'services' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:33.693344 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02132c12-7a77-47cc-ba82-450cfa2be1c0 tempest-ServersAdmin275Test-1881860620 tempest-ServersAdmin275Test-1881860620-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1920 microversion: 2.75 time: 0.222470 Oct 10 10:39:33.696282 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 334/623] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:33 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1920 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:33.701697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:33.702802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:33.749991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.750839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.751407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.755316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.755860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.756367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.799614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:33.803410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:33.814722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1b1033b-116a-462e-839d-a78c63397e18 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1311 microversion: 2.1 time: 0.510955 Oct 10 10:39:33.841241 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 290/624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:33 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1311 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:33.867700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:33.869557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:33.916015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.916694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.917143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:33.917881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:33.922658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:33.927159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.043761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.046090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:34.061378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.065611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.067025 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8dbbef68-5e31-41f8-9e45-70b72cf73ad3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1282 microversion: 2.25 time: 0.369555 Oct 10 10:39:34.069420 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 335/625] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:33 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1282 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:34.086471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aefa9a-77fb-4139-83cc-80a1acc91467", "name": "network-vif-deleted", "tag": "afb008da-7e5d-4923-8379-ecd3f21369c2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:34.113246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.113838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.116026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.156315 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] Creating event network-vif-deleted:afb008da-7e5d-4923-8379-ecd3f21369c2 for instance 90aefa9a-77fb-4139-83cc-80a1acc91467 on n-h2-860687-2 Oct 10 10:39:34.168120 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ba48e4f6-33ff-4bf1-9830-74884d630d54 req-b9bcc791-f362-4cf7-9821-578fabb16031 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093607 Oct 10 10:39:34.169835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 336/626] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:34.296946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07eba2d9-aabc-4368-8411-80c4a776c6cf tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 204 len: 0 microversion: 2.75 time: 0.453611 Oct 10 10:39:34.298502 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 291/627] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:39:33 2022] DELETE /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:39:34.307824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:34.308758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:34.332844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.333450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.333905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.334677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.334837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:34.335496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:34.340099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.342770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.355069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.355581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.356024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.356735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.357195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.357614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.539874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.549156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.555154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.568478 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f49011e7-cd01-47c1-af89-4ded61ee69ba tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1444 microversion: 2.75 time: 0.265537 Oct 10 10:39:34.583291 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 337/628] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:34 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1444 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:34.597064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:34.597923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:34.604458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.605045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.605550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.606306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.606830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.607359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.672936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.673611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.674116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.675320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lazy-loading 'fault' on Instance uuid 90aefa9a-77fb-4139-83cc-80a1acc91467 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:34.765529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd42ae1f507d4c57baf86bb876a26e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c441bd02ac48c08891cd3231edfb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:34.779658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32696dfd-714d-4fa7-86e6-a4f34e727d57 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 200 len: 1306 microversion: 2.1 time: 0.194634 Oct 10 10:39:34.780710 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 338/629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:34 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:34.843442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:34.844061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:34.887029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.887779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.889079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.891956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:34.896300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:34.896749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:34.976920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:35.106044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:35.125443 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-333c5f4e-69af-44b0-8f99-74aec466315a tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1476 microversion: 2.1 time: 0.798259 Oct 10 10:39:35.141933 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 292/630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:34 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1476 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:35.163078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:35.164131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:35.175360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.176319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.177560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.178538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.179282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.179876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.740538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:35.749674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:35.761984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:35.763461 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0078eefb-8732-4de2-9cc7-b73bc909c3b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1356 microversion: 2.25 time: 0.619402 Oct 10 10:39:35.764021 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 293/631] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:35 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1356 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:35.777971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:35.778582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:35.786605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.787073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.787548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.789536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.789992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.790588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.816599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:35.830487 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1712174-664b-41b4-9d39-fd9d5bf4b513 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1311 microversion: 2.1 time: 0.991960 Oct 10 10:39:35.831175 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 339/632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:34 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1311 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:35.837277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f143b145-e939-4d70-8b2f-a820bb1da065", "tag": "5feb11b1-c915-412f-b614-78efefef6f98"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:35.857729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.858222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.858656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.886589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] Creating event network-changed:5feb11b1-c915-412f-b614-78efefef6f98 for instance f143b145-e939-4d70-8b2f-a820bb1da065 on n-h2-860687-2 Oct 10 10:39:35.896101 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-71255497-906e-45ca-a267-1dbed0fe25a7 req-5d319e2e-5131-4e5c-ba43-3f75fe2838d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063506 Oct 10 10:39:35.897249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 340/633] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:35.910746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:35.911933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:35.922711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.923254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.923697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.924581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.925091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.925534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.942582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 HTTP/1.1 Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:35.946861 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.948676 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '90aefa9a-77fb-4139-83cc-80a1acc91467'} Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:35.949548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.950950 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.952293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:35.952293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69635b98-0107-4f87-af89-b84dd62495e9 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 404 len: 111 microversion: 2.1 time: 0.049816 Oct 10 10:39:35.952543 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 341/634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:35 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:35.958115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-134981965", "metadata": {"image_type": "test"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:35.961000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:35.967470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.967971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.968665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.969381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:35.969844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:35.970275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:35.985333 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467/action HTTP/1.1 Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 111 Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:35.987589 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-134981965", "metadata": {"image_type": "test"}}} Oct 10 10:39:35.989138 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '90aefa9a-77fb-4139-83cc-80a1acc91467', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-134981965', 'metadata': {'image_type': 'test'}}}} Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:35.990002 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:35.991621 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:35.993380 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:35.993380 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:35.993380 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:35.993380 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:35.993380 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:35.994695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:35.995762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-693665d0-1775-4ab5-8e51-b6243616e207 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "POST /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467/action" status: 404 len: 111 microversion: 2.1 time: 0.042068 Oct 10 10:39:36.001296 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 342/635] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Oct 10 10:39:35 2022] POST /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:36.007574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-188798219", "metadata": {"image_type": "test"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:36.010524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Failed to fetch instance by id tempest-invalid-712109623 {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:39:36.011065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance tempest-invalid-712109623 could not be found. Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/tempest-invalid-712109623/action HTTP/1.1 Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 111 Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:36.012674 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-188798219", "metadata": {"image_type": "test"}}} Oct 10 10:39:36.014352 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance tempest-invalid-712109623 could not be found. Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'tempest-invalid-712109623', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-188798219', 'metadata': {'image_type': 'test'}}}} Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-712109623 could not be found. Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:36.015395 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-712109623 could not be found. Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-712109623 could not be found. Oct 10 10:39:36.017133 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.019235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance tempest-invalid-712109623 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:36.019235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-99018f12-27b6-4441-be1b-15bdc1e400b2 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-712109623/action" status: 404 len: 100 microversion: 2.1 time: 0.011575 Oct 10 10:39:36.019235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 343/636] 10.222.0.16 () {60 vars in 1246 bytes} [Mon Oct 10 10:39:36 2022] POST /compute/v2.1/servers/tempest-invalid-712109623/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:39:36.040199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:36.041682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1193473605"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:36.045526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:39:36.046202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 57 Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:36.050113 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-test-snap-1193473605"}} Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:36.051920 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1193473605'}}} Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.052864 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.054889 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.056333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:36.056916 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3beb835-34cc-4d1d-9302-84a8c0b05936 tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.034367 Oct 10 10:39:36.058578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:36.060157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:36.061649 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 344/637] 10.222.0.16 () {60 vars in 1275 bytes} [Mon Oct 10 10:39:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:39:36.069070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1666935004"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:36.072467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:39:36.073116 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 57 Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:36.074816 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-test-snap-1666935004"}} Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:36.076713 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1666935004'}}} Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.077753 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 10:39:36.079346 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.081271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:36.081361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24aff7b3-ca29-4f09-9091-e3914125e9d8 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1444 microversion: 2.75 time: 0.314765 Oct 10 10:39:36.082447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-576735c0-15be-4638-97ee-ec21770a0ada tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019310 Oct 10 10:39:36.087406 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 345/638] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Oct 10 10:39:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:36.092345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:36.092974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:36.100259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.100894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.101451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.102289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.102869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.103447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.105604 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 294/639] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:35 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1444 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:36.118954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 HTTP/1.1 Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:36.134132 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.135772 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '90aefa9a-77fb-4139-83cc-80a1acc91467'} Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:36.136588 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.138465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.139826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:36.139826 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-173107d2-ab1c-4bcd-b487-a203a1afbd2a tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 404 len: 111 microversion: 2.1 time: 0.049693 Oct 10 10:39:36.149447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:36.150365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] [instance: 90aefa9a-77fb-4139-83cc-80a1acc91467] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:36.154838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 346/640] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:36 2022] DELETE /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:36.161526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.165076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.165539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.166262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.168716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:36.169608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:36.169945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.170810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.186308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.190348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.191108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.194111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.194737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.195363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.208812 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] HTTP exception thrown: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Request method failure captured: Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 HTTP/1.1 Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZKVi-33y-l6vn9_b64wIueQa4k7Jq4L33TCM9ngjieF_oNIagXKTChCQOOdmz1uDqGMFIXp4GfAe5YTYxVxbn9CH7CI09ki2HVG0vShtAsuGr1HUFYh7sYxElz9GLB2Tg9Jgxl0-NbFV7GkpaJjS9cvg7EReEKavYyYu3iE4_gF0Y Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:39:36.213117 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4c441bd02ac48c08891cd3231edfb1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4c441bd02ac48c08891cd3231edfb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4c441bd02ac48c08891cd3231edfb1b"}]}] Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e4c441bd02ac48c08891cd3231edfb1b Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1061879170 Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bd42ae1f507d4c57baf86bb876a26e1e Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-1061879170-project Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.214608 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '90aefa9a-77fb-4139-83cc-80a1acc91467'} Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:36.215470 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. Oct 10 10:39:36.217881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:39:36.220763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] Returning 404 to user: Instance 90aefa9a-77fb-4139-83cc-80a1acc91467 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:36.223353 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cbe03f5-f384-4f18-995c-243f4ad71eee tempest-ImagesNegativeTestJSON-1061879170 tempest-ImagesNegativeTestJSON-1061879170-project] 10.222.0.16 "GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467" status: 404 len: 111 microversion: 2.1 time: 0.078704 Oct 10 10:39:36.225170 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 295/641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:36 2022] GET /compute/v2.1/servers/90aefa9a-77fb-4139-83cc-80a1acc91467 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:36.614091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:36.628054 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4283d366-9041-4be2-b9ba-c921ba651e51 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1434 microversion: 2.1 time: 0.471852 Oct 10 10:39:36.628634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 347/642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:36 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1434 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:36.792936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:36.798287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:36.811558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.812352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.813626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:36.816079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:36.816810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:36.817961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.032367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.041838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c685db00-6e96-4da2-8e91-cb33a91e42d4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1796160099", "id": 1802801054, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:37.042094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.043502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.044691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c7b5799-d7c4-4d1e-9d17-c0363e06a37b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1344 microversion: 2.25 time: 0.256551 Oct 10 10:39:37.045795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 348/643] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:36 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1344 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:37.050552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de629cf-61f6-4e7f-8199-edf01fad5986", "name": "network-vif-deleted", "tag": "78894261-78aa-4f5d-9071-5bfcca65dc6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:37.061202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.061839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.062259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.075650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] Creating event network-vif-deleted:78894261-78aa-4f5d-9071-5bfcca65dc6e for instance 2de629cf-61f6-4e7f-8199-edf01fad5986 on n-h2-860687-2 Oct 10 10:39:37.082828 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3a50fc07-55e0-458f-8a61-07860f3e9843 req-613c1239-24f0-4855-96d6-66c46139d916 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035666 Oct 10 10:39:37.083969 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 349/644] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:37.090970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:37.092157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:37.101035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.101919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.102627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.103721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.104405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.105038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.148952 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c685db00-6e96-4da2-8e91-cb33a91e42d4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.382748 Oct 10 10:39:37.149766 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 296/645] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:36 2022] POST /compute/v2.1/flavors => generated 439 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:37.160275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:37.161556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:37.171739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.172927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.173748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.174834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.175517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.176195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.232960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.233771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.234643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.235431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lazy-loading 'fault' on Instance uuid b84c7f46-8148-4493-80be-f4553e9bb49a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:37.346131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.355327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.357864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4380ac95681141f29d1db6b20666cbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed541f09ff74833b043530ada9f819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.364362 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-362c26fa-d6a5-46db-b19e-196cf765ad47 tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 200 len: 1449 microversion: 2.75 time: 0.211576 Oct 10 10:39:37.364954 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 297/646] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:37 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 1449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:37.369611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3feebd50-ea01-4295-a446-14319e0fd5d7 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:37.502064 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3feebd50-ea01-4295-a446-14319e0fd5d7 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1802801054/action" status: 200 len: 97 microversion: 2.1 time: 0.135795 Oct 10 10:39:37.509207 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 298/647] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:37 2022] POST /compute/v2.1/flavors/1802801054/action => generated 97 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:39:37.520624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1270401878", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "5061736c-860b-401b-8fa7-abf1001c1980"}], "security_groups": [{"name": "tempest-securitygroup--1139066983"}], "key_name": "tempest-keypair-729539895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:37.628715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:37.639383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27245652-cf69-426e-b2c8-8b94d43af9f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1311 microversion: 2.1 time: 0.553964 Oct 10 10:39:37.647040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 350/648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:37 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:37.651981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02a5932c-ae3c-49a6-b19a-a26b7e7d3fd1 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:37.773887 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-02a5932c-ae3c-49a6-b19a-a26b7e7d3fd1 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02a5932c-ae3c-49a6-b19a-a26b7e7d3fd1 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Request method failure captured: Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/flavors/1802801054/action HTTP/1.1 Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 67 Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZnfQ9_nV-1ri71kyOhD8s9OFLGNjSiIKhdst6wsFg5iB9UazLrclIw0LkchTg3jqdOgtTZ_63DcZgZOj6Yc5xPxAYFUnNfNi26tqZMRyLEItYFG4v8_itCr7Ol4vojHErREyDzbXTxC7IQxuYwS7GzmqYXn50WlOTsHf0sZi8DRrw Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:39:37.791120 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddaed9235e864c20bf19f1eb774a02dc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddaed9235e864c20bf19f1eb774a02dc"}]}] Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9074bc89075e415ab665a1add5f48a3a Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} Oct 10 10:39:37.792738 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: exception: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1802801054', 'body': {'addTenantAccess': {'tenant': '745a95dd657e472c80501d4f739fb1e0'}}} Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:39:37.793752 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-745a95dd657e472c80501d4f739fb1e0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 10:39:37.795431 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 10:39:37.796861 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:39:37.798257 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-745a95dd657e472c80501d4f739fb1e0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 10, 39, 37, 762702), 'updated_at': None, 'flavor_id': 34, 'project_id': '745a95dd657e472c80501d4f739fb1e0'}] Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:37.800414 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:37.804562 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:37.806882 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:37.809335 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. Oct 10 10:39:37.809335 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:37.809335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02a5932c-ae3c-49a6-b19a-a26b7e7d3fd1 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 745a95dd657e472c80501d4f739fb1e0 combination. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:37.810619 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02a5932c-ae3c-49a6-b19a-a26b7e7d3fd1 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1802801054/action" status: 409 len: 152 microversion: 2.1 time: 0.162293 Oct 10 10:39:37.812235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 351/649] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:37 2022] POST /compute/v2.1/flavors/1802801054/action => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:39:37.824007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:37.826019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:37.835503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.836251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.836897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.837823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.838477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.846788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.922134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:37.922377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:37.922777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:37.924816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lazy-loading 'fault' on Instance uuid 2de629cf-61f6-4e7f-8199-edf01fad5986 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:38.076164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd60d84d4684de5930c85bb8364c918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b536c2b1842e490b840f442fac134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:38.088412 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d792a1a8-cd0b-48ab-8059-0119753ab1e3 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 200 len: 1311 microversion: 2.1 time: 0.274610 Oct 10 10:39:38.089719 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 352/650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:37 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 1311 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:38.096438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27f85184-d43f-414e-8d72-2850f1e35d9c tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:38.120961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] validate_networks() for [('5061736c-860b-401b-8fa7-abf1001c1980', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:38.248181 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27f85184-d43f-414e-8d72-2850f1e35d9c tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1802801054/action" status: 200 len: 21 microversion: 2.1 time: 0.156155 Oct 10 10:39:38.249295 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 353/651] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:38 2022] POST /compute/v2.1/flavors/1802801054/action => generated 21 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:39:38.260793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:38.263972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:38.278772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:38.281442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:38.282140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:38.282949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:38.285811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:38.286166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.069618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:39.078725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:39.080222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:39.082092 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0cfa76b4-3e17-4b45-bd4d-519a15570faa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.830318 Oct 10 10:39:39.082680 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 354/652] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:38 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:39.087104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e64e6037-6a5e-48d2-8695-cb997e5508ae tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.108028 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e64e6037-6a5e-48d2-8695-cb997e5508ae tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1802801054" status: 202 len: 0 microversion: 2.1 time: 0.023985 Oct 10 10:39:39.109218 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 355/653] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:39:39 2022] DELETE /compute/v2.1/flavors/1802801054 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:39.117077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.118190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] [instance: b84c7f46-8148-4493-80be-f4553e9bb49a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:39.124286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.124854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.125369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.126179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.126707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.127237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.132840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:39.143952 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] HTTP exception thrown: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Request method failure captured: Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a HTTP/1.1 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YcsGI4u1UXsEhB8TZZdYK9Lz8wh2QStlk-pcOdHt4oOwZdpO8nD4C2xZmOz--0YXeAWEdv8FUbqs0N7IYVUFxBi6NrC06zJLgp129Gun7CxDfon-JsPiBNjEjNV94Kt7cJGmZo9Z8pbZruGF6E50voTfLmXawt-RtkHDzfnfkbQhc Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.75 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: eed541f09ff74833b043530ada9f819a Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdmin275Test-2032302724 Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:39.145506 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed541f09ff74833b043530ada9f819a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eed541f09ff74833b043530ada9f819a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eed541f09ff74833b043530ada9f819a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eed541f09ff74833b043530ada9f819a"}]}] Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdmin275Test-2032302724 Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: eed541f09ff74833b043530ada9f819a Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdmin275Test-2032302724 Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdmin275Test-2032302724-project Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4380ac95681141f29d1db6b20666cbf2 Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdmin275Test-2032302724-project Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. Oct 10 10:39:39.147083 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b84c7f46-8148-4493-80be-f4553e9bb49a'} Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:39.147921 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. Oct 10 10:39:39.149375 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.150492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] Returning 404 to user: Instance b84c7f46-8148-4493-80be-f4553e9bb49a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:39.150492 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91fdae81-6eae-4085-b7b8-76056f71f25b tempest-ServersAdmin275Test-2032302724 tempest-ServersAdmin275Test-2032302724-project] 10.222.0.16 "GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a" status: 404 len: 111 microversion: 2.75 time: 0.036393 Oct 10 10:39:39.150492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 356/654] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:39 2022] GET /compute/v2.1/servers/b84c7f46-8148-4493-80be-f4553e9bb49a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:39:39.156629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.157250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:39.163574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.164227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.164858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.165578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.166042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.166469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.659345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:39.670050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55ba01b6-2315-4ef4-953b-9ccd002e0c94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1311 microversion: 2.1 time: 0.521039 Oct 10 10:39:39.670727 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 357/655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:39 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1311 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:39.692848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.693473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] [instance: 2de629cf-61f6-4e7f-8199-edf01fad5986] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:39.700864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.701365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.702109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.702814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.703305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.703740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.727784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] HTTP exception thrown: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Request method failure captured: Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 HTTP/1.1 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YnuQyIk-6-A9Zytp2lEgF2vjtvavaLHrQKXPk8Z1iv8lcxZMipSZKM86WpD10bYTjNQ7aVx6o_aVHNsccyYHDHj6ihcrwsCmQ1PT3cA9byACiOJqo4jv1mhAOljO4SpQcdGAgYIOT1nuvk5YTpsbDrh_uMQ9MDXmra1EP508ATdow Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3a7b536c2b1842e490b840f442fac134 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:39.729764 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a7b536c2b1842e490b840f442fac134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3a7b536c2b1842e490b840f442fac134", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3a7b536c2b1842e490b840f442fac134"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3a7b536c2b1842e490b840f442fac134"}]}] Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3a7b536c2b1842e490b840f442fac134 Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-387109653 Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-387109653-project Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: fbd60d84d4684de5930c85bb8364c918 Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-387109653-project Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. Oct 10 10:39:39.731456 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2de629cf-61f6-4e7f-8199-edf01fad5986'} Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:39.732354 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. Oct 10 10:39:39.733960 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.735882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] Returning 404 to user: Instance 2de629cf-61f6-4e7f-8199-edf01fad5986 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:39.735882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf0db93f-5941-44be-97a9-67b03fe398f2 tempest-ServersAdminNegativeTestJSON-387109653 tempest-ServersAdminNegativeTestJSON-387109653-project] 10.222.0.16 "GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986" status: 404 len: 111 microversion: 2.1 time: 0.059380 Oct 10 10:39:39.735882 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 358/656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:39 2022] GET /compute/v2.1/servers/2de629cf-61f6-4e7f-8199-edf01fad5986 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:39.749628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4dbcf47-217f-4969-a1c5-c527cad0ec4e tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.791836 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4dbcf47-217f-4969-a1c5-c527cad0ec4e tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058238 Oct 10 10:39:39.792728 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 359/657] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:39 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:39.800333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f143b145-e939-4d70-8b2f-a820bb1da065", "name": "network-vif-plugged", "status": "completed", "tag": "5feb11b1-c915-412f-b614-78efefef6f98"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:39.814304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.815859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.816978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.845488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] Creating event network-vif-plugged:5feb11b1-c915-412f-b614-78efefef6f98 for instance f143b145-e939-4d70-8b2f-a820bb1da065 on n-h2-860687-2 Oct 10 10:39:39.856479 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6a645721-5200-47a6-a782-8a64111e9618 req-0453179f-65fa-4187-ad57-8b402ce86264 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062364 Oct 10 10:39:39.857292 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 360/658] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:39.873812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be21892d-750a-47c8-aa53-5e03f10270e8 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1834348299", "id": 496298674, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:39.879402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:39.880406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:39.881036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:39.881852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:39.882430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:39.901500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.902144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.902750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.903669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:39.907379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:39.908043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:39.918765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=16 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:39.923437 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be21892d-750a-47c8-aa53-5e03f10270e8 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.065113 Oct 10 10:39:39.924906 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 361/659] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:39.939191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27de076d-defb-4f7c-b5c1-40980f035efe tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.959789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-27de076d-defb-4f7c-b5c1-40980f035efe tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27de076d-defb-4f7c-b5c1-40980f035efe tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Request method failure captured: Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/flavors/496298674/os-flavor-access HTTP/1.1 Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZnfQ9_nV-1ri71kyOhD8s9OFLGNjSiIKhdst6wsFg5iB9UazLrclIw0LkchTg3jqdOgtTZ_63DcZgZOj6Yc5xPxAYFUnNfNi26tqZMRyLEItYFG4v8_itCr7Ol4vojHErREyDzbXTxC7IQxuYwS7GzmqYXn50WlOTsHf0sZi8DRrw Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:39:39.961207 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddaed9235e864c20bf19f1eb774a02dc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddaed9235e864c20bf19f1eb774a02dc"}]}] Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9074bc89075e415ab665a1add5f48a3a Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: exception: Access list not available for public flavors. Oct 10 10:39:39.962548 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'flavor_id': '496298674'} Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 10 10:39:39.963368 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:39.964647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27de076d-defb-4f7c-b5c1-40980f035efe tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:39.964647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27de076d-defb-4f7c-b5c1-40980f035efe tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/496298674/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029639 Oct 10 10:39:39.965192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for project 257f78a524be47438022f1d676de077e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:39.967288 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 362/660] 10.222.0.16 () {58 vars in 1206 bytes} [Mon Oct 10 10:39:39 2022] GET /compute/v2.1/flavors/496298674/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:39:39.979557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for user 8a76a87cf647471a93969cb2dcfb0f12 and project 257f78a524be47438022f1d676de077e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:39.979944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41512494-2b9c-435a-8a2a-f705271b86f7 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:39.996393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:39.999406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:40.005242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:40.028874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41512494-2b9c-435a-8a2a-f705271b86f7 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/496298674" status: 202 len: 0 microversion: 2.1 time: 0.056434 Oct 10 10:39:40.030355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 363/661] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:39 2022] DELETE /compute/v2.1/flavors/496298674 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:40.050885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a13312d-45d4-4b03-a9ab-bd3f3a093eda tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:40.084385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a13312d-45d4-4b03-a9ab-bd3f3a093eda tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.039366 Oct 10 10:39:40.085866 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 364/662] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:40.101939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7eee4e40-f087-45de-89be-8bde0af63ec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.591443 Oct 10 10:39:40.102730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 299/663] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:39:40.119686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:40.120714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:40.134627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:40.135747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:40.136588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:40.137740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:40.138889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:40.139625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:40.155019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d21b0e32-2c3c-46f8-9f4e-7c445cfe4586 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1228969241", "id": 1219625562, "os-flavor-access:is_public": "False"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:40.190439 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d21b0e32-2c3c-46f8-9f4e-7c445cfe4586 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.082288 Oct 10 10:39:40.195901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 365/664] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:40 2022] POST /compute/v2.1/flavors => generated 439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:40.211948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e57fd3df-e892-4d5d-a6c7-082dbe482cfa tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:40.212711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e57fd3df-e892-4d5d-a6c7-082dbe482cfa tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:40.461029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e57fd3df-e892-4d5d-a6c7-082dbe482cfa tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:40.497779 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e57fd3df-e892-4d5d-a6c7-082dbe482cfa tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1241 microversion: 2.1 time: 0.296373 Oct 10 10:39:40.498418 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 366/665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:40 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1241 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:40.744079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:40.753482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:40.755052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:40.764270 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f88f0ea-c304-4af1-9df2-a104f766c74e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.650013 Oct 10 10:39:40.765100 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 300/666] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:40 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:40.778342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:40.779312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:40.802321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:40.802838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:40.803491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:40.804603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:40.810831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:40.811313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:40.968806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94a7b672-3acd-4fd9-920e-b34f87899c2a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:40.973216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94a7b672-3acd-4fd9-920e-b34f87899c2a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ec85123097dd400d81740d8ae6140a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745a95dd657e472c80501d4f739fb1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94a7b672-3acd-4fd9-920e-b34f87899c2a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Request method failure captured: Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/flavors/1219625562/action HTTP/1.1 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 67 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZmqkiWuAJ2ZLSV6_ywI0ZvtoZL8b6J-cWBBvnFoeJN0KPWQ3KjWCZabKwxYqWi-ukee3K75pH8UZW1BfOAIbjaCE4k8FNzV88eg6OSBtPH5ONss_5jHmakpZYP7g7Z4_hf3SsjkKa0q5cDUKEc3GQpf0ikHG3WObhHKDMHnHd5uMI Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 745a95dd657e472c80501d4f739fb1e0 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:40.977039 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/745a95dd657e472c80501d4f739fb1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_745a95dd657e472c80501d4f739fb1e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/745a95dd657e472c80501d4f739fb1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/745a95dd657e472c80501d4f739fb1e0"}]}] Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 745a95dd657e472c80501d4f739fb1e0 Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAccessNegativeTestJSON-229914620-project Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ec85123097dd400d81740d8ae6140a3b Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-229914620-project Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} Oct 10 10:39:40.978673 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1219625562', 'body': {'addTenantAccess': {'tenant': '745a95dd657e472c80501d4f739fb1e0'}}} Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:39:40.979725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 10:39:40.981110 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:40.982325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94a7b672-3acd-4fd9-920e-b34f87899c2a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:40.982325 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94a7b672-3acd-4fd9-920e-b34f87899c2a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] 10.222.0.16 "POST /compute/v2.1/flavors/1219625562/action" status: 403 len: 130 microversion: 2.1 time: 0.480230 Oct 10 10:39:40.982325 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 367/667] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:40 2022] POST /compute/v2.1/flavors/1219625562/action => generated 130 bytes in 483 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:40.992811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2077b959-90cd-437d-8846-ebeb9a6f99c6 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:41.034548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2077b959-90cd-437d-8846-ebeb9a6f99c6 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1219625562" status: 202 len: 0 microversion: 2.1 time: 0.047596 Oct 10 10:39:41.035767 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 368/668] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:39:40 2022] DELETE /compute/v2.1/flavors/1219625562 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:41.047181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdb80e5-e993-4e5b-a43c-cfbaa672d783 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:41.073788 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccdb80e5-e993-4e5b-a43c-cfbaa672d783 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.033173 Oct 10 10:39:41.075825 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 369/669] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:41 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:41.101839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc1445d2-1510-4272-886a-659ef319383c tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-508545136", "id": 1814464924, "os-flavor-access:is_public": "False"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:41.141105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc1445d2-1510-4272-886a-659ef319383c tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.045529 Oct 10 10:39:41.142651 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 370/670] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:41 2022] POST /compute/v2.1/flavors => generated 438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:41.156877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32bfd5c3-b22e-4803-8cd4-bd3dffeb559e tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:41.577189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:41.592694 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d73c342-72c6-410e-92c2-45c0c282ec02 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1311 microversion: 2.1 time: 0.826357 Oct 10 10:39:41.595541 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 301/671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:40 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1311 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:41.610594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:41.610594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:41.610594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:41.610594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:41.611141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:41.611329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:41.615386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:41.617339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32bfd5c3-b22e-4803-8cd4-bd3dffeb559e tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1814464924/action" status: 200 len: 97 microversion: 2.1 time: 0.465438 Oct 10 10:39:41.618001 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 371/672] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:41 2022] POST /compute/v2.1/flavors/1814464924/action => generated 97 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:39:41.618823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:41.632703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5b3367e-65b1-46ec-bedd-a0e30e1bc15a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:41.636666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a5b3367e-65b1-46ec-bedd-a0e30e1bc15a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ec85123097dd400d81740d8ae6140a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745a95dd657e472c80501d4f739fb1e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5b3367e-65b1-46ec-bedd-a0e30e1bc15a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Request method failure captured: Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/flavors/1814464924/action HTTP/1.1 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 70 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZmqkiWuAJ2ZLSV6_ywI0ZvtoZL8b6J-cWBBvnFoeJN0KPWQ3KjWCZabKwxYqWi-ukee3K75pH8UZW1BfOAIbjaCE4k8FNzV88eg6OSBtPH5ONss_5jHmakpZYP7g7Z4_hf3SsjkKa0q5cDUKEc3GQpf0ikHG3WObhHKDMHnHd5uMI Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 745a95dd657e472c80501d4f739fb1e0 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:39:41.638713 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/745a95dd657e472c80501d4f739fb1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_745a95dd657e472c80501d4f739fb1e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/745a95dd657e472c80501d4f739fb1e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/745a95dd657e472c80501d4f739fb1e0"}]}] Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 745a95dd657e472c80501d4f739fb1e0 Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-229914620 Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAccessNegativeTestJSON-229914620-project Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ec85123097dd400d81740d8ae6140a3b Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-229914620-project Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: {"removeTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} Oct 10 10:39:41.640429 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1814464924', 'body': {'removeTenantAccess': {'tenant': '745a95dd657e472c80501d4f739fb1e0'}}} Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can( Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:39:41.641443 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 10:39:41.642873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:41.646484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5b3367e-65b1-46ec-bedd-a0e30e1bc15a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:41.647811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5b3367e-65b1-46ec-bedd-a0e30e1bc15a tempest-FlavorsAccessNegativeTestJSON-229914620 tempest-FlavorsAccessNegativeTestJSON-229914620-project] 10.222.0.16 "POST /compute/v2.1/flavors/1814464924/action" status: 403 len: 133 microversion: 2.1 time: 0.021765 Oct 10 10:39:41.663580 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 372/673] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:41 2022] POST /compute/v2.1/flavors/1814464924/action => generated 133 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:41.684670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a3ed4626-f5f7-4a56-b726-7d17581e179f tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "745a95dd657e472c80501d4f739fb1e0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:41.762810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:41.776438 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cc26395-7f3d-4bb3-9d7a-539e24944aea tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1293 microversion: 2.1 time: 0.177785 Oct 10 10:39:41.779416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 302/674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:41 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:41.813259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:41.814046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:41.828396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:41.829218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:41.830159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:41.832103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:41.833311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:41.834157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:42.213124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:42.231517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:42.234088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:42.241601 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd97741f-d903-465f-a326-1833f11c109e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.432785 Oct 10 10:39:42.242412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 303/675] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:41 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:42.268469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:42.309356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:42.311770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:42.312568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:42.335486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] Creating event network-changed:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h2-860687-2 Oct 10 10:39:42.344347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5a11d499-e48d-4eca-ae14-24f81cf61d6b req-ee633765-ef66-41e1-a8ca-58e5146be155 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078729 Oct 10 10:39:42.345436 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 304/676] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:42.365829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a3ed4626-f5f7-4a56-b726-7d17581e179f tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1814464924/action" status: 200 len: 21 microversion: 2.1 time: 0.697645 Oct 10 10:39:42.366993 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 373/677] 10.222.0.16 () {60 vars in 1200 bytes} [Mon Oct 10 10:39:41 2022] POST /compute/v2.1/flavors/1814464924/action => generated 21 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:39:42.386353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b03c22ce-75c2-48a5-a194-4c2e5ff757ce tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:42.407957 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b03c22ce-75c2-48a5-a194-4c2e5ff757ce tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1814464924" status: 202 len: 0 microversion: 2.1 time: 0.034153 Oct 10 10:39:42.419412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb79c032-1716-4bbb-be27-099432f2e4c0 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:42.427800 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 305/678] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:39:42 2022] DELETE /compute/v2.1/flavors/1814464924 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:42.461852 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb79c032-1716-4bbb-be27-099432f2e4c0 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.048564 Oct 10 10:39:42.476990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 374/679] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:42.489578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-242cf066-8cda-4238-9f39-ddac3fff8f80 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2068568937", "id": 370112802, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:42.522736 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-242cf066-8cda-4238-9f39-ddac3fff8f80 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038410 Oct 10 10:39:42.523363 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 306/680] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:42 2022] POST /compute/v2.1/flavors => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:42.537867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-877cf4b0-0364-488a-a030-8414654a4fd4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89a940480f384b77bcbf9c0b7d9dab0d"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:42.617990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:42.618789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:42.630607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:42.632423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:42.633082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:42.636031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:42.636731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:42.638584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:42.989065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-877cf4b0-0364-488a-a030-8414654a4fd4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] HTTP exception thrown: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-877cf4b0-0364-488a-a030-8414654a4fd4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Request method failure captured: Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/flavors/370112802/action HTTP/1.1 Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 70 Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZnfQ9_nV-1ri71kyOhD8s9OFLGNjSiIKhdst6wsFg5iB9UazLrclIw0LkchTg3jqdOgtTZ_63DcZgZOj6Yc5xPxAYFUnNfNi26tqZMRyLEItYFG4v8_itCr7Ol4vojHErREyDzbXTxC7IQxuYwS7GzmqYXn50WlOTsHf0sZi8DRrw Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:39:42.993076 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ddaed9235e864c20bf19f1eb774a02dc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ddaed9235e864c20bf19f1eb774a02dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ddaed9235e864c20bf19f1eb774a02dc"}]}] Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ddaed9235e864c20bf19f1eb774a02dc Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500 Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9074bc89075e415ab665a1add5f48a3a Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: {"removeTenantAccess": {"tenant": "89a940480f384b77bcbf9c0b7d9dab0d"}} Oct 10 10:39:42.994566 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: exception: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '370112802', 'body': {'removeTenantAccess': {'tenant': '89a940480f384b77bcbf9c0b7d9dab0d'}}} Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 10 10:39:42.995501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:42.996648 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. Oct 10 10:39:42.997862 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:39:42.998243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:43.010436 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5915b8c-1f82-4bc2-a82b-02ff92beb399 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1495 microversion: 2.1 time: 0.389550 Oct 10 10:39:43.011536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-877cf4b0-0364-488a-a030-8414654a4fd4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Returning 404 to user: Flavor access not found for 38 / 89a940480f384b77bcbf9c0b7d9dab0d combination. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:39:43.016533 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-877cf4b0-0364-488a-a030-8414654a4fd4 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/370112802/action" status: 404 len: 124 microversion: 2.1 time: 0.484126 Oct 10 10:39:43.017411 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 307/681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:42 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1495 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:43.020823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 375/682] 10.222.0.16 () {60 vars in 1197 bytes} [Mon Oct 10 10:39:42 2022] POST /compute/v2.1/flavors/370112802/action => generated 124 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:39:43.026588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:43.027629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:43.045570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6864429c-70d5-4798-81fd-3a6bf6166990 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:43.047506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.048297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.049565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:43.051585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.052411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.053094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:43.099603 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6864429c-70d5-4798-81fd-3a6bf6166990 tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/370112802" status: 202 len: 0 microversion: 2.1 time: 0.069552 Oct 10 10:39:43.100592 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 376/683] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:39:43 2022] DELETE /compute/v2.1/flavors/370112802 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:39:43.138060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:43.151451 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b65ad26-0fac-4df3-b31e-03142016c916 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1299 microversion: 2.1 time: 0.130191 Oct 10 10:39:43.154084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 308/684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:43 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:43.173717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a0e481f-6e65-4765-8563-bb7c3310c11d tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:43.208551 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a0e481f-6e65-4765-8563-bb7c3310c11d tempest-FlavorsAccessNegativeTestJSON-1583401500 tempest-FlavorsAccessNegativeTestJSON-1583401500-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.052190 Oct 10 10:39:43.224550 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 309/685] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:39:43 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:43.272276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:43.272895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:43.283940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.288414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.288414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:43.291099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.291506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.291940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:43.588497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:43.599615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:43.602133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:43.603987 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6dac8222-07dd-44a4-a31b-eb3a4ae9b552 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.336855 Oct 10 10:39:43.606002 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 310/686] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:43 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:43.758088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:43.759080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:43.771049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.771550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.775925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:43.778766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:43.781004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:43.781630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.106151 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6124cca-2b01-4810-9294-adeb6735e475 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1646 microversion: 2.1 time: 1.004111 Oct 10 10:39:44.110115 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 377/687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:43 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1646 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:44.139657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:44.141080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:44.150987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.151594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.153513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.154978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.156083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.159759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.181393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:44.182221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:44.200997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.201499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.205927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.212728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.213262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.218923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.630970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:44.650130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-536c4450-f4af-4668-93e5-15d67be05d47 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.467407 Oct 10 10:39:44.652114 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 378/688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:44 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:44.670830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:44.673370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:44.700979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.702719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.703987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.705717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.706503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.708012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.717345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7a34478-b611-4867-8513-f53f6a41b499 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1646 microversion: 2.1 time: 0.583633 Oct 10 10:39:44.717929 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 311/689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:44 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1646 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:44.745658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:44.750228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.750931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.753267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.761170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.761588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.762029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.806147 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44b1aa7a-612e-4375-9a98-063bd95af662 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065047 Oct 10 10:39:44.815265 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 312/690] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:39:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:39:44.820461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:44.823284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:44.833104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:44.839767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.840581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.841252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.842197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:44.842869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:44.843823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:44.849518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:44.874377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lazy-loading 'flavor' on Instance uuid f143b145-e939-4d70-8b2f-a820bb1da065 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:44.906769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:39:45.040069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:45.071235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:45.077915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:45.080761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1197ef8d-1255-41ab-8c95-3e5fe226e0ef tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.425933 Oct 10 10:39:45.085718 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 379/691] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:44 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:45.998888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1485465459", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:46.074988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:46.538991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:46.539871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:46.540755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:46.541710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:46.542616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:46.560669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:46.561460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:46.562107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:46.563736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:46.565714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:46.567130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:46.599982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:46.607871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:46.624696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:46.627742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:46.692601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-022cd504-4fc8-46d2-99ae-5f423e5e5f7f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118800 Oct 10 10:39:46.693440 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 380/692] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:39:46.701756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:46.703017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:46.725439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:46.726256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:46.726956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:46.728338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:46.729018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:46.729659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.024753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:47.042816 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b18f02c8-e0c6-4ada-a684-c4d91fc170b1 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.346956 Oct 10 10:39:47.044406 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 381/693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:46 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:47.420930 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07fd3046-3af3-45fd-b5c5-2f54d3056778 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065/action" status: 202 len: 0 microversion: 2.1 time: 2.604083 Oct 10 10:39:47.423021 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 313/694] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:39:44 2022] POST /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065/action => generated 0 bytes in 2607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:39:47.428769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:47.429759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:47.464938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.465881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.466548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.467511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.468442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.469088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.587278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-679226499", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:47.701878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:47.702312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:47.702784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:47.707597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:47.708917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:47.734095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.738027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.738641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.740440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.742966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.743585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.775250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Getting quotas for project 563b176f9e7246f7ae7df171d17dad51. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:47.781439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Getting quotas for user d55390ca6db84ef79df2947f1f7f8101 and project 563b176f9e7246f7ae7df171d17dad51. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:47.800414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:47.802876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:47.824395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:47.843651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:47.848384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:47.849588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-841b55ea-145f-4f17-ac35-849233c29c34 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.425335 Oct 10 10:39:47.865289 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 314/695] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:47 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:47.879660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366b075f-2d79-4500-904e-f42558454b83", "tag": "e23d90ff-faac-4edb-86f7-64ebc26f6f32"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:47.895390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.896395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.897012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.906309 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc4d2215-a3c1-4f0d-acf2-4c4df0dcb7c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.860470 Oct 10 10:39:47.907980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 382/696] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:39:47.913270 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] Creating event network-changed:e23d90ff-faac-4edb-86f7-64ebc26f6f32 for instance 366b075f-2d79-4500-904e-f42558454b83 on n-h1-860687-2 Oct 10 10:39:47.913899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:47.915401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:47.927313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.928444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.929049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.932084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.932826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.932968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4f04c6cf-4ee0-463d-8bd3-11bc83049fe7 req-4c4d264a-5b3f-4799-8251-a5549e6df3cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066203 Oct 10 10:39:47.933563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.934145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 315/697] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:47.944310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:47.949087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:47.973611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.976109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.980194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:47.981865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:47.982508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:47.983174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:48.030765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.041724 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61eeed45-4fcb-4fc1-ab1d-9f18dbd97d51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1269 microversion: 2.1 time: 0.131928 Oct 10 10:39:48.042748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 383/698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:47 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:48.057051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "name": "network-vif-plugged", "status": "completed", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:48.068413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:48.069632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:48.070596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:48.096165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] Creating event network-vif-plugged:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h2-860687-2 Oct 10 10:39:48.109586 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-79314b6c-3f01-4222-830e-cb70f5ed35d8 req-a60121bd-5741-461f-8c53-3ec990700578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065584 Oct 10 10:39:48.110197 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 384/699] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:48.116463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:48.117111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:48.186887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.195794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d55a44b-3fa2-42f3-96a1-c0302797b3cb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.260458 Oct 10 10:39:48.197071 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 316/700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:47 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:48.202066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:48.202734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:48.209274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:48.209766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:48.210207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:48.210935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:48.211436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:48.211867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:48.265969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.277981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.279451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.282657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:48.300234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9dc07e36-55ec-4fb8-a50d-823ab269e97d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1452 microversion: 2.91 time: 0.186596 Oct 10 10:39:48.302082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 385/701] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:48 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:48.722432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:48.741221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c72cbb47-7b69-4fc0-ba03-29434a75cf45 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.540579 Oct 10 10:39:48.741985 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 317/702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:48 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:48.882464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:48.883741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:48.891679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:48.892505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:48.895140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:48.896190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:48.896865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:48.899084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.065970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f559a08-1772-42d7-82fd-08aefc350217 tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] Calling method '.version_select at 0x7f677cddb940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.222470 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f559a08-1772-42d7-82fd-08aefc350217 tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] 10.222.0.16 "GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c" status: 200 len: 784 microversion: 2.1 time: 0.381803 Oct 10 10:39:49.224185 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 386/703] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:39:48 2022] GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c => generated 784 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:49.229944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.230786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:49.239734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.241035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.241682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.243304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.244444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.245099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.491581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.503577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.509437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.511588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-820e0b65-1628-41a8-a242-67b869a62410 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1412 microversion: 2.25 time: 0.635813 Oct 10 10:39:49.513029 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 318/704] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:48 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1412 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:49.522461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.524939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:49.536401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.537271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.537891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.540272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.540757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.541334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.541760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.552968 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27745562-d08f-4452-8e9b-70a857eeb6ee tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1275 microversion: 2.1 time: 0.327371 Oct 10 10:39:49.553790 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 387/705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1275 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:49.575861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84b313cb-25c0-4547-aeb9-a68fcc03ee8a tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] Calling method '.version_select at 0x7f677cdc6820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.687882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84b313cb-25c0-4547-aeb9-a68fcc03ee8a tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.119855 Oct 10 10:39:49.689200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 388/706] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/images => generated 445 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:49.702944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.703937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:49.710802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.711399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.711902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.713487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.714008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.714499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.719490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:49.761820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.779766 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae33239d-3c27-4a2a-ac14-3d449ecc2868 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.265314 Oct 10 10:39:49.780968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 319/707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:49.788907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c72e54-d068-46f5-bbe2-17f1ec7815ed tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] Calling method '.version_select at 0x7f677cd28790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.824798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.839238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.840818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:49.854810 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8402b5b7-b6bf-4ddd-8eb1-8048b644484e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1504 microversion: 2.91 time: 0.164051 Oct 10 10:39:49.858940 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 389/708] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:49.871467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:49.872583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:49.881724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.885916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.886591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.889001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:49.890666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:49.891407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:49.999364 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5c72e54-d068-46f5-bbe2-17f1ec7815ed tempest-ListImagesTestJSON-1600187453 tempest-ListImagesTestJSON-1600187453-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.215689 Oct 10 10:39:50.001990 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 320/709] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:50.243700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:50.258639 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e23b738-6100-4743-831a-817e94066c53 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.395188 Oct 10 10:39:50.259910 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 390/710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:49 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:50.542385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:50.543369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:50.548359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:50.552244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.552944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.553380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.554068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.554681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.555133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.582270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:50.583215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:50.590696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.591748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.592341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.593463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.594129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.595068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.789478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:50.799606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:50.803169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:50.805522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d322294f-1231-409b-9277-791ebb590c59 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1609 microversion: 2.25 time: 0.268309 Oct 10 10:39:50.806631 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 321/711] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:50 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1609 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:50.811690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:50.812565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:50.819919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:50.821261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.821982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.822903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.824742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.825594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.826253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.828802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2dc650cc-e875-4a31-9e88-812de8d3c814 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 0.252973 Oct 10 10:39:50.829376 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 391/712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:50 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:50.841761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:50.842445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:50.852400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.853061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.853782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:50.854634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:50.855258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:50.855856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.016734 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-113159d2-0789-4f45-85fd-75a75de30a86 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.178683 Oct 10 10:39:51.028008 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 392/713] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:39:50 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:39:51.036855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:51.037748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:51.047041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.047861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.048687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.049622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.050470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.051154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.114971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:51.125514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47f7ab77-ec83-4e16-8009-1e927874417b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.317308 Oct 10 10:39:51.126650 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 322/714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:50 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:51.133582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0eb006-0f97-46a3-80e9-f0eb428e91b2", "tag": "48becb52-706a-42d2-b305-dff39afedfa7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:51.148202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.150042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.150853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.174757 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] Creating event network-changed:48becb52-706a-42d2-b305-dff39afedfa7 for instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 on n-h2-860687-2 Oct 10 10:39:51.183073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0b0f6c8c-cca7-44c9-ab7c-22ba3207f60f req-40cf6d96-5ab7-4828-9262-e831bc66edf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052876 Oct 10 10:39:51.184054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 323/715] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:51.215605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:51.229013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:51.232583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:51.247222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d2be6d3-2e1e-4543-8309-cd43cfef5477 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1510 microversion: 2.91 time: 0.217343 Oct 10 10:39:51.248725 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 393/716] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:51 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:51.281574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:51.282127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:51.289618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.290421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.291052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.292184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.292790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.293360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.370731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b49afee0-70ea-4eed-96bb-d6006e8070a0 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2055746634", "id": 1395062634, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:51.410910 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b49afee0-70ea-4eed-96bb-d6006e8070a0 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.225244 Oct 10 10:39:51.412062 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 324/717] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:39:51 2022] POST /compute/v2.1/flavors => generated 471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:39:51.443519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56f57e04-9301-4f4c-9c89-10342ee930c7 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:51.459181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:51.467484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-380b0a3a-6e84-4957-990a-be3fccd4f96a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.189605 Oct 10 10:39:51.468737 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 394/718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:51 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:51.646774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56f57e04-9301-4f4c-9c89-10342ee930c7 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1395062634/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.217045 Oct 10 10:39:51.653031 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 325/719] 10.222.0.16 () {62 vars in 1265 bytes} [Mon Oct 10 10:39:51 2022] POST /compute/v2.1/flavors/1395062634/os-extra_specs => generated 62 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:51.658874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-694c151b-6db1-486c-977a-8c78fd1c95f2 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:51.680648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-694c151b-6db1-486c-977a-8c78fd1c95f2 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1395062634" status: 202 len: 0 microversion: 2.86 time: 0.026245 Oct 10 10:39:51.681446 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 395/720] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Oct 10 10:39:51 2022] DELETE /compute/v2.1/flavors/1395062634 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:51.692529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65ece777-a4b4-4d4c-ad4e-fea386772c27 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:51.717501 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65ece777-a4b4-4d4c-ad4e-fea386772c27 tempest-FlavorMetadataValidation-1816095927 tempest-FlavorMetadataValidation-1816095927-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6685 microversion: 2.86 time: 0.030664 Oct 10 10:39:51.718318 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 326/721] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:39:51 2022] GET /compute/v2.1/flavors/detail => generated 6685 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:39:51.858877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:51.859528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:51.869537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.871219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.872574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:51.873896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:51.874800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:51.875874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.134575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:52.144537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c23afc9-192a-4d0e-b87d-6ba3e4ad7fb1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 0.289346 Oct 10 10:39:52.145652 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 396/722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:51 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:52.152687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:52.153425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:52.164819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.165497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.166020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.166891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.167493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.168084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.279679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:52.281015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:52.307571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.308929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.311102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.311892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.313569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.315282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.362977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:52.372827 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63cf07c5-bba9-4bc3-85f6-a243d3f93c58 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.223843 Oct 10 10:39:52.395750 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 327/723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:52 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:52.415161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:52.415719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:52.455885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.457128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.457867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.462346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.463140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.466722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:52.467767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.483036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:52.484816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:52.492037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80ac0d4e-2bf7-4a3f-b27c-fd5d62ddda4b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1510 microversion: 2.91 time: 0.217813 Oct 10 10:39:52.494108 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 397/724] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:52 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:52.514594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:52.516109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:52.521258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:39:52.526207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.527766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.528565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.529979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:52.531280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:52.532009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:52.642035 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76f4e8da-9611-4304-b7fb-9b534e581041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 204 len: 0 microversion: 2.1 time: 0.244808 Oct 10 10:39:52.657796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 328/725] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:39:52 2022] DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:52.797276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-159003509", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "1045431188", "adminPass": "***", "networks": [{"uuid": "5a8bf198-e3f9-4d29-a436-b32671d2b5ea"}], "security_groups": [{"name": "tempest-securitygroup--428833452"}], "key_name": "tempest-keypair-202871567", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:53.007794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:53.019119 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a8b1b83-1d66-43ad-a63d-eb3a28e82912 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.522788 Oct 10 10:39:53.020107 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 398/726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:52 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:53.073683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] validate_networks() for [('5a8bf198-e3f9-4d29-a436-b32671d2b5ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:53.170109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:53.170862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:53.178874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:53.179616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:53.180313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:53.181781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:53.182368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:53.183482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:53.569914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:53.587188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f76a454-f931-4187-b294-651e94f65b9a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 0.421507 Oct 10 10:39:53.587944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 399/727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:53 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:53.602483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f143b145-e939-4d70-8b2f-a820bb1da065", "name": "network-vif-unplugged", "status": "completed", "tag": "5feb11b1-c915-412f-b614-78efefef6f98"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:53.632264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:53.633683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:53.634330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:53.686154 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] Creating event network-vif-unplugged:5feb11b1-c915-412f-b614-78efefef6f98 for instance f143b145-e939-4d70-8b2f-a820bb1da065 on n-h2-860687-2 Oct 10 10:39:53.700638 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4b0c4bc2-dd59-408b-abe7-e82c0cd290df req-aaefb218-b10d-44ab-b494-6773b96a5fbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109764 Oct 10 10:39:53.701249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 400/728] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:53.718461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:53.719197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:53.734764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:53.735292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:53.735739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:53.736983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:53.737442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:53.737872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.033603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:39:54.034741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:39:54.036137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:39:54.036740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:39:54.037305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:39:54.055375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.058357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.059262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.060046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.060504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.060946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.113537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.115637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for project c87ea9779ea549d8a893c36bbe69d962. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:39:54.125136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11b93683-c1ac-4cba-a026-2defdaeb1829 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.419900 Oct 10 10:39:54.126186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 401/729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:53 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:54.145735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Getting quotas for user c0b9f90c3fc24f4fb0e03e557230db65 and project c87ea9779ea549d8a893c36bbe69d962. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:39:54.147505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:54.149535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:54.159896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.160690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.161709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.162743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.163553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.164137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.186949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:39:54.196839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:39:54.275508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.290654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.295928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.308623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80cefb1b-40b1-4ff0-98d9-b2499092373a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1531 microversion: 2.91 time: 0.180556 Oct 10 10:39:54.311828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed061135-b96c-4d80-b112-563c9a27f44d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.519647 Oct 10 10:39:54.312482 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 329/730] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:39:54.324148 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 402/731] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:54 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1531 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:54.326153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:54.327064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:54.339703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.340203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.340643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.341354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.341815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.342203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04bbe92e-da51-4ad3-bc3a-00179c8473f0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:54.342340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.350431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04bbe92e-da51-4ad3-bc3a-00179c8473f0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:54.559547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04bbe92e-da51-4ad3-bc3a-00179c8473f0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.568762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04bbe92e-da51-4ad3-bc3a-00179c8473f0 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1263 microversion: 2.1 time: 0.242297 Oct 10 10:39:54.569358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 403/732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:54 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1263 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:54.741777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:54.753396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82031e75-2060-40d0-8db5-48dbd9a93dd0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.436830 Oct 10 10:39:54.754013 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 330/733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:54 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:54.770089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:54.770776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:54.799284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.799783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.800281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:54.801022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:54.801486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:54.801983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.157069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:55.169619 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-694b11ac-222f-484a-acb5-7650ca1ceb1f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 0.414492 Oct 10 10:39:55.171313 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 331/734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:54 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:55.194114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b075f-2d79-4500-904e-f42558454b83", "name": "network-vif-plugged", "status": "completed", "tag": "e23d90ff-faac-4edb-86f7-64ebc26f6f32"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:55.195436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:55.196056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:55.208147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.210314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.212563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.213545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.215175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.216277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.219113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.227996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.228820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.235512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:55.262352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] Creating event network-vif-plugged:e23d90ff-faac-4edb-86f7-64ebc26f6f32 for instance 366b075f-2d79-4500-904e-f42558454b83 on n-h1-860687-2 Oct 10 10:39:55.276951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fa24b152-5780-4671-bb44-7996a787a406 req-a0f4b13c-c6c2-4e55-adee-73e922cc7b92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099921 Oct 10 10:39:55.278498 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 332/735] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:55.288714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:55.294958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:55.305654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.306590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.307531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.308667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.324977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.327185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.506690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lazy-loading 'services' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:55.573181 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e0ed57e-3917-40e5-aa56-6be945129005 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1936 microversion: 2.91 time: 1.001119 Oct 10 10:39:55.587862 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 404/736] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:54 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1936 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:55.604635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:55.607651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:55.622126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.622744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.624574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.626615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.628979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.629524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.759367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:55.780906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6c4d5c4-4887-43eb-9b8e-588fa7c61272 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.495156 Oct 10 10:39:55.782034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 333/737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:55 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:55.799459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:55.802408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:55.816751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:55.819696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.822511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.823377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.824368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.831391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5195ad59-417b-46d9-bc92-abd117278abe tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1259 microversion: 2.1 time: 0.237327 Oct 10 10:39:55.831616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.833166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.841487 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 405/738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:55 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:55.857651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:55.862816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:55.890669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.893815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.895737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.897521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:55.900507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:55.903573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:55.938283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lazy-loading 'services' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:55.962716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-105f3de0-bb0d-4baf-a9d0-e96a15d51808 tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1936 microversion: 2.91 time: 0.178719 Oct 10 10:39:55.964034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 334/739] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:55 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1936 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:55.996823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:56.002135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.002799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.004349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.010666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.011224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.011668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.057036 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81b24bfb-48a0-496d-bbda-4230e7fe0efd tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.064296 Oct 10 10:39:56.057959 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 335/740] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Oct 10 10:39:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:39:56.063037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f143b145-e939-4d70-8b2f-a820bb1da065", "tag": "5feb11b1-c915-412f-b614-78efefef6f98"}, {"name": "network-changed", "server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:56.075773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.076643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.077291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.092781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Creating event network-changed:5feb11b1-c915-412f-b614-78efefef6f98 for instance f143b145-e939-4d70-8b2f-a820bb1da065 on n-h2-860687-2 Oct 10 10:39:56.094013 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] Creating event network-changed:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h2-860687-2 Oct 10 10:39:56.101611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-62b8e6fd-b182-4824-9d47-0cfc51670965 req-e02395d7-7d94-4a6b-802b-c72576549c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042157 Oct 10 10:39:56.102967 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 336/741] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:56.110074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:56.111259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:56.120554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.121285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.121939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.123070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.123747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.124512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.137639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:56.148594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccbe1264-5e69-4284-b4a1-68804a5078de tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1367 microversion: 2.1 time: 0.305814 Oct 10 10:39:56.149409 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 406/742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:55 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:56.168311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lazy-loading 'flavor' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:39:56.195461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:56.196889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:56.207960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.208455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.210037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.211101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.212149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.213294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.694421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:56.724297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b8721d4-ba8d-4e53-a3a5-95b0015f1602 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 0.533830 Oct 10 10:39:56.769220 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 407/743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:56 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:56.810739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:56.812131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:56.836249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.841439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.845515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.848767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:56.850161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:56.851433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:56.899351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:57.002174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55c2f9cb-bcb2-4f59-9027-8b7669152a01 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action" status: 202 len: 0 microversion: 2.91 time: 0.896488 Oct 10 10:39:57.010628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 337/744] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:39:56 2022] POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:39:57.018213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:57.023638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:57.032290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.033735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.034447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.035850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.041172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.042030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.161662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:57.175326 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76114d89-4e2e-476b-b368-13684804eb21 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1321 microversion: 2.1 time: 0.161427 Oct 10 10:39:57.176491 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 338/745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:57 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:57.202133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:57.202884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:57.216572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.217080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.217517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.219837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.221354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.221992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.450873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:57.463291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2922e204-9d91-4024-bd32-ba79a9e49622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.654354 Oct 10 10:39:57.464099 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 408/746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:56 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:57.466255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:57.477183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:57.477570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:57.477813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:57.481371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:57.493294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.493805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.494244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.494953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.497815 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0805aaf9-0cec-49e3-aa37-8edea411eb34 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.320112 Oct 10 10:39:57.498977 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 339/747] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:39:57 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:39:57.499569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.500250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.755801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:57.756663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:57.764458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:39:57.780657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.781360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.782517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:57.784767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:57.785780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:57.787956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:58.875648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:58.898169 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-003876b7-6c2e-488f-a435-e7aa4cd3883f tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1557 microversion: 2.1 time: 1.430596 Oct 10 10:39:58.903792 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 409/748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:57 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1557 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:58.915073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eb006-0f97-46a3-80e9-f0eb428e91b2", "name": "network-vif-plugged", "status": "completed", "tag": "48becb52-706a-42d2-b305-dff39afedfa7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:58.930361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:58.931230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:58.931848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:58.946448 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] Creating event network-vif-plugged:48becb52-706a-42d2-b305-dff39afedfa7 for instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 on n-h2-860687-2 Oct 10 10:39:58.954376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:58.963698 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bd12f3b-8eab-47af-8e38-e967a644031d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1317 microversion: 2.1 time: 1.213750 Oct 10 10:39:58.964370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5e74424f-477a-4942-b528-37e2709f8920 req-4982e286-a9b7-49c1-8e9c-42ff37892db5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046075 Oct 10 10:39:58.965461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 410/749] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:58.971476 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 340/750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:57 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1317 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:39:58.984067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:58.986408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:59.007980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:59.009984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:59.011687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:59.013110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:59.014946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:59.015493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:59.204154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-422434554", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:59.292208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:39:59.667089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:39:59.678164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c78d50d9-a6db-48d0-8f93-9f83b910b6bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.711047 Oct 10 10:39:59.678949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 411/751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:58 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:39:59.687147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cff59e5-7804-49cb-a842-394d2de7a908", "name": "network-vif-deleted", "tag": "5b84cf1f-746e-4da0-94de-93accd23ecbb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:39:59.707746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:59.709111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:59.709764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:59.726912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] Creating event network-vif-deleted:5b84cf1f-746e-4da0-94de-93accd23ecbb for instance 0cff59e5-7804-49cb-a842-394d2de7a908 on n-h1-860687-2 Oct 10 10:39:59.737380 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-df916e08-4f52-4c9a-82c2-c90ebec4ba84 req-4466cf8d-2ba5-4b92-b87b-5c1f8cbd8d1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056605 Oct 10 10:39:59.739606 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 412/752] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:39:59.747469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:39:59.753187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:39:59.769131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:59.769942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:59.770890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:39:59.771985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:39:59.772767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:39:59.773427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.042219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:00.056993 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b5f4d0c5-e017-45f1-a36f-545264bf12d5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 0.315664 Oct 10 10:40:00.057861 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 413/753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:39:59 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:00.063140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:00.064024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:00.070947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.071776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.072393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.073343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.073964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.074549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.082730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:00.083867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:00.084513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:00.085078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:00.085646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:00.105207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.105960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.106557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.109525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.110202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.113371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.139899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=11 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:00.151527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:00.178061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Getting quotas for project 98d14526bda544259e66185614b4881d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:00.193378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Getting quotas for user 9298c75fa5004ebd8e871e446afaf5b8 and project 98d14526bda544259e66185614b4881d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:00.228973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:00.232441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:00.304934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e66bb04-f808-427d-a022-56253d26b5a4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326216 Oct 10 10:40:00.313321 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 341/754] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:39:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:00.320692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:00.321628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:00.332767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.333830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.334603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.337397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.339658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.340731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.380765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:00.400388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:00.405390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:00.429286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bd5be57-2fa5-41bc-bbc3-37007728d592 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.368525 Oct 10 10:40:00.433502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 414/755] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:00 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:00.451906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:00.452656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:00.466105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.470592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.471428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.472441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:00.473367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:00.477664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:00.768186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6e0c586-9259-4070-b0f7-fa05adbb7d05 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.451536 Oct 10 10:40:00.768975 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 342/756] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:40:00 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-interface => generated 285 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:00.781129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a1d776d-a633-4b32-9820-f13b1a1b6dfa tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:00.781924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a1d776d-a633-4b32-9820-f13b1a1b6dfa tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:01.011580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a1d776d-a633-4b32-9820-f13b1a1b6dfa tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:01.020851 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a1d776d-a633-4b32-9820-f13b1a1b6dfa tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1218 microversion: 2.1 time: 0.250606 Oct 10 10:40:01.035107 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 343/757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:00 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:01.035107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:01.035107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:01.046744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:01.054331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:01.054961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:01.055848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:01.056406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:01.057103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:01.131609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:01.145330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98e0a455-9a93-4140-83d4-2cdafc21a75a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1467 microversion: 2.1 time: 0.709354 Oct 10 10:40:01.147864 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 415/758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:00 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1467 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:01.184505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:01.185390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:01.197300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:01.200220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:01.200972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:01.202319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:01.203079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:01.203786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:01.927758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:01.937703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30693c86-1d8c-45c8-a190-03420b188fac tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.912842 Oct 10 10:40:01.939905 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 344/759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:01 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:02.163580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:02.172219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0b1e6b0-83c2-419e-bf7f-9fd56dc66428 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1505 microversion: 2.1 time: 1.010524 Oct 10 10:40:02.177178 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 416/760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:01 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1505 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:02.209401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:02.210506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:02.218626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.228304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.228882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.230626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.234089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.235342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.265807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:02.268459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:02.278589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.280070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.280865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.281965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.283520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.283965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.558456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:02.574399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:02.577721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:02.611632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1114de43-9df2-42db-9394-f3b4ed0e8ce3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.432272 Oct 10 10:40:02.616156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 417/761] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:02 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:02.643207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:02.644025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:02.651322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.652051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.652655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.653707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.657255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.657941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.914409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:02.927178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cdb918b6-ec60-4f24-b1f4-24b919667ec2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1276 microversion: 2.1 time: 0.307365 Oct 10 10:40:02.927944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 418/762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:02 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:02.966148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:02.967152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:02.975393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.980397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.981861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:02.986601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:02.987752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:02.990275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:03.541980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:03.551368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d450d1f4-0ec5-4c4c-91d0-fd56591e403e tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.590172 Oct 10 10:40:03.576693 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 419/763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:02 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:03.584365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:03.584992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:03.591078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:03.591569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:03.592166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:03.593292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:03.593750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:03.594174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:03.695867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95b85ac4-a2f9-487b-9e34-b5d4d7c965cb tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1618 microversion: 2.1 time: 1.754634 Oct 10 10:40:03.696554 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 345/764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:01 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1618 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:03.771230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0ee4abb-5066-4ad1-8e5c-95e2d625290a tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Action: 'create', calling method: .version_select at 0x7f677ce15280>, body: {"keypair": {"name": "tempest-keypair-654559839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXjrMW1MJRLopm+c9DXM3OFWZmPYf8T6ZkawjkC59utr3fcdF9NWAkLHBBMwhD/bX5rHmHSodTVeJzXFcUA6iXJqci8Kz0y9OGy7mxWl0wda4GXktTG0CUSP6gAM2SSkw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:03.797517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b0ee4abb-5066-4ad1-8e5c-95e2d625290a tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Getting quotas for project c5cff07e1dd54760babfcedffa37d81e. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:03.806329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b0ee4abb-5066-4ad1-8e5c-95e2d625290a tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Getting quotas for user 3167e5e9262a4ee3a0a629c9b3148c63 and project c5cff07e1dd54760babfcedffa37d81e. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:03.833969 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0ee4abb-5066-4ad1-8e5c-95e2d625290a tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135916 Oct 10 10:40:03.834824 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 346/765] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:40:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:03.843137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:03.843758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:03.851394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:03.852014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:03.852347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:03.853050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:03.853504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:03.854026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.006001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:04.022941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:04.024749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:04.031941 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dbb9189-259c-4a54-bdea-e19bd3760def tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.195918 Oct 10 10:40:04.066742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:04.067206 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 347/766] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:03 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:04.081589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38c9ced8-3a89-4650-9d9c-8e6c7abfd7cd tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1495 microversion: 2.1 time: 0.499928 Oct 10 10:40:04.082241 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 420/767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:03 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1495 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:04.087802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: .version_select at 0x7f677ce345e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-415737771", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:04.094707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:04.096777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:04.123626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:04.126524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:04.127623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.130567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:04.131390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:04.132033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.162050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:04.176476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:04.302535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:04.309403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:04.326016 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d855c368-37d6-430e-8bef-9ebce05dbf95 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.257281 Oct 10 10:40:04.339245 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 348/768] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Oct 10 10:40:04 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:04.344527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b34d659-04ee-493e-b55f-030c1e2118db tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '.version_select at 0x7f677cf8c550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:04.348380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b34d659-04ee-493e-b55f-030c1e2118db tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:04.349379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b34d659-04ee-493e-b55f-030c1e2118db tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:04.350010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b34d659-04ee-493e-b55f-030c1e2118db tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.366448 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b34d659-04ee-493e-b55f-030c1e2118db tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.025172 Oct 10 10:40:04.367930 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 349/769] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:40:04 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:04.382698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:04.383355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:04.390587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:04.394383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:04.395297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.396296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:04.396998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:04.397650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:04.564842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=18 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:04.669417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:04.685111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-60043367-a855-4ceb-8bf4-9a4b8a50ddbb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1276 microversion: 2.1 time: 0.599612 Oct 10 10:40:04.688413 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 421/770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:04 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1276 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:04.721629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-487972657", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c7d0c00f-94fa-4b38-9c6d-284504018129"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:04.800263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:05.100828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d9c9728-61c9-4efe-81ee-8985fbe15e27 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1646 microversion: 2.1 time: 0.722515 Oct 10 10:40:05.103537 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 350/771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:04 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1646 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:05.112075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:05.113167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:05.126015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.128065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.129035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.131435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.132574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.133584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.744017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:05.745102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:05.746753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:05.747600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:05.748283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:05.781452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.782248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.783156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.784363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.785069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.785720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.811646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:05.812042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:05.820789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:05.825215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f1fea93-1bb6-41b7-8f3b-d8d731099b56 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.717995 Oct 10 10:40:05.826824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:05.828792 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 351/772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:05 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:05.846376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 2 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:05.849990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:05.858432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9df6cbb-e23c-4387-b4cc-26b529c75c94", "tag": "291d1e03-eb74-48db-bbe8-10251394865a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:05.897575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.901313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.901951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.940086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128800) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 10:40:05.948483 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] Creating event network-changed:291d1e03-eb74-48db-bbe8-10251394865a for instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 on n-h2-860687-2 Oct 10 10:40:05.961236 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e9f9e089-0a4f-4ebc-9db2-58aedaa50fe6 req-d210c2a5-83e5-4307-aff0-3c5fd070027a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128005 Oct 10 10:40:05.964533 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 352/773] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:05.978254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:05.979787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:05.995814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.996844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:05.997566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:05.999023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:05.999697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:06.000298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:06.006430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:06.022047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:06.134305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:06.146518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:06.191828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=c65535d9-6662-4ead-8fb5-95134fc5bf1d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:06.292179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:06.298267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:06.342026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:06.347260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:06.367204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:06.379438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:06.380084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:06.397362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:06.405605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b086f45-4149-4a73-b39a-e96e80a3a0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.439651 Oct 10 10:40:06.414559 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 353/774] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:05 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:06.425693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-21727853", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cad63d61-412d-4d6c-9849-4c933c49b65e"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:06.484901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8a2930d4-c2ff-42e2-bf95-e7b1e5290160 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.795129 Oct 10 10:40:06.489837 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 422/775] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 1801 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:40:06.503424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:06.503923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:06.516801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:06.517456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:06.517914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:06.518692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:06.519209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:06.519633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:06.550039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] validate_networks() for [('cad63d61-412d-4d6c-9849-4c933c49b65e', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:06.926179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:06.934853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8ff1f56-d721-42dd-9607-20ffdf0ac5da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.443712 Oct 10 10:40:06.947518 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 423/776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:06 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:06.960884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c51c7cbf-bbc1-4bab-a5ab-9bb266988ec6"}], "security_groups": [{"name": "tempest-securitygroup--987148918"}], "key_name": "tempest-keypair-654559839", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:07.454059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] validate_networks() for [('c51c7cbf-bbc1-4bab-a5ab-9bb266988ec6', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:07.674301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:07.674814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:07.675309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:07.675741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:07.676190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:07.685512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:07.686005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:07.686447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:07.687218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:07.687671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:07.688126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:07.707167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:07.713071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for user d2bfae2396ee410c964701fd5d77615e and project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:07.727145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:07.729449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:07.780968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c365e4c7-eff2-4bc9-916e-3e6440768ab0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364797 Oct 10 10:40:07.782109 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 354/777] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:07.800560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:07.806827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:07.812814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Searching by: {'deleted': False, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:40:07.821503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:07.821992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:07.822632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:07.823379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:07.823837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:07.824263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.015549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:40:08.129054 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7d676d9-3f1d-43cd-8657-a2cd0001bec3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.344918 Oct 10 10:40:08.130403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 355/778] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:40:07 2022] GET /compute/v2.1/servers => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:08.135492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:08.136413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:08.145343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.146157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.147656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.149006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.149863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.150579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.694496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:08.702989 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d12ed38-19b2-4384-b041-e64a916dbf5f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.571333 Oct 10 10:40:08.703580 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 356/779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:08 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:08.708308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:08.709538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:08.715317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.715811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.716256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.716953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.717413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.718104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.802107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:08.812185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:08.814021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:08.819455 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efd4cd7b-3e1c-43b0-982e-18ad3d7ca92e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.114551 Oct 10 10:40:08.820033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 357/780] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:08 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:08.824724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:08.825534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:08.828194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:08.832402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.832903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.833537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.834399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.835074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.835512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.851508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:08.852008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:08.852399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:08.852809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:08.853222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:08.862992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.863514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.863955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.865013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.865661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.866251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.888356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Getting quotas for project c5cff07e1dd54760babfcedffa37d81e. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:08.895817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Getting quotas for user 3167e5e9262a4ee3a0a629c9b3148c63 and project c5cff07e1dd54760babfcedffa37d81e. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:08.911713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:08.915341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:08.939726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:08.952112 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56797fec-9284-4e39-92ca-3ac752907e94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1205 microversion: 2.1 time: 0.130763 Oct 10 10:40:08.952698 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 358/781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:08 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1205 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:08.958894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:08.959538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:08.978319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.978931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.979407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:08.980119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:08.980570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:08.980996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.002698 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6f340871-b02f-420a-a41f-727c495257d1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.051476 Oct 10 10:40:09.003955 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 424/782] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:09.010922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:09.012066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:09.027311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.029176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.030049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.051128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.051703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.055072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.263259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:09.284256 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ea12180-4fa1-4ebe-b524-717d0c73d02e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1270 microversion: 2.1 time: 0.274666 Oct 10 10:40:09.288228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 425/783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:09 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1270 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:09.294590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366b075f-2d79-4500-904e-f42558454b83", "tag": "e23d90ff-faac-4edb-86f7-64ebc26f6f32"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:09.330655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.331200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.331643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.354686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] Creating event network-changed:e23d90ff-faac-4edb-86f7-64ebc26f6f32 for instance 366b075f-2d79-4500-904e-f42558454b83 on n-h1-860687-2 Oct 10 10:40:09.362906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9075dae9-04ac-4fbf-88ad-370bd4e6578a req-9795a369-7b1e-43b2-8051-df5e2130b044 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073406 Oct 10 10:40:09.364057 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 426/784] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:09.377129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e568024-a326-40c0-828d-9a028b2edc26 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:09.377906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e568024-a326-40c0-828d-9a028b2edc26 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:09.592419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6e568024-a326-40c0-828d-9a028b2edc26 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:09.601178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e568024-a326-40c0-828d-9a028b2edc26 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1225 microversion: 2.1 time: 0.235577 Oct 10 10:40:09.602192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 427/785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:09 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1225 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:09.637828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:09.649350 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0be7781b-55b2-4d3c-863f-efbd8dfbf526 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.695255 Oct 10 10:40:09.658352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 359/786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:08 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:09.728606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:09.729886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:09.739794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.740562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.741226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.742537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.743264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.744216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.849314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:09.849926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:09.868937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.869824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.871235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:09.873667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:09.874351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:09.875657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.225666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.236478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.240660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.261136 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b390853-adcd-41d1-bfae-91bb3dc502a7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.417127 Oct 10 10:40:10.261953 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 360/787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:09 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:40:10.267465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:10.268606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:10.290958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.291777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.292086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.292881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.293234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.293658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.608022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.622396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2afb834-2720-4004-b131-d85be3472db9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1261 microversion: 2.1 time: 0.359147 Oct 10 10:40:10.635779 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 361/788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:10 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1261 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:10.643455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:10.644263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:10.650389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.650879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.651399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.652173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.652637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.653050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.778081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.787575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cf3eafb-0579-4062-854c-8e9bb0e32523 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1276 microversion: 2.1 time: 0.150257 Oct 10 10:40:10.789393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 362/789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:10 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:10.794462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:10.795457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:10.815574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.817271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.817966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.820177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.821713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.822867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.823427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.823990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92f88408-fda8-44a2-a634-924e38e3b71d tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 1.101795 Oct 10 10:40:10.827395 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 428/790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:09 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:10.836064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:10.836959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:10.845582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.846270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.846702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.847459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:10.847911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:10.848327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:10.867432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:10.972320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:10.989480 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8382e762-43c6-45fe-9d1a-ad2fa9e5ac25 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1277 microversion: 2.1 time: 0.198773 Oct 10 10:40:11.007070 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 363/791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:10 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:11.175196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:11.185633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c711f776-7f01-4ac1-a5c1-3455b3a97437 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.354434 Oct 10 10:40:11.186422 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 429/792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:10 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:11.295151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:11.295994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:11.306191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.306845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.307401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.308191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.308660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.309144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.398406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:11.404014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3964a919-4685-4fac-8c44-a5d5913ff4d4", "tag": "e70a24d0-7675-4614-8dc6-cb04fb439e1e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:11.411770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:11.413212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:11.416358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.416847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.417589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.419956 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b37afc8d-3480-4c95-b07c-9b4e7365b3f6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.130125 Oct 10 10:40:11.420758 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 364/793] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:11 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:11.430142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] Creating event network-changed:e70a24d0-7675-4614-8dc6-cb04fb439e1e for instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 on n-h1-860687-2 Oct 10 10:40:11.442567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6ee0932a-1205-4282-a053-0e07154ed697 req-a1013c9a-d120-44a2-b90d-471f68c127ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047669 Oct 10 10:40:11.444031 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 430/794] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:11.659127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:11.660065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:11.679891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.680834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.682116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.684180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.685026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.686190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.806368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9df6cbb-e23c-4387-b4cc-26b529c75c94", "name": "network-vif-plugged", "status": "completed", "tag": "291d1e03-eb74-48db-bbe8-10251394865a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:11.822585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.823906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.824561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.837593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] Creating event network-vif-plugged:291d1e03-eb74-48db-bbe8-10251394865a for instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 on n-h2-860687-2 Oct 10 10:40:11.846429 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-96d01b54-a542-4acc-a7c1-25426d10c319 req-1f8b0956-a90b-493c-bb88-575fb19bf1be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044834 Oct 10 10:40:11.847481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 431/795] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:11.856423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:11.857404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:11.872857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.888348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.890033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:11.891811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:11.892586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:11.893413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.104504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.117541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e1d4679-8fd2-47e0-b4a8-593363a58b65 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1276 microversion: 2.1 time: 0.268728 Oct 10 10:40:12.118128 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 432/796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:11 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:12.126479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:12.127610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:12.140514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:12.156130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.158223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.159111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.160306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.160967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.161974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.227389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.241936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d2f026f-2d02-45d8-b419-691fe93a0678 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.599327 Oct 10 10:40:12.255670 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 365/797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:11 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:12.264138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:12.265035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:12.272053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.272812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.273409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.274269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.274900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.275815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.443277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.455678 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97a55549-4268-4861-a417-d36d93067688 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1277 microversion: 2.1 time: 0.198560 Oct 10 10:40:12.469294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 366/798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:12 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:12.482149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:12.483232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:12.491371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.492180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.493968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.494694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.495342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.495767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.613634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.626291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94e9889a-ad45-4480-8bfb-df20d941de53 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1388 microversion: 2.1 time: 0.504208 Oct 10 10:40:12.628740 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 433/799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:12 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1388 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:12.634718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:12.635649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:12.643196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.645425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.646136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.647265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:12.648108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:12.649979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:12.775092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.785177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.786740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.793045 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de4891b4-4b61-47d6-ae09-067d92adb2e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.162757 Oct 10 10:40:12.793620 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 434/800] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:12 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:12.952575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:12.961389 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e54d999d-5c34-47c8-b24c-f38b455ae282 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.487795 Oct 10 10:40:12.975022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 367/801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:12 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:13.146751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:13.147973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:13.162423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.162924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.163387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.167876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.168390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.168834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.270464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:13.271133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:13.285830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.286329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.286763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.287506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.287954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.288373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.710109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:13.719859 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5462663-5a23-4938-8441-0d7e51b75c82 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.579620 Oct 10 10:40:13.720533 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 435/802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:13 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:13.727265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9218b2cb-2af2-4d68-86b1-d7cbba73bcd8", "tag": "bcc7a67d-b86c-4a02-9596-f10432b8292b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:13.739099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.739699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.740249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.753755 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] Creating event network-changed:bcc7a67d-b86c-4a02-9596-f10432b8292b for instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 on n-h2-860687-2 Oct 10 10:40:13.759618 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-37a6a5a5-f054-4eab-87cb-9793e63245e1 req-e0966328-fad1-4991-a5ea-4925673ff64a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036239 Oct 10 10:40:13.760416 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 436/803] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:13.766074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:13.768310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:13.774671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.775813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.776258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.776986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.777437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.778255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.805662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:13.813953 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-520ee87b-369d-4c99-8a94-eddb1856ced4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.547383 Oct 10 10:40:13.814969 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 368/804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:13 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:13.820057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:13.820934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:13.828320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.829079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.829810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:13.831028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:13.831545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:13.831981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.291680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:14.315214 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c4a7328-e7b8-4133-88eb-15ba88e0097b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.553191 Oct 10 10:40:14.316554 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 437/805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:13 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:14.323213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:14.324729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:14.338452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.338947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.339404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.340420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.341094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.341735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.394651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:14.404854 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-727cda59-0922-4f09-9f97-5b0f763b6eaf tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1588 microversion: 2.1 time: 0.588595 Oct 10 10:40:14.405882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 369/806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:13 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1588 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:14.411914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:14.412807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:14.419440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.420218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.420860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.421793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.422561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.423382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.497187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:14.506201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:14.507689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:14.514286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0785a8fe-1e8e-479b-bd92-9af0d6627df8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.196362 Oct 10 10:40:14.515130 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 438/807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:14 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:14.526599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:14.527522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:14.535356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.536134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.536853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.537568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.538216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.538626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.700952 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-834501a4-9289-42e2-bb5b-6e38d18d64d8 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184412 Oct 10 10:40:14.701791 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 439/808] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:40:14 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:14.748641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:14.751774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:14.764508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.765379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.766305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:14.767750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:14.768443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:14.769331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.161415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:15.165613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:15.173224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-beb25236-6598-48ed-afe3-a287c614a63b tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.764974 Oct 10 10:40:15.190735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 370/809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:14 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:15.196597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:15.197212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:15.206025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.206025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.206335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.206912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.207608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.208034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.564248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:15.585935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c99f0237-3c01-4711-af51-3bc2a5290bde tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.842825 Oct 10 10:40:15.587078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 440/810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:14 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:15.593071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:15.593926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:15.606617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.607366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.607907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.608696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.609225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.609797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.828815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:15.838899 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5711086-23f3-443d-8f6b-603c9472f99a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.646999 Oct 10 10:40:15.839555 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 371/811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:15 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:15.844372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65535d9-6662-4ead-8fb5-95134fc5bf1d", "tag": "3b8f7d3d-01a4-4534-849c-81d3212451db"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:15.856192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.856683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.857117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.869929 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] Creating event network-changed:3b8f7d3d-01a4-4534-849c-81d3212451db for instance c65535d9-6662-4ead-8fb5-95134fc5bf1d on n-h2-860687-2 Oct 10 10:40:15.876254 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-89736427-3a4e-49fb-9986-87633e76b090 req-2961c7c1-d657-4e54-9f2c-4f5c16f04158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035505 Oct 10 10:40:15.876863 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 372/812] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:15.882203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:15.882891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:15.889218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.889716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.890157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:15.890861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:15.891393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:15.891829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.030418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:16.039914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:16.041816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:16.047169 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20f87368-d006-4c71-8682-1cf28e8769fb tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.168843 Oct 10 10:40:16.048158 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 373/813] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:15 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:16.053396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6baccc5e-d70d-418c-a077-26c0a75ad965", "tag": "3c194fa2-d41c-4d94-8401-b53f677b269a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:16.062595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.063115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.064161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.077224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] Creating event network-changed:3c194fa2-d41c-4d94-8401-b53f677b269a for instance 6baccc5e-d70d-418c-a077-26c0a75ad965 on n-h1-860687-2 Oct 10 10:40:16.083714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f20c34e9-71a1-4ce4-983e-49565da0f800 req-c37bb980-3ec4-4309-b6cd-12e0f3f58848 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034223 Oct 10 10:40:16.084312 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 374/814] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:16.154232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:16.165385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-711670e0-9c06-4ba4-9cd9-820cfd1ad15e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.576694 Oct 10 10:40:16.168473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 441/815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:15 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:16.197100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:16.197882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:16.205470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.205973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.206419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.207165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.207647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.208389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.221351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964a919-4685-4fac-8c44-a5d5913ff4d4", "name": "network-vif-plugged", "status": "completed", "tag": "e70a24d0-7675-4614-8dc6-cb04fb439e1e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:16.239705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.240121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.240558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.252250 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] Creating event network-vif-plugged:e70a24d0-7675-4614-8dc6-cb04fb439e1e for instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 on n-h1-860687-2 Oct 10 10:40:16.258609 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5b075385-15d9-4571-a0b7-ad1097c89bf0 req-b5721268-aab5-4a82-8f80-1a09b4b33cea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041375 Oct 10 10:40:16.259774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 442/816] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:16.611539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:16.612326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:16.618698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.619328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.620348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.621306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.621846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.622375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.701519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:16.714093 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1d01480-0e29-467f-a43c-a9e40016f1c4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.521691 Oct 10 10:40:16.727796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 375/817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:16 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:16.869962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:16.870582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:16.894000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.894563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.895018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:16.896851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:16.898256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:16.901229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.354677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.364101 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-625fdd75-7ffe-4438-bafc-2bb00bab2ae5 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.758015 Oct 10 10:40:17.364686 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 443/818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:16 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:17.369177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:17.369781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:17.386890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.387319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.387794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.388522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.388985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.389415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.433348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.441351 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b50e892-904f-43bf-b97c-027cf075861e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.581033 Oct 10 10:40:17.441920 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 376/819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:16 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:17.446423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:17.447047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:17.468521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.469014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.472134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.472606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.473071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.473503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.489387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.497835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.499311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.505078 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7941632d-16d9-450e-ab5e-49552e1c7791 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.139403 Oct 10 10:40:17.506154 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 444/820] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:17 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:17.701757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:17.713747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d755bd68-7ae0-40d6-b077-42291612d57f tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.270779 Oct 10 10:40:17.728287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 377/821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:17 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:17.737142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:17.738372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:17.741518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:17.742473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:17.745228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:17.745788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.746461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.747088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.747988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.748425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.748853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.756036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.756892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.757430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.758213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:17.758855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:17.759496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:17.942168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:18.029982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.040093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-318ba708-1035-4e1b-9f26-1d31eb1e2da5 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1588 microversion: 2.1 time: 0.307813 Oct 10 10:40:18.041266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 445/822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:17 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1588 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:18.042291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.046290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7750b9f4-8c81-4867-91cb-2da7669238cc", "tag": "e3236ca5-6f12-47b1-a597-c495d533c241"}, {"name": "network-changed", "server_uuid": "b9df6cbb-e23c-4387-b4cc-26b529c75c94", "tag": "291d1e03-eb74-48db-bbe8-10251394865a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:18.057954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.058841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.059483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.063967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31ad3c6f-ef83-431e-8bd5-0104f66aba16 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1318 microversion: 2.1 time: 0.328136 Oct 10 10:40:18.075480 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 378/823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:17 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:18.091773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Creating event network-changed:e3236ca5-6f12-47b1-a597-c495d533c241 for instance 7750b9f4-8c81-4867-91cb-2da7669238cc on n-h2-860687-2 Oct 10 10:40:18.092809 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] Creating event network-changed:291d1e03-eb74-48db-bbe8-10251394865a for instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 on n-h2-860687-2 Oct 10 10:40:18.100890 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-cc0acfd7-7b7e-40d1-add8-b449c4c7824a req-790330f3-d725-400e-9283-d04da4c9cac2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058283 Oct 10 10:40:18.101763 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 446/824] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:18.393162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:18.393784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:18.410568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.411211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.411523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.412368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.412825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.413538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.466050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:18.466862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:18.473844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.474637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.475099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.475808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.476264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.476882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.803276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.816647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.824355 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c480eda-b00b-4df2-b672-40228910d729 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.362482 Oct 10 10:40:18.839044 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-439c1130-2d10-4f08-9e7d-af7f553ef73e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.437865 Oct 10 10:40:18.839044 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 379/825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:18 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:18.839340 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 447/826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:18 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:18.847442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:18.847442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:18.848756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:18.849418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:18.855777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.856269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.856701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.857408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.857858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.858514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.858702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.859422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.859951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.860774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:18.861534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:18.862196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:18.879679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:18.957058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.965760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.967241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:18.973348 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eeb3d120-67f0-4d5c-8f45-2b7d02417105 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.144075 Oct 10 10:40:18.974125 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 380/827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:18 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:19.028551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:19.036748 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7ba781c-d43b-48f8-93cb-7738d7ecd1f6 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.205613 Oct 10 10:40:19.037450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 448/828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:18 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:19.088909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:19.089525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:19.096519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.097011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.097449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.098148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.098609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.099073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.229435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:19.237340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8ad786e-682b-4b00-9d4f-907b7041e4b4 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1468 microversion: 2.1 time: 0.152325 Oct 10 10:40:19.237903 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 381/829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:19 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:19.309209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-137818860", "block_migration": true, "disk_over_commit": false}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:19.311784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:19.318178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.318657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.319121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.319807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.320259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.320676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.344777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lazy-loading 'flavor' on Instance uuid 3964a919-4685-4fac-8c44-a5d5913ff4d4 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:19.347982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:19.356688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Going to try to live migrate instance to tempest-host-137818860 {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:40:19.363970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] HTTP exception thrown: Compute host tempest-host-137818860 could not be found. Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Request method failure captured: Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4/action HTTP/1.1 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 106 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Z9yyySlltv23Wfex60xihmjIgdJhaHCgmNVBEyyogCLOYDEj_1VnpjGaWwCoowGFXHY4Y-0hH4KWCD6n7jrF3LedL-rvIH3Fp_D2svwrRkk6puFgli6_utZtMgrCk1u8O5e2qx4vEe4vTavcj16KJQll-Y3UNNhVzezNZLYoHOJGg Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b015263c3d8f44f09392fe9ca7090ce7 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:40:19.367496 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b015263c3d8f44f09392fe9ca7090ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b015263c3d8f44f09392fe9ca7090ce7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b015263c3d8f44f09392fe9ca7090ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b015263c3d8f44f09392fe9ca7090ce7"}]}] Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b015263c3d8f44f09392fe9ca7090ce7 Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-LiveMigrationNegativeTest-461047669-project-admin Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 03454881be124aeb8ef8176828ab0c42 Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-LiveMigrationNegativeTest-461047669-project-admin Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: {"os-migrateLive": {"host": "tempest-host-137818860", "block_migration": true, "disk_over_commit": false}} Oct 10 10:40:19.369180 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: exception: Compute host tempest-host-137818860 could not be found. Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3964a919-4685-4fac-8c44-a5d5913ff4d4', 'body': {'os-migrateLive': {'host': 'tempest-host-137818860', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:19.370127 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-137818860 could not be found. Oct 10 10:40:19.371671 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-137818860 could not be found. Oct 10 10:40:19.373044 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-137818860 could not be found. Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Returning 400 to user: Compute host tempest-host-137818860 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f66f3da5-affb-44b9-9b7f-a97122931d6f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4/action" status: 400 len: 99 microversion: 2.1 time: 0.113174 Oct 10 10:40:19.374672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 449/830] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Oct 10 10:40:19 2022] POST /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4/action => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:40:19.378383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:19.379025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:19.384961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.385449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.385884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.386574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.387053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.387477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.519111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:19.527124 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-597c7a99-1df1-45de-a199-aa5141140c07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1468 microversion: 2.1 time: 0.153382 Oct 10 10:40:19.527682 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 382/831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:19 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:19.589469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-712603303", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:19.600359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=30 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:19.647543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:19.733025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9218b2cb-2af2-4d68-86b1-d7cbba73bcd8", "name": "network-vif-plugged", "status": "completed", "tag": "bcc7a67d-b86c-4a02-9596-f10432b8292b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:19.744761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.746055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.746489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.767367 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] Creating event network-vif-plugged:bcc7a67d-b86c-4a02-9596-f10432b8292b for instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 on n-h2-860687-2 Oct 10 10:40:19.772763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-532c4a47-e886-4f0a-9210-5a03a62a688c req-03c5f02e-6e9a-4098-ad78-352c4ac25c12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Oct 10 10:40:19.773399 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 383/832] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:19.848645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:19.849386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:19.856205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.856693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.857127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.857819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.858271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.858699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.963114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:19.963665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:19.964368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:19.964782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:19.965345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:19.975391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.975798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.976636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.977487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:19.978018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:19.978523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:19.997652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Getting quotas for project 98d14526bda544259e66185614b4881d. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:20.003885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Getting quotas for user 9298c75fa5004ebd8e871e446afaf5b8 and project 98d14526bda544259e66185614b4881d. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:20.017813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:20.020238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:20.071628 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-290dab6d-120b-42e1-bcd2-29d25d07c043 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486054 Oct 10 10:40:20.072865 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 450/833] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:20.077891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:20.080269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:20.087522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.088283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.088924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.089845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.090494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.091328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.208156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.218833 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1948887-d95f-4b60-9bf5-7449cb6b15ee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1309 microversion: 2.1 time: 0.374441 Oct 10 10:40:20.226080 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 384/834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:19 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:20.238056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:20.238691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:20.254021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.254482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.254922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.255651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.256138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.256513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.398335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.403297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.409954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fb7d2a3-9e1e-4a0b-92ca-98b6bcefb874 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.335774 Oct 10 10:40:20.411306 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 451/835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:20 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:20.417545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:20.418874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:20.426714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.427233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.427842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.428868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:20.429479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:20.429904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.430298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:20.431631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.437371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc53b4b2-d527-458e-8831-c3c2d5f5005b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.210271 Oct 10 10:40:20.437972 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 385/836] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:20 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:20.446786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31ce3668-ef3c-4bdf-967d-89bd40ba6f70 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:20.447454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31ce3668-ef3c-4bdf-967d-89bd40ba6f70 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:20.530990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31ce3668-ef3c-4bdf-967d-89bd40ba6f70 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.539729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31ce3668-ef3c-4bdf-967d-89bd40ba6f70 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1218 microversion: 2.1 time: 0.099354 Oct 10 10:40:20.551021 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 386/837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:20 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:20.607722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:20.616047 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f8f14e0a-d745-4ec6-a06b-3f05028d3398 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.202995 Oct 10 10:40:20.616626 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 452/838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:20 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:21.245970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:21.247071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:21.257883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.258380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.258960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.259850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.260468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.260887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.436744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:21.438067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:21.446399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.447135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.447755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.448669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.449240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.450134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.604059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:21.612616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01616cfa-7473-4d9b-89b9-8260a3c9e3f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1492 microversion: 2.1 time: 0.371377 Oct 10 10:40:21.619836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 387/839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:21 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1492 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:21.627777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:21.628788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:21.641665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.642566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.644591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.645814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.647344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.649381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.753908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:21.763132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ad119b8-0738-493c-a1ea-5a38eda09127 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.333048 Oct 10 10:40:21.764490 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 453/840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:21 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:21.779849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:21.780763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:21.798793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.799335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.799858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.801949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.803965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:21.804777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.805442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.814738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:21.816793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:21.822400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b08b7a6-f865-410b-b642-d3944a6c81e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.201082 Oct 10 10:40:21.823327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 388/841] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:21 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:21.827900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:21.828541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:21.836981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.837662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.838108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:21.838817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:21.839442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:21.839885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.220676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:22.229290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8c2c258-66e1-4589-a155-8a175b287233 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1276 microversion: 2.1 time: 0.463480 Oct 10 10:40:22.230179 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 454/842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:21 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1276 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:22.234574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:22.235552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:22.242594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.242982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.243537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.244321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.244854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.245351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.456542 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71bf8c70-d813-4f55-9f66-9b5e3512425f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1643 microversion: 2.1 time: 0.632123 Oct 10 10:40:22.461049 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 389/843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:21 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1643 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:22.470724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6baccc5e-d70d-418c-a077-26c0a75ad965", "name": "network-vif-plugged", "status": "completed", "tag": "3c194fa2-d41c-4d94-8401-b53f677b269a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:22.480590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.481260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.481853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.499441 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] Creating event network-vif-plugged:3c194fa2-d41c-4d94-8401-b53f677b269a for instance 6baccc5e-d70d-418c-a077-26c0a75ad965 on n-h1-860687-2 Oct 10 10:40:22.507844 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9b8f57fa-1a22-432b-9eb6-cfdfbf2c6cff req-e8026450-bf82-434c-9d8a-73b65a4deb10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043388 Oct 10 10:40:22.508981 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 390/844] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:22.515165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:22.517285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:22.551410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.552232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.561186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.564291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.564987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.565624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.572702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:22.617184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:22.627332 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d874519-93da-40d0-842f-67b4823e19eb tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.394663 Oct 10 10:40:22.630989 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 455/845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:22 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:22.786524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:22.787075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:22.793238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.793959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.794556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.795461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.796078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.796510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.819277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b87b184c-a01d-467a-9478-0978a4d08e34 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1643 microversion: 2.1 time: 0.308897 Oct 10 10:40:22.822794 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 391/846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:22 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1643 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:22.850981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:22.858908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.859664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.860996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.861945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.862700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.863311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.898993 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8cbf0ec9-55f0-4873-a769-5eafb6f5ced2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055084 Oct 10 10:40:22.909146 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 392/847] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:40:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:22.915827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:22.916654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:22.924017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.924809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.925411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.926283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.926893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.927525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.935180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:22.945807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b26ae86a-31ee-45b7-b3e8-745ab7f766a2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.163667 Oct 10 10:40:22.946933 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 456/848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:22 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:22.960250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:22.961189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:22.968218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.970200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.971103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:22.972363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:22.973083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:22.973739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.017542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:23.026797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:23.028302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:23.036443 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-beec4eb1-3e9e-4ae1-8e08-d854081df549 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.125940 Oct 10 10:40:23.052295 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 393/849] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:22 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:23.080168 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27ab8458-6c25-457d-a3c5-9147dbc131b0 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8/action" status: 202 len: 0 microversion: 2.1 time: 0.130641 Oct 10 10:40:23.083726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 457/850] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:40:22 2022] POST /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:40:23.100194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:23.101232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:23.109230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.109857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.110592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.111379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.111834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.112255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.246784 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25f69259-be8b-4f7c-9e6f-7319db5c1ba2 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1648 microversion: 2.1 time: 0.151366 Oct 10 10:40:23.247599 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 394/851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:23 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1648 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:23.254517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:23.255383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:23.261978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.262471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.262913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.263639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.264099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.264534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.324155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c7a354-feb2-4c38-9b59-968e0888fc42", "tag": "9f00c0e6-a033-48f0-8b6a-09b39ca84ad3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:23.335934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.336411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.337026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.349430 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] Creating event network-changed:9f00c0e6-a033-48f0-8b6a-09b39ca84ad3 for instance 88c7a354-feb2-4c38-9b59-968e0888fc42 on n-h1-860687-2 Oct 10 10:40:23.361000 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9d718439-8223-409b-a42c-216b3238208a req-41efa8a6-a7c7-456d-b97a-aa6cd4d7a281 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040460 Oct 10 10:40:23.361967 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 395/852] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:23.415571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:23.423952 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac833813-adb2-4b0a-b37b-a1ac5f8838ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.174401 Oct 10 10:40:23.424507 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 458/853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:23 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:23.654671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:23.655440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:23.662181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.662670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.663148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.663842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.664304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.664736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.795414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:23.803465 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd59d0d8-6456-43d5-8ced-70227699f885 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1350 microversion: 2.1 time: 0.152952 Oct 10 10:40:23.804050 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 396/854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:23 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:23.970207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:23.970817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:23.978311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.978805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.979262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:23.979967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:23.980422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:23.980847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.067954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:24.068616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:24.074597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.075114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.075558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.076343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.076806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.077231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.124562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.132537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6224019c-232b-4071-b5e7-df4d4217da06 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.166662 Oct 10 10:40:24.133110 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 459/855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:23 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:24.153658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.162208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.165481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.170322 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f1e49aa-196e-46e6-ab72-9ce2990df181 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.106288 Oct 10 10:40:24.170879 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 397/856] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:24 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:40:24.270124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:24.270735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:24.276773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.277254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.277685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.278371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.278854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.279302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.420354 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c20a495-38f1-4754-9c85-f870f50f390c tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1628 microversion: 2.1 time: 0.154457 Oct 10 10:40:24.420925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 460/857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:24 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1628 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:24.446992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:24.449808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:24.452037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:24.452651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:24.461401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:24.465042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.465586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.466017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.466721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.467218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.467883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.474832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.475656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.476447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.477465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.478200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.479368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.522903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lazy-loading 'flavor' on Instance uuid 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:24.539560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:40:24.635137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.644319 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2eb9b852-3dbd-4705-8c8f-d73e3fb459b8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.201450 Oct 10 10:40:24.645193 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 461/858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:24 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:24.650090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65535d9-6662-4ead-8fb5-95134fc5bf1d", "name": "network-vif-plugged", "status": "completed", "tag": "3b8f7d3d-01a4-4534-849c-81d3212451db"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:24.660925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.661493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.661998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.675936 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] Creating event network-vif-plugged:3b8f7d3d-01a4-4534-849c-81d3212451db for instance c65535d9-6662-4ead-8fb5-95134fc5bf1d on n-h2-860687-2 Oct 10 10:40:24.681959 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-377b4512-53b0-4f87-ad19-c235137607c4 req-c26d32ba-eff6-4c03-bcb2-25eebe00e18e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Oct 10 10:40:24.682823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 462/859] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:24.827118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:24.827820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:24.834162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.834842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.835488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.836192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:24.836648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:24.837072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:24.984417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:24.992653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-044552ec-2179-4865-9a8b-989ab2284417 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1540 microversion: 2.1 time: 0.169779 Oct 10 10:40:24.993225 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 463/860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:24 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1540 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:25.015799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:25.017379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:25.024417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.024938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.025377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.026075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.026535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.026967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.104389 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd6e6495-fd5d-48f2-bd2b-e817a4a8d0de tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092403 Oct 10 10:40:25.105002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 464/861] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:40:25 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:25.154865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:25.155436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:25.162113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.162604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.163078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.163778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.164235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.164661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.424785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:25.432479 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba4be19a-5a96-4df5-8cda-b8ee5d42fd1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.281626 Oct 10 10:40:25.433265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 465/862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:25 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:25.437530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:25.438139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:25.443884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.444369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.444805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.445673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.446309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.446734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.540955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:25.544513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:25.551508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:25.552956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:25.559222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-998ad9bd-b58e-4fc2-9cf3-8891756537e9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.125166 Oct 10 10:40:25.559808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 466/863] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:25 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:25.670235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:25.670867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:25.677627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.678119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.678559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.679287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:25.679752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:25.680218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:25.910605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:25.919357 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5bf651be-104c-4a13-b639-11a854b6ab79 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.254583 Oct 10 10:40:25.920759 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 467/864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:25 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:26.232233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6baccc5e-d70d-418c-a077-26c0a75ad965", "tag": "3c194fa2-d41c-4d94-8401-b53f677b269a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:26.244209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.245014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.245631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.258075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] Creating event network-changed:3c194fa2-d41c-4d94-8401-b53f677b269a for instance 6baccc5e-d70d-418c-a077-26c0a75ad965 on n-h1-860687-2 Oct 10 10:40:26.264135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fdd519da-e379-4250-89c9-7e457367ccb6 req-93626e6b-1c7d-4257-aed2-246236f9d21d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034992 Oct 10 10:40:26.265320 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 468/865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:26.354867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8dd51f34-c6d6-4094-8f96-3df269d16c83 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8/action" status: 202 len: 0 microversion: 2.1 time: 1.915359 Oct 10 10:40:26.358767 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 398/866] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:40:24 2022] POST /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8/action => generated 0 bytes in 1917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:40:26.365309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:26.366182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:26.372888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.373624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.374685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.375713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.376320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.376896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.456567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:26.457251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:26.465337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.465824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.466265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.466966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.467717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.468116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.895743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:26.907180 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe16b247-bd0e-49f0-8476-5066f73f4cee tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.545846 Oct 10 10:40:26.922925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 469/867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:26 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:26.928270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:26.929200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:26.935310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.936075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.936581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.937510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:26.938842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:26.939502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:26.990027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:26.997862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b827cfc-248f-442e-bec2-5af9b014da74 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.545729 Oct 10 10:40:26.998851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 399/868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:26 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:27.003793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750b9f4-8c81-4867-91cb-2da7669238cc", "name": "network-vif-plugged", "status": "completed", "tag": "e3236ca5-6f12-47b1-a597-c495d533c241"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:27.015339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:27.016091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:27.016479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:27.027227 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] Creating event network-vif-plugged:e3236ca5-6f12-47b1-a597-c495d533c241 for instance 7750b9f4-8c81-4867-91cb-2da7669238cc on n-h2-860687-2 Oct 10 10:40:27.032718 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-39ff2021-d547-4330-8d59-dab94402a27e req-8a30ca4d-8ab0-4fdd-a424-1a723d29cb10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032451 Oct 10 10:40:27.033383 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 400/869] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:27.039942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:27.040877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:27.043638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:27.049239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:27.049983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:27.051107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:27.052066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:27.052737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:27.053390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:27.058456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:27.060277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:27.070526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6477cb7e-637b-4e26-8205-d625b307abb5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.146043 Oct 10 10:40:27.082816 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 470/870] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:26 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:27.340077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:27.348707 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-578efd5c-c6ec-4c69-bdd6-cbc607ecf061 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.314006 Oct 10 10:40:27.349370 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 401/871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:27 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:27.929703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:27.930346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:27.932873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:27.938593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:27.939184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:27.939685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:27.940373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:27.940821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:27.941238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.020957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:28.021578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:28.028433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.028927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.029368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.030070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.030531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.030962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.182852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.193738 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e3a3103-94dd-4f3d-9364-999025b26aec tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.267772 Oct 10 10:40:28.195289 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 471/872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:27 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:28.216772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:28.217726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:28.225184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.225771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.226722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.227546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.228158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.228879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.299883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.311633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f2b8ae9-592e-442d-80d6-0f9f65f23365 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1318 microversion: 2.1 time: 0.294327 Oct 10 10:40:28.312993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 402/873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:28 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:28.319797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9218b2cb-2af2-4d68-86b1-d7cbba73bcd8", "name": "network-vif-unplugged", "status": "completed", "tag": "bcc7a67d-b86c-4a02-9596-f10432b8292b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:28.338307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.343458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.344729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.345429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.350741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.352738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.363241 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] Creating event network-vif-unplugged:bcc7a67d-b86c-4a02-9596-f10432b8292b for instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 on n-h2-860687-2 Oct 10 10:40:28.364488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-961728d4-daff-4a0a-a492-e121ca0c76ad tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1558 microversion: 2.91 time: 0.155529 Oct 10 10:40:28.393690 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 472/874] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:28 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:28.395086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-daa42985-42cc-48da-817d-bcd9a2bb4ad0 req-1d3a2f05-3ef9-4806-80e3-07a97ecf5b4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080481 Oct 10 10:40:28.397754 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 403/875] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:28.398736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:28.399390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:28.412992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.413492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.414046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.414638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:28.415133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:28.415565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:28.613849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:28.623451 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2d4e023-ccac-4e65-aa18-6f59517210a8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.228137 Oct 10 10:40:28.635039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 473/876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:28 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:29.222500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.223269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:29.229378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.229867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.230300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.230989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.231470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.231900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.339370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.340022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:29.347617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.348111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.348581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.349312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.349766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.350194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.370146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.378714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e501ca6f-d4ce-4a1a-8e2b-fbb943523b24 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.162062 Oct 10 10:40:29.382992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 404/877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:29.399724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.400448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:29.407610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.408134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.408716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.409704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.410302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.410736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.485997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.494130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.495605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.500809 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7dc90aef-88dd-463d-aa47-6d564ad6d101 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.105336 Oct 10 10:40:29.501700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 405/878] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:29.519524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.527726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-efc64499-1ae9-42c1-a651-8cc961336ee2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1468 microversion: 2.1 time: 0.193328 Oct 10 10:40:29.528289 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 474/879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1468 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:29.550931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.551643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:29.557474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.558284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.558830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.559774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.560244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.560682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.649450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.650151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:29.657702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.657980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.658854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.659723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.660266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.660763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.717045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.726190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f94a0585-8b1a-4aee-9616-327e6aaec7bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 200 len: 1468 microversion: 2.1 time: 0.179727 Oct 10 10:40:29.726755 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 406/880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 1468 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:29.748706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:29.755279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.756183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Searching by: {'reservation_id': 'r-nyfple4g', 'deleted': False, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:40:29.761908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.762517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.763107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.763990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:29.764652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:29.764979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:29.810048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:29.821188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-477a8adb-e52d-49c1-92f3-bf8efc03d468 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.175262 Oct 10 10:40:29.822137 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 475/881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:29.930771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:40:30.013007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:30.021775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.023500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.024055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.027554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:30.061409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.062213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.068209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:30.079952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:30.082577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.083246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.083942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.084855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.085543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.086273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.237714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e6d4818-4d71-40fe-aba1-c0c14add000a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-nyfple4g" status: 200 len: 2929 microversion: 2.1 time: 0.492752 Oct 10 10:40:30.255476 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 407/882] 10.222.0.16 () {58 vars in 1197 bytes} [Mon Oct 10 10:40:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-nyfple4g => generated 2929 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:30.269641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.298082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_groups [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Querying cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) for 2 instances {{(pid=128801) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 10:40:30.298813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.299328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.299767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.337761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb4384f6-4291-405e-95b4-055170aa75d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/c7d0c00f-94fa-4b38-9c6d-284504018129" status: 200 len: 265 microversion: 2.1 time: 0.072034 Oct 10 10:40:30.344897 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 408/883] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/os-server-groups/c7d0c00f-94fa-4b38-9c6d-284504018129 => generated 265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:30.349659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:30.350614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.351336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.359296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.360216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.360624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.361470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.361784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.364653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.384457 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5dc5f02a-afe1-4698-9cfc-ae29dfb4603e tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 2346 microversion: 2.25 time: 0.326774 Oct 10 10:40:30.386902 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 476/884] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 2346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:40:30.394531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7a354-feb2-4c38-9b59-968e0888fc42", "name": "network-vif-plugged", "status": "completed", "tag": "9f00c0e6-a033-48f0-8b6a-09b39ca84ad3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:30.422467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.422467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.427402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.440139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] Creating event network-vif-plugged:9f00c0e6-a033-48f0-8b6a-09b39ca84ad3 for instance 88c7a354-feb2-4c38-9b59-968e0888fc42 on n-h1-860687-2 Oct 10 10:40:30.448197 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-800c4c7b-7f9c-4319-a776-082ec911e17d req-613b479c-9fbb-4318-b597-5687aab556ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057734 Oct 10 10:40:30.449339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 477/885] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:30.456064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.457155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.465653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.466385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.467184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.469588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.470269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.470919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.655976 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66f7ce25-02d7-49f0-a294-06615434831a tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1619 microversion: 2.1 time: 0.309177 Oct 10 10:40:30.657611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 409/886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1619 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:30.662782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9218b2cb-2af2-4d68-86b1-d7cbba73bcd8", "tag": "bcc7a67d-b86c-4a02-9596-f10432b8292b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:30.673919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.675077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.675721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.689170 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] Creating event network-changed:bcc7a67d-b86c-4a02-9596-f10432b8292b for instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 on n-h2-860687-2 Oct 10 10:40:30.697568 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5a31ef67-befa-42ad-928b-7b1b4e421eba req-842b6e4b-f266-4c22-8d5a-c2486df9de34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038441 Oct 10 10:40:30.698467 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 410/887] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:30.705006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.709496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.710808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.711434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.712402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.712874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.713297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.738929 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9a891ae-7a51-4ed9-a706-10fee8d916fa tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038312 Oct 10 10:40:30.740100 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 411/888] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:40:30.745574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.746578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.757182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.758306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.759034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.760654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.761430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.762207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.780793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:30.789488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d995beba-5c76-4c22-9ff8-ac2f4220b6e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.338669 Oct 10 10:40:30.803404 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 478/889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:30.811512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.812420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.818940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.819607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.820217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.823791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.824422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.825006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.891821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:30.902845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:30.906976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:30.922389 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-caced007-629f-4c52-a893-30acb2e19c53 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.180869 Oct 10 10:40:30.935700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 412/890] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:30.952883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:30.954353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:30.960605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.961041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.961487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:30.962194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:30.962657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:30.963152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:31.186112 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b3c2ffc6-0e17-4145-937f-1aaae314a52e tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 200 len: 1619 microversion: 2.1 time: 0.381303 Oct 10 10:40:31.187251 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 479/891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 1619 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:31.223881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: .version_select at 0x7f677cdc6040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-656828622", "policies": ["anti-affinity"]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:31.253407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:31.259076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:31.308378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:31.330921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0231d853-e275-4d8c-9f62-f64c87364824 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.393698 Oct 10 10:40:31.331825 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 413/892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:30 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:31.346181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:31.354225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:31.382312 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d8323b5-4205-430e-819f-a93ea3ec8d2f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.163086 Oct 10 10:40:31.383586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 480/893] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Oct 10 10:40:31 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:31.467268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1028208960", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ca7703af-1dda-48fc-9a89-f1feb9b1c7ee"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:31.557155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:31.820110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:31.820916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:31.829015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:31.832447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:31.833496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:31.834339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:31.835449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:31.839444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:31.962546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:31.963443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:31.964323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:31.965124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:31.965825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:31.985158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:31.986022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:31.986686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:31.987817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:31.988419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:31.988990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.009920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:32.016868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:32.124086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:32.134809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:32.142734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.185129 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e07e9eb-a53b-4475-8b4c-06e602fe4145 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.370043 Oct 10 10:40:32.186043 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 481/894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:31 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:32.191514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:32.192126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:32.213108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.213644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.214090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.214810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.215307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.215728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.247982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128801) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 10:40:32.303632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:32.310455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:32.338169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.355218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.356892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.374046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0be60a2-3b2c-49da-add4-f474cac4a19f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.184425 Oct 10 10:40:32.375623 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 482/895] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:32 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:32.406970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:32.407755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:32.414850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:32.428504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.429164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.429610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.430529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.432303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.433420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:32.436493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.472467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=c7bb3c83-3665-47bd-b4d6-d95b46bf417c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:32.597349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:32.603488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:32.616069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:32.663098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:32.674406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:32.705459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.713288 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a962facd-b2d7-4364-a0f7-7acff8d0c434 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1318 microversion: 2.1 time: 0.336457 Oct 10 10:40:32.714684 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 483/896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:32 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:32.735349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b81e97f-a153-4c17-9571-fa5fb5235343 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.271311 Oct 10 10:40:32.738881 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 414/897] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:40:32.748943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:32.755327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:32.756500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Searching by: {'deleted': False, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:40:32.778883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.779665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.780335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.781794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:32.782645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:32.783285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:32.907751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:40:33.029622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-723409db-3235-4936-9fe0-d6ae1f1daf2d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.289092 Oct 10 10:40:33.030512 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 484/898] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:40:32 2022] GET /compute/v2.1/servers => generated 1664 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:33.043270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04f1c836-9718-4541-89f7-b89b2b9c4b5f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:33.043986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04f1c836-9718-4541-89f7-b89b2b9c4b5f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:33.109970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04f1c836-9718-4541-89f7-b89b2b9c4b5f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:33.118711 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04f1c836-9718-4541-89f7-b89b2b9c4b5f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1219 microversion: 2.1 time: 0.079318 Oct 10 10:40:33.119851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 415/899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:33 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:33.211103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:33.212178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:33.221428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.222346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.222960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:33.223860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.224657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.225400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:33.256857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:33.408465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:33.409252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:33.434185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.438098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.438771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:33.440133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.440567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.440998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:33.512633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:33.521530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72776b84-c9c5-4daf-b616-b7192464c462 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.315413 Oct 10 10:40:33.543560 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 485/900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:33 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:33.663191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:33.673120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:33.683948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:33.695677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88ba2c05-9a70-46fd-af0a-9574a426c042 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.286940 Oct 10 10:40:33.696942 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 416/901] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:33 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:33.745372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:33.754581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:33.770207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.771148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.774706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:33.776589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:33.778171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:33.786826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.145890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:34.149741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.172048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.175805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.179310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.180343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.181030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.181706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.252261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.269302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-438d04ee-8efb-460f-8707-5adfca20b2d9 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1467 microversion: 2.1 time: 0.524675 Oct 10 10:40:34.287939 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 486/902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:33 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1467 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:34.297470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.299694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:34.300427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.306692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c184142a-d0b1-4825-8775-cc1224c4200d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1215 microversion: 2.1 time: 0.166611 Oct 10 10:40:34.307548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 417/903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:34 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:34.310258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.310920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.312233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.314332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.315083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.315541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.352925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lazy-loading 'flavor' on Instance uuid 88c7a354-feb2-4c38-9b59-968e0888fc42 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:34.535451 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5b2c27e-c6bb-4341-bad7-63763550d944 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42/action" status: 202 len: 0 microversion: 2.1 time: 0.221335 Oct 10 10:40:34.540378 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 487/904] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:40:34 2022] POST /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:40:34.545224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:34.545813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.554897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.555423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.555860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.556553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.557041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.557446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.558248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:34.559271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.569726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.570225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.570792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.571847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.572023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.573278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.798940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.812490 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8074831e-4144-4d3e-b103-ec1e498a64da tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1475 microversion: 2.1 time: 0.271198 Oct 10 10:40:34.813633 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 418/905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:34 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:34.818676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:34.819302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.824990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.825467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.825895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.826758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.827276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.827682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.837785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.851380 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d3f622e-cec8-4ab1-9cd1-68cb96537e2f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.299177 Oct 10 10:40:34.853842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 488/906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:34 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:34.925460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.934459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.935932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:34.941781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a54e815e-d99d-4877-a743-38b84e486df4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.126966 Oct 10 10:40:34.942663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 419/907] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:34 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:34.982643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa463e7f-1c9b-4183-82f5-c6aaf7143c48", "device": "/dev/xvdb"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:34.988115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:34.994376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.995128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.995925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:34.996941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:34.997547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:34.998120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.333588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:35.334209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:35.340611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.341096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.341533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.342226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.342935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.343381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.563038 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a21bc0b4-447a-4af2-a199-7d3736534b9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.585899 Oct 10 10:40:35.565069 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 489/908] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 10 10:40:34 2022] POST /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:40:35.835453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:35.840544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:35.841549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:35.852552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24546127-aa54-46c7-a2c2-64b03bfd1867 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1271 microversion: 2.1 time: 0.522948 Oct 10 10:40:35.853145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 420/909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:35 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1271 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:35.855825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.858070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.858672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.860971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.862464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.864062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.878772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:35.880681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:35.896038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.898916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.900798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:35.901802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:35.902636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:35.909304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:36.460567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:36.469177 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecae2c2a-0c39-4ed4-9d8a-9686f0d53654 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.594495 Oct 10 10:40:36.472464 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 421/910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:35 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:36.478881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:36.483915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:36.501667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:36.502657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:36.503432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:36.505601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:36.506327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:36.509573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:36.515992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:36.524208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a59bb44e-f05b-4856-9de5-7bc2696abf07 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1458 microversion: 2.1 time: 0.688828 Oct 10 10:40:36.533219 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 490/911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:35 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1458 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:36.561590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:36.562779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:36.581264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:36.583597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:36.584279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:36.587068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:36.587777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:36.589024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:37.275950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:37.285525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:37.302721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:37.317291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26d5c2c6-21f6-43a2-85af-635890edcb80 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.842066 Oct 10 10:40:37.320103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 422/912] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:36 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:37.335411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:37.336384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:37.348752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:37.349404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:37.349939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:37.350752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:37.351972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:37.352500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:37.947094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:37.956519 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b3c12df-f4b0-4c55-ab52-54c11f79e4d2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.634442 Oct 10 10:40:37.961204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 423/913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:37 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:37.975943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:37.979406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:37.993438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:37.995255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:37.995928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.000572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.003500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.004384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.211985 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ce3d5c7-e490-4749-9bf6-da2ddcaa456f tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1609 microversion: 2.1 time: 1.653098 Oct 10 10:40:38.217950 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 491/914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:36 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1609 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:38.250452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d00218-083c-4ad6-9546-b3e85513114b", "tag": "e7ba385a-ad60-4b02-8c47-682dadb5f95b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:38.308337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.310536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.315653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.367807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] Creating event network-changed:e7ba385a-ad60-4b02-8c47-682dadb5f95b for instance f7d00218-083c-4ad6-9546-b3e85513114b on n-h1-860687-2 Oct 10 10:40:38.377440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-31d4f705-7ada-4b24-8272-7cb5c0860aad req-532bcb01-e72a-4f23-98eb-3122083a67a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157691 Oct 10 10:40:38.380266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 492/915] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:38.418249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:38.440180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.441075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.442359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:38.444296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.446383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.446971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.449816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.456093 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecafb36c-8a8d-44ab-a347-9eb66ac34f96 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1502 microversion: 2.1 time: 0.493210 Oct 10 10:40:38.471422 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 424/916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:37 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1502 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:38.486985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:38.487817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:38.499093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.502231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.502860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.503798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.507612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.508281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.544463 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-403316dd-9822-42e6-923b-91f6c5cd7ae8 tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.160677 Oct 10 10:40:38.557135 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 493/917] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:40:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:38.567108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:38.582108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:38.612670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.614829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.617707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.618504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.618979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.621770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.724463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Lazy-loading 'flavor' on Instance uuid 88c7a354-feb2-4c38-9b59-968e0888fc42 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:38.743491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 88c7a354-feb2-4c38-9b59-968e0888fc42 while it is in vm_state suspended Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Request method failure captured: Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42/action HTTP/1.1 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 97 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_Z9yyySlltv23Wfex60xihmjIgdJhaHCgmNVBEyyogCLOYDEj_1VnpjGaWwCoowGFXHY4Y-0hH4KWCD6n7jrF3LedL-rvIH3Fp_D2svwrRkk6puFgli6_utZtMgrCk1u8O5e2qx4vEe4vTavcj16KJQll-Y3UNNhVzezNZLYoHOJGg Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b015263c3d8f44f09392fe9ca7090ce7 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:40:38.745408 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b015263c3d8f44f09392fe9ca7090ce7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b015263c3d8f44f09392fe9ca7090ce7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b015263c3d8f44f09392fe9ca7090ce7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b015263c3d8f44f09392fe9ca7090ce7"}]}] Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b015263c3d8f44f09392fe9ca7090ce7 Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-461047669 Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-LiveMigrationNegativeTest-461047669-project-admin Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 03454881be124aeb8ef8176828ab0c42 Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-LiveMigrationNegativeTest-461047669-project-admin Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: {"os-migrateLive": {"host": "n-h2-860687-2", "block_migration": true, "disk_over_commit": false}} Oct 10 10:40:38.746854 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'os-migrateLive' instance 88c7a354-feb2-4c38-9b59-968e0888fc42 while it is in vm_state suspended Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '88c7a354-feb2-4c38-9b59-968e0888fc42', 'body': {'os-migrateLive': {'host': 'n-h2-860687-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 10:40:38.747650 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:38.748856 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 88c7a354-feb2-4c38-9b59-968e0888fc42 while it is in vm_state suspended Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 88c7a354-feb2-4c38-9b59-968e0888fc42 while it is in vm_state suspended Oct 10 10:40:38.750405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:40:38.754874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 88c7a354-feb2-4c38-9b59-968e0888fc42 while it is in vm_state suspended {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:40:38.754874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-35d83191-da36-4b8e-944a-8ff3a76cb7fd tempest-LiveMigrationNegativeTest-461047669 tempest-LiveMigrationNegativeTest-461047669-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42/action" status: 409 len: 155 microversion: 2.1 time: 0.188660 Oct 10 10:40:38.754874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 494/918] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:40:38 2022] POST /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42/action => generated 155 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:40:38.764814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:38.766563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:38.776488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.777345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.778025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.779755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:38.780460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:38.781180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:38.859532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:40:38.908228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:38.928087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:38.930500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:38.942841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a55b6074-948c-4bf4-96a4-bdb815f33588 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.469970 Oct 10 10:40:38.944300 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 425/919] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:38 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:38.986725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:38.987754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:39.002557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.003557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.004632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.006500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.008919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.010607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.087612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e96839f-f1e3-4098-a219-40558748e4c8 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 204 len: 0 microversion: 2.1 time: 0.333378 Oct 10 10:40:39.088760 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 495/920] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:40:38 2022] DELETE /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:40:39.100960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:39.101902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:39.110239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.110874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.111456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.112282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.113246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.115183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.520484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:39.534208 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-294f51e9-3642-4a23-80d2-03a985f2b3ce tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.552119 Oct 10 10:40:39.535202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 426/921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:38 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:39.569335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:39.570426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:39.584645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.585844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.586527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.587907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:39.590401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:39.591099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:39.742907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:39.754057 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c923da71-78ee-4233-bf36-261ea8f37e80 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1464 microversion: 2.1 time: 0.660654 Oct 10 10:40:39.767028 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 496/922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:39 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1464 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:39.947304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:39.950655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:39.960064 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e30ab00a-dbf6-4aed-9af9-ed0fba1a4f5a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1477 microversion: 2.1 time: 0.423568 Oct 10 10:40:39.963207 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 427/923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:39 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1477 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:39.977169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:39.977777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:39.989532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49b1fed2-04e2-473c-b7b2-1861ac9cac6e tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '.version_select at 0x7f677d25eb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:40.010109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.011083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.013622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b1fed2-04e2-473c-b7b2-1861ac9cac6e tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.017398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.019192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b1fed2-04e2-473c-b7b2-1861ac9cac6e tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.022454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b1fed2-04e2-473c-b7b2-1861ac9cac6e tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.022777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.026195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.030101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.069901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49b1fed2-04e2-473c-b7b2-1861ac9cac6e tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.087550 Oct 10 10:40:40.079360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 428/924] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:40:39 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:40.095931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:40.097455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:40.113943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.117317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.117772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.122578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.123209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.124453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.346860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:40.372706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:40.378631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:40.390971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a539b0b8-652f-4f16-aeb9-62b7e5e3e409 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.417495 Oct 10 10:40:40.393335 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 497/925] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:39 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:40.574444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:40.574960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:40.594417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.594926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.595388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.596405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.597010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.597652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.641674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:40.794358 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8121b8ae-3b03-40f5-8f9f-06428b608f5f tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1628 microversion: 2.1 time: 0.704915 Oct 10 10:40:40.795668 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 429/926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:40 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1628 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:40.825614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:40.826427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:40.835205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.835850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.836629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.837779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:40.838505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:40.839392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:40.973072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:40.981926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f9e2f6b-471f-41a2-baf7-19ae8dcb2496 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.411181 Oct 10 10:40:40.982745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 498/927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:40 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:40.995738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e321e15-82c4-4d94-aaed-627ed0b82192 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: .version_select at 0x7f677cbb8ca0>, body: {"keypair": {"name": "tempest-keypair-489638281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTlv8KWNcu/RwtN6ce+lKbPIX901fiUxkF04a/17I2Hyh+fWeWlPJbib3gfLUyk7vtY8cu3ZIQTiAfwJQUAjdz7rVedGWkReUXOTxfZQk5mUF3xM9dTBmV9yRRFohkfxg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:41.023955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8e321e15-82c4-4d94-aaed-627ed0b82192 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for project 37e58734bc744586bda489a8e2edd009. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:41.029112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:41.030297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8e321e15-82c4-4d94-aaed-627ed0b82192 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for user d2bfae2396ee410c964701fd5d77615e and project 37e58734bc744586bda489a8e2edd009. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:41.068100 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e321e15-82c4-4d94-aaed-627ed0b82192 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075894 Oct 10 10:40:41.068758 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 499/928] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:40:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:41.168287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bb3c83-3665-47bd-b4d6-d95b46bf417c", "tag": "fad5a651-a636-4bf2-8717-d8b75d5bcf2a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:41.192928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:41.194612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:41.195078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:41.213338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] Creating event network-changed:fad5a651-a636-4bf2-8717-d8b75d5bcf2a for instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c on n-h2-860687-2 Oct 10 10:40:41.233379 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a97e6385-2aa2-47dd-8c12-8b518773c109 req-3e943ddf-c526-4713-a5b4-ef39f5dc8c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075718 Oct 10 10:40:41.238952 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 500/929] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:41.314040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:41.327531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34ebf705-a0e1-4dc5-ab5f-0888013a3aca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1464 microversion: 2.1 time: 0.517341 Oct 10 10:40:41.329354 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 430/930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:40 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1464 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:41.428833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:41.429655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:41.447340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:41.447865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:41.449481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:41.451952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:41.452468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:41.459741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:41.621768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:41.630883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:41.633063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:41.662508 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2fc32db9-d300-44a5-82cc-4272901a23c0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.240657 Oct 10 10:40:41.663152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 501/931] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:41 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:42.007186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:42.007980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:42.020046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:42.024114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:42.024902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:42.026234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:42.027808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:42.029184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:42.029919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:42.352326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:42.353511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:42.370624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:42.371392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:42.372016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:42.372896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:42.373498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:42.374072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.114872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:43.292783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:43.297529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:43.303486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0156bb7a-416c-4b37-a38c-c1232b367505 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 1.300773 Oct 10 10:40:43.322983 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5eb456da-9c99-4763-9cb3-933abff2c2ca tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1464 microversion: 2.1 time: 0.974362 Oct 10 10:40:43.323455 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 431/932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:42 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:43.324051 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 502/933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:42 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1464 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:43.332649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75de287a-62e4-4d2b-b6bf-16717512843c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:43.340965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:43.345071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:43.345907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:43.352504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:43.353292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:43.353907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.355568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:43.356212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:43.356797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.373038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:43.373611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:43.374040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.377393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:43.377878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:43.378312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.670902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:43.683913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:43.689022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:43.701419 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90c4e9c3-c784-46db-b27a-5e0e9657d261 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.360985 Oct 10 10:40:43.731335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 432/934] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:43 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:43.738826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c7a354-feb2-4c38-9b59-968e0888fc42", "name": "network-vif-deleted", "tag": "9f00c0e6-a033-48f0-8b6a-09b39ca84ad3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:43.759032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:43.774623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:43.775503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:43.810738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] Creating event network-vif-deleted:9f00c0e6-a033-48f0-8b6a-09b39ca84ad3 for instance 88c7a354-feb2-4c38-9b59-968e0888fc42 on n-h1-860687-2 Oct 10 10:40:43.826224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b6494689-c775-4862-9d54-38a2073fa330 req-38572fc7-d9c0-4e12-87b6-5c6a01486fa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093301 Oct 10 10:40:43.837732 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 433/935] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:43.948751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-214407ad-a7c3-42fb-9110-258b7d73c4fe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "POST /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623204 Oct 10 10:40:43.958377 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 503/936] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:40:43 2022] POST /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:44.332013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:44.332717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:44.348364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:44.349063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:44.360650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.366894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.367427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.367872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.368480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.368614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.368943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.369075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.369444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.369685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.370149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.370577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.449534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.451527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.452410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.453456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lazy-loading 'fault' on Instance uuid 88c7a354-feb2-4c38-9b59-968e0888fc42 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:44.638417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:44.648603 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f206ccb3-52cf-4ee0-83e9-d4f3676006e2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 200 len: 1308 microversion: 2.1 time: 0.305454 Oct 10 10:40:44.675040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 504/937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:44 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:44.733413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:44.734062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:44.749619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.750260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.750743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.751666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:44.752133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:44.752581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:44.936242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:44.949960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:44.953813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:44.974060 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59274a87-d8c0-4b83-a4cc-212cf386e8b8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.244372 Oct 10 10:40:44.974958 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 505/938] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:44 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:45.033496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:45.041764 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0111635-ffa4-4dec-9833-a6dda6f310bb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.715565 Oct 10 10:40:45.048056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 434/939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:44 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:45.636858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2053966877", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cad63d61-412d-4d6c-9849-4c933c49b65e"}], "security_groups": [{"name": "tempest-securitygroup--1013434034"}], "key_name": "tempest-keypair-489638281", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:45.686662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:45.688763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 88c7a354-feb2-4c38-9b59-968e0888fc42] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:45.706454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:45.707651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:45.708547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:45.709494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:45.709965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:45.710542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:45.729854 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] HTTP exception thrown: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Request method failure captured: Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 HTTP/1.1 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Z8j0xz5VPIPlQ5l3Mc92r8iQj_06sEWRtuMN7zC2KOFgS4fL1MSlESIauoB9EHeID3t0N-Hu0Z4QG3w51ys_XLyQRgfD7y8w6QEgnzjCIE71fjqlRjR3sS3bOgQzlzEgj96yyzNELmBuXIerhMCX996QwwwJ0UFDvlAAiIAOfgoJ4 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98d14526bda544259e66185614b4881d Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:40:45.732726 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d14526bda544259e66185614b4881d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d14526bda544259e66185614b4881d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d14526bda544259e66185614b4881d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d14526bda544259e66185614b4881d"}]}] Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98d14526bda544259e66185614b4881d Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationNegativeTest-260394991-project Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9298c75fa5004ebd8e871e446afaf5b8 Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationNegativeTest-260394991-project Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. Oct 10 10:40:45.734757 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '88c7a354-feb2-4c38-9b59-968e0888fc42'} Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:40:45.735820 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. Oct 10 10:40:45.738106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:45.741983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Returning 404 to user: Instance 88c7a354-feb2-4c38-9b59-968e0888fc42 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:40:45.743125 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a0d0f2d-98fc-4bbd-8f43-0816bcb597bb tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42" status: 404 len: 111 microversion: 2.1 time: 0.061205 Oct 10 10:40:45.747180 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 435/940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:45 2022] GET /compute/v2.1/servers/88c7a354-feb2-4c38-9b59-968e0888fc42 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:40:45.754049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:45.754936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:45.763303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:45.764238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:45.764884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:45.766447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:45.767150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:45.767774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:45.799960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] validate_networks() for [('cad63d61-412d-4d6c-9849-4c933c49b65e', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:45.800549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:40:45.976839 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-180f8138-e671-4908-8369-77b5f0ce8f0f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 204 len: 0 microversion: 2.1 time: 0.227923 Oct 10 10:40:45.980845 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 436/941] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:40:45 2022] DELETE /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:40:46.001735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:46.004697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:46.031088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.033485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.034175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.041098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.041886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.042557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.611893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:46.623311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3b8bb8f-b2f8-4b1c-83ca-44ceac572d3f tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1474 microversion: 2.1 time: 0.640883 Oct 10 10:40:46.639713 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 437/942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:45 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1474 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:46.649967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:46.651049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:46.658303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.658638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.658913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.660089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.660901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.661119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.712360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:46.713409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:46.714084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:46.714738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:46.715933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:46.740720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.743250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.743994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.745263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.745929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.747127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.778462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:46.791587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for user d2bfae2396ee410c964701fd5d77615e and project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:46.806228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:46.823810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:46.826599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:46.832285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:46.839877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:46.842444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2aa6ac43-d4e9-41c2-8733-79f48049b9a6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.200593 Oct 10 10:40:46.847767 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 438/943] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:46 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:46.856487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:46.864028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:46.880563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.882480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.883575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.885057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:46.889087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:46.891737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:46.979678 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a65e5cb-859f-4ee4-82f8-acd0bb2419d6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.348490 Oct 10 10:40:46.987972 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 506/944] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:46.999092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96a6f012-38c7-4c2e-ad66-040563dd8282 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:47.000238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96a6f012-38c7-4c2e-ad66-040563dd8282 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:47.132987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96a6f012-38c7-4c2e-ad66-040563dd8282 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:47.144406 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96a6f012-38c7-4c2e-ad66-040563dd8282 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1234 microversion: 2.1 time: 0.149882 Oct 10 10:40:47.164089 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 507/945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:46 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1234 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:47.168880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d00218-083c-4ad6-9546-b3e85513114b", "name": "network-vif-plugged", "status": "completed", "tag": "e7ba385a-ad60-4b02-8c47-682dadb5f95b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:47.191810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:47.192538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:47.193646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:47.203831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:47.213789 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d27e821-1fd9-4a85-a647-5165d2508134 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.363972 Oct 10 10:40:47.214921 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 439/946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:46 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:47.224608 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] Creating event network-vif-plugged:e7ba385a-ad60-4b02-8c47-682dadb5f95b for instance f7d00218-083c-4ad6-9546-b3e85513114b on n-h1-860687-2 Oct 10 10:40:47.230761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ac2433f5-a877-4196-a651-091f574b958a req-437fe60a-f89f-443c-9193-86b03dce3524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065200 Oct 10 10:40:47.232060 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 508/947] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:47.654905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:47.656169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:47.672233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:47.672743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:47.673187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:47.673901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:47.674356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:47.674777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:47.888837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:47.889608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:47.906630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:47.907894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:47.908684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:47.909564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:47.910172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:47.910774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:47.942405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:47.954162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a910648-be7c-463a-b043-c1d7f3e678d5 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1474 microversion: 2.1 time: 0.303658 Oct 10 10:40:47.957509 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 440/948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:47 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1474 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:48.025831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:48.034549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:48.036383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:48.057926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ba1c32e-f096-438a-a1a0-a9f76280fa94 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.173384 Oct 10 10:40:48.062623 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 509/949] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:47 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:48.170525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:48.171739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:48.178474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:48.178960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:48.179411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:48.180113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:48.180564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:48.180982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:48.239070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:48.239988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:48.248832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:48.253002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:48.253909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:48.254866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:48.257329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:48.259413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:48.263509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:48.273025 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2ebbda7-5999-45bf-b04a-047d87d97e9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1286 microversion: 2.1 time: 0.106202 Oct 10 10:40:48.273923 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 441/950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:48 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:48.459025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:48.470279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e13b2a40-7600-4d47-bb96-f8465b15d6d0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1319 microversion: 2.1 time: 0.237614 Oct 10 10:40:48.483135 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 510/951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:48 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:48.579218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3964a919-4685-4fac-8c44-a5d5913ff4d4", "name": "network-vif-deleted", "tag": "e70a24d0-7675-4614-8dc6-cb04fb439e1e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:48.603304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:48.603791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:48.604224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:48.622010 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] Creating event network-vif-deleted:e70a24d0-7675-4614-8dc6-cb04fb439e1e for instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 on n-h1-860687-2 Oct 10 10:40:48.628331 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d948a733-7777-4e18-9c26-2b46c2894f2c req-9e059ad8-4bef-488f-beeb-ee379e5e1f81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053306 Oct 10 10:40:48.629841 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 442/952] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:48.989002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:48.990561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:49.028513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.030575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.034692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.039035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.039577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.050111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.090728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:49.092403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:49.107357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.108303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.109946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.111858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.116225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.117068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.139331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.140596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.141560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.142313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lazy-loading 'fault' on Instance uuid 3964a919-4685-4fac-8c44-a5d5913ff4d4 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:49.259362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:49.269629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e648134-124d-4b60-b2ac-a2b0fc41c42e tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1308 microversion: 2.1 time: 0.291473 Oct 10 10:40:49.272980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 511/953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:48 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:49.292110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bb3c83-3665-47bd-b4d6-d95b46bf417c", "name": "network-vif-plugged", "status": "completed", "tag": "fad5a651-a636-4bf2-8717-d8b75d5bcf2a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:49.305000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.305746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.306585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.318973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:49.322289 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] Creating event network-vif-plugged:fad5a651-a636-4bf2-8717-d8b75d5bcf2a for instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c on n-h2-860687-2 Oct 10 10:40:49.328942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3e5a8527-afec-4ff7-9d4f-aedc338b7245 req-06bc3404-ac9d-456f-87d1-b6f3a535e580 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054652 Oct 10 10:40:49.330017 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 512/954] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:49.333826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:49.336845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:49.337096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:49.338243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:49.347842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.348702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.350421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.351793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.352859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.353195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c9f1df7-5c22-474f-8497-794ab07dc9c6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1535 microversion: 2.91 time: 0.265808 Oct 10 10:40:49.353628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.354067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 443/955] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:49 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1535 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:49.463623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:49.475302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-716d248e-fa52-4a5e-8ef0-de7f36875128 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1292 microversion: 2.1 time: 0.142314 Oct 10 10:40:49.478139 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 513/956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:49 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:49.497702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:49.498324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:49.505132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.505834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.506496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:49.507408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:49.508027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:49.508613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.029563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.038692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-633eafab-00f1-4eba-af5e-0e06a3774980 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1468 microversion: 2.1 time: 0.544736 Oct 10 10:40:50.039639 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 444/957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:49 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:50.064358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:50.065136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:50.072714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.073954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.074579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.075341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.075808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.076241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.294621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:50.295245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.296832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:50.304562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2893e94-80b9-47c9-bcf9-aba541056730 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1319 microversion: 2.1 time: 0.244117 Oct 10 10:40:50.306722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.307674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.308341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.309270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.309958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.310583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.323106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 514/958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:50 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:50.331590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:50.348381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.349108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.349547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.349992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lazy-loading 'fault' on Instance uuid 3964a919-4685-4fac-8c44-a5d5913ff4d4 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:50.388812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:50.389794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:50.396236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.396847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.397390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.398477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.399091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.399781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.410292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9298c75fa5004ebd8e871e446afaf5b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d14526bda544259e66185614b4881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.418347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9067ee51-2824-434d-999d-6ce99247d9ce tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 200 len: 1308 microversion: 2.1 time: 0.127959 Oct 10 10:40:50.432381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 445/959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:50 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:50.484757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.498504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:50.498746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.499765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:50.501085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.506763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:50.507846 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe18817b-b58b-4c72-9998-ffa85a520c59 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1535 microversion: 2.91 time: 0.121984 Oct 10 10:40:50.508844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.509239 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 515/960] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:50 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1535 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:40:50.509808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.510407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.511367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:50.512021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:50.513552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:50.722632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:50.731712 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19d263d6-1e5a-41cf-94db-3bfa2a7a79c7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.237207 Oct 10 10:40:50.743221 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 446/961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:50 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:51.327586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:51.328315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.335490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.335972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.336471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.337198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.337661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.338080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.443951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:51.444695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] [instance: 3964a919-4685-4fac-8c44-a5d5913ff4d4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.451603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.452163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.452738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.453430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.453884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.454312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.468139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] HTTP exception thrown: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Request method failure captured: Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 HTTP/1.1 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Z8j0xz5VPIPlQ5l3Mc92r8iQj_06sEWRtuMN7zC2KOFgS4fL1MSlESIauoB9EHeID3t0N-Hu0Z4QG3w51ys_XLyQRgfD7y8w6QEgnzjCIE71fjqlRjR3sS3bOgQzlzEgj96yyzNELmBuXIerhMCX996QwwwJ0UFDvlAAiIAOfgoJ4 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 98d14526bda544259e66185614b4881d Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:40:51.469864 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d14526bda544259e66185614b4881d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98d14526bda544259e66185614b4881d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98d14526bda544259e66185614b4881d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98d14526bda544259e66185614b4881d"}]}] Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 98d14526bda544259e66185614b4881d Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-260394991 Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationNegativeTest-260394991-project Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9298c75fa5004ebd8e871e446afaf5b8 Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationNegativeTest-260394991-project Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. Oct 10 10:40:51.471541 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '3964a919-4685-4fac-8c44-a5d5913ff4d4'} Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:40:51.472455 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. Oct 10 10:40:51.474106 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:40:51.476434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] Returning 404 to user: Instance 3964a919-4685-4fac-8c44-a5d5913ff4d4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:40:51.476434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65c87bb5-35c9-4bd0-b380-b9c36cb051a2 tempest-LiveMigrationNegativeTest-260394991 tempest-LiveMigrationNegativeTest-260394991-project] 10.222.0.16 "GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4" status: 404 len: 111 microversion: 2.1 time: 0.031222 Oct 10 10:40:51.476434 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 447/962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:51 2022] GET /compute/v2.1/servers/3964a919-4685-4fac-8c44-a5d5913ff4d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:40:51.476765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.482546 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ae23a7e-1319-4dc0-b868-92e1a693527b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1319 microversion: 2.1 time: 0.158704 Oct 10 10:40:51.483948 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 516/963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:51 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:51.542209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:51.543080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.550362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.550860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.551427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.552122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.552606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.553033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.630745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.638930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.640578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.645492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af968eee-f1f3-4ee8-992b-e5c141d21835 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1538 microversion: 2.91 time: 0.107244 Oct 10 10:40:51.646255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 448/964] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:51 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1538 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:51.674978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:51.678262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.688315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.689699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.690251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.692319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.693602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.694199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.754899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:51.755794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:51.756661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.757990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860687-2". {{(pid=128800) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 10:40:51.763512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.764018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.764492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.765786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.766246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.767057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.837567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a839dee7-2292-48a4-b7ff-86060f5b65ba tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action" status: 202 len: 0 microversion: 2.91 time: 0.168359 Oct 10 10:40:51.838316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 517/965] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:40:51 2022] POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:40:51.846722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:51.847446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:51.854071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.854568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.855035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.861169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:51.861927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:51.862403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:51.943468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.944906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.954768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.955250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0c94ddf-02e4-4000-9f00-0a80f27cf8ae tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.202710 Oct 10 10:40:51.967025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:51.967025 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33664bc4-bb9e-4a07-b143-20927da98ff2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1486 microversion: 2.91 time: 0.121527 Oct 10 10:40:51.967025 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 518/966] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:51 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1486 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:40:51.970233 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 449/967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:51 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:52.510421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:52.516445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:52.526740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:52.527835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:52.528726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:52.529984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:52.531662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:52.532382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:52.824395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:52.835664 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d7121db-1b3a-4da2-9e5f-702f67cd97d3 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1319 microversion: 2.1 time: 0.329576 Oct 10 10:40:52.839496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 519/968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:52 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:52.932919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:52.940905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:52.947754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:52.950924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:52.951403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:52.952117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:52.954500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:52.954942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:52.986625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:52.987982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:53.000806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.001381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.004826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.004826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.004826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.004826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.300641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:53.309087 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6763209-55bc-48f7-89b2-f2a34c26cac0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.330455 Oct 10 10:40:53.309662 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 520/969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:52 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:53.323899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:53.324838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:53.332742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.333567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.334362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.335333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.336003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.336906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.340515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:53.367398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7427dd4a-1c50-43b0-a4d1-fe509da7e021 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 2424 microversion: 2.25 time: 0.440177 Oct 10 10:40:53.368245 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 450/970] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:52 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 2424 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:53.373524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:53.390558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.392130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.392728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.415875 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] Creating event network-changed:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h2-860687-2 Oct 10 10:40:53.420686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f55d06c5-0325-40c7-ab4e-af788fc8db81 req-2dd72dd5-b40a-474f-8230-8bed14a61e43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050981 Oct 10 10:40:53.422377 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 451/971] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:53.427967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": "auto"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:53.430500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:53.437871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.438448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.438824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.439635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.440095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.440706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.467737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'flavor' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:40:53.480673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:53.481667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:40:53.490284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:53.496238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:53.504037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ea0f8c2-4811-4f2e-a3f0-cc004978f14e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.192843 Oct 10 10:40:53.505600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 521/972] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:53 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:53.859890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:53.861462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:53.870351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.870814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.871441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:53.872345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:53.873018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:53.873672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.066967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.078695 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b7ac5c07-169f-485f-90f0-0c7f3eeada66 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1469 microversion: 2.1 time: 0.221431 Oct 10 10:40:54.095322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 522/973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:53 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:54.107151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:54.120705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.124184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Searching by: {'reservation_id': 'r-ygp8q8va', 'deleted': False, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:40:54.132435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.132960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.133401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.134119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.135302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.135745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.243832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:40:54.330539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.339083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.339513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.340025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.516594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d143d137-b2b0-42c8-9b16-75835b3826bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-ygp8q8va" status: 200 len: 2930 microversion: 2.1 time: 0.413538 Oct 10 10:40:54.517274 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 523/974] 10.222.0.16 () {58 vars in 1197 bytes} [Mon Oct 10 10:40:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ygp8q8va => generated 2930 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:40:54.522054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:54.523086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:54.531745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.532603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.533257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.534173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.534831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.535576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.732304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.743988 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e67d84b-5687-4e94-9a1e-80535d255072 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.224583 Oct 10 10:40:54.755640 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 524/975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:54 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:54.760478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:54.761084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:54.774394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.775170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.775767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.776635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.777094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.777518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:54.903096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.921481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.923123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:54.925500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:54.933342 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c587df83-0f19-4901-a6ad-fe6aadb4348c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.176617 Oct 10 10:40:54.934495 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 525/976] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:54 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:54.951136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:54.966585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_groups [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Querying cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) for 2 instances {{(pid=128800) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 10:40:54.968703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:54.969425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:54.970008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.003432 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38ebaf21-75c2-4769-8c1f-25e78ba76acf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/ca7703af-1dda-48fc-9a89-f1feb9b1c7ee" status: 200 len: 270 microversion: 2.1 time: 0.067401 Oct 10 10:40:55.004589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 526/977] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:40:54 2022] GET /compute/v2.1/os-server-groups/ca7703af-1dda-48fc-9a89-f1feb9b1c7ee => generated 270 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:55.227226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-761afcae-f08d-458f-9188-6f775a464740 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677cb560d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:55.364115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-761afcae-f08d-458f-9188-6f775a464740 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc" status: 200 len: 371 microversion: 2.1 time: 0.358104 Oct 10 10:40:55.364800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 527/978] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:40:55 2022] GET /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc => generated 371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:55.369533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:55.370153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:55.377009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.377753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.378410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.379464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.380083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.380668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.616960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a4476ae-7775-47a5-ad49-85b94af5fe39 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1620 microversion: 2.1 time: 0.251066 Oct 10 10:40:55.617805 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 528/979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:55 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1620 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:55.641624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Action: 'update', calling method: .version_select at 0x7f677cbdca60>, body: {"quota_set": {"ram": "5120"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:55.714379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.714879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.715355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.716465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.716973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.717697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.779552 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3929d38c-ef5a-421e-9b4f-eee42e7bbf7d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc" status: 200 len: 328 microversion: 2.1 time: 0.147040 Oct 10 10:40:55.780360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 529/980] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:40:55 2022] PUT /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc => generated 328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:55.785303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:55.786414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:55.793677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.794394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.795052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.796626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.797307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.797896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.971064 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70754ced-8790-471b-a521-b210e69dec13 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 200 len: 1619 microversion: 2.1 time: 0.189115 Oct 10 10:40:55.971810 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 530/981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:55 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 1619 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:55.976654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:55.977393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:55.984306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.984913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.985689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:55.986485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:55.987270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:55.987928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:56.153158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:56.161222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fbbf01ee-09e3-47a4-962b-58b67b7e39c2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.188205 Oct 10 10:40:56.162005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 531/982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:55 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:56.169236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3195bc7b-2087-4190-b4ec-53e8539e4cf7 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:56.181349 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3195bc7b-2087-4190-b4ec-53e8539e4cf7 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc" status: 202 len: 0 microversion: 2.1 time: 0.015672 Oct 10 10:40:56.182227 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 532/983] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:40:56 2022] DELETE /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc => generated 0 bytes in 20 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:40:56.187582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:56.188305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:56.194651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:56.195200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:56.195569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:56.196342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:56.196866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:56.197358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:56.270402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:56.281184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:56.282676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:56.287829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c13bcb33-c365-43c8-b7c6-8e06cf8b54f9 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.104572 Oct 10 10:40:56.288815 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 533/984] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:56 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:56.293699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1837253562", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "aa0eb006-0f97-46a3-80e9-f0eb428e91b2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:56.352155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:40:56.672183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:40:56.672618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:40:56.673071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:40:56.673474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:40:56.673887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:40:56.689744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:56.690324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:56.690889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:56.692382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:56.692382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:56.692813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:56.716514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:40:56.723737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:40:56.747863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:40:56.757471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:40:56.817374 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba770df1-bce2-4e0e-b367-5078b804aed1 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527283 Oct 10 10:40:56.818169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 534/985] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:40:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:40:56.824219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c34c444-6071-4b37-aa57-0d5c3aba7844 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677ca308b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:56.927565 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c34c444-6071-4b37-aa57-0d5c3aba7844 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc" status: 200 len: 371 microversion: 2.1 time: 0.108004 Oct 10 10:40:56.928467 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 535/986] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:40:56 2022] GET /compute/v2.1/os-quota-sets/a021cae5b2a54449ae4686b7f81b2ccc => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:56.934270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fdb3f59e-0ce4-42ef-96f9-f2259ceae389 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:56.934923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fdb3f59e-0ce4-42ef-96f9-f2259ceae389 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:57.030022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdb3f59e-0ce4-42ef-96f9-f2259ceae389 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:57.039713 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fdb3f59e-0ce4-42ef-96f9-f2259ceae389 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1217 microversion: 2.1 time: 0.110140 Oct 10 10:40:57.051835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 536/987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:56 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:57.149550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76a7b16c-1ba8-4085-a474-0e802c168b6d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677d041e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:57.472704 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-76a7b16c-1ba8-4085-a474-0e802c168b6d tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.327213 Oct 10 10:40:57.473486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 537/988] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:40:57 2022] GET /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18/defaults => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:40:57.492004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:57.494282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:57.512271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:57.512933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:57.513856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:57.515359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:57.516354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:57.516858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:57.728685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:57.738465 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-53868d1c-76b8-4107-867d-5a08b4b47c0a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.264078 Oct 10 10:40:57.739767 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 538/989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:57 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:57.744803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:57.747056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:57.752222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:57.752843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:57.753380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:57.754188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:57.754748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:57.755356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:57.781616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:57.829635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:57.838204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:57.840042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:57.846953 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8515bb2d-3de4-4e12-b522-490b2814b355 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.105963 Oct 10 10:40:57.847700 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 539/990] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:57 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:57.856350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Action: 'update', calling method: .version_select at 0x7f677ca30430>, body: {"quota_set": {"ram": "5120"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:58.010784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.011297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.011734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.012500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.012956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.013381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.078805 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d070f96d-00df-416e-b240-13519008275c tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237" status: 200 len: 328 microversion: 2.1 time: 0.226485 Oct 10 10:40:58.083321 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 540/991] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:40:57 2022] PUT /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237 => generated 328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:58.089758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:58.090381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:58.097964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.098451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.098938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.099661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.100112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.100535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.167488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:58.175794 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-284770ea-d961-432d-b77e-43e925db213b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1221 microversion: 2.1 time: 0.091296 Oct 10 10:40:58.183409 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 541/992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:58 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:58.183409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677cbb8ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:58.265192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.265679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.266116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.266852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.267343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.267776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.289639 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b6380a0-473c-474a-83c0-aabf340b4b68 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237/detail" status: 200 len: 916 microversion: 2.1 time: 0.110284 Oct 10 10:40:58.289639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 542/993] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:40:58 2022] GET /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237/detail => generated 916 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:58.545913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Action: 'update', calling method: .version_select at 0x7f677cbd69d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:58.719977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.721851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.723430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.725965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.726480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.728373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.817592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:40:58.839880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.841413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.843449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.846309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.847681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.848835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.949721 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aabbd7b5-bfcd-42d0-a29f-746944633af0 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237?user_id=67e18fb8a69444e7bed4d7e3aaad1d70" status: 200 len: 328 microversion: 2.1 time: 0.407494 Oct 10 10:40:58.950788 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 543/994] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:40:58 2022] PUT /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237?user_id=67e18fb8a69444e7bed4d7e3aaad1d70 => generated 328 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:58.961856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "name": "network-vif-plugged", "status": "completed", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:40:58.973695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:58.974179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:58.974617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:58.989696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] Creating event network-vif-plugged:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h2-860687-2 Oct 10 10:40:58.995038 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-351a3c84-180d-4611-9104-aa6d058acf67 req-9125ad3e-c849-4978-90db-96f74695813d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036681 Oct 10 10:40:58.995726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 544/995] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:59.003945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:59.004603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:59.012380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.013407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.013407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.014131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.015319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.016281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.229969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:59.239200 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-520e2c9c-2231-4721-880f-d97be900ed71 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.242476 Oct 10 10:40:59.251354 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 545/996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:58 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:59.251354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:59.251354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:59.258207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.259095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.259918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.261330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.262107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.263616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.330365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:59.338891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:59.340614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:59.347571 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33ff894c-ce75-4b57-9301-ff0454ba6e55 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.106709 Oct 10 10:40:59.349578 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 546/997] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:40:59 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:40:59.353087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac226695-43e6-416c-b23e-e02ef3f2e393 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677ca485e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:59.443074 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac226695-43e6-416c-b23e-e02ef3f2e393 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237?user_id=67e18fb8a69444e7bed4d7e3aaad1d70" status: 200 len: 370 microversion: 2.1 time: 0.093379 Oct 10 10:40:59.443671 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 547/998] 10.222.0.16 () {58 vars in 1323 bytes} [Mon Oct 10 10:40:59 2022] GET /compute/v2.1/os-quota-sets/21671d5b88c04d73828e61480f767237?user_id=67e18fb8a69444e7bed4d7e3aaad1d70 => generated 370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:40:59.448820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:40:59.449443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:40:59.456650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.457151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.457596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.458304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:40:59.458765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:40:59.459230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:40:59.551617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:40:59.560003 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9bd9832-1263-4467-aac2-d718f4adb186 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1221 microversion: 2.1 time: 0.115276 Oct 10 10:40:59.561028 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 548/999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:40:59 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:40:59.837430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8607d132-70ec-41ce-8f51-94506e097415 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Calling method '.version_select at 0x7f677cb560d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:00.045919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8607d132-70ec-41ce-8f51-94506e097415 tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18/defaults" status: 200 len: 371 microversion: 2.1 time: 0.212049 Oct 10 10:41:00.046822 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 549/1000] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:40:59 2022] GET /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18/defaults => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:00.059046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Action: 'update', calling method: .version_select at 0x7f677cbd6550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:00.128332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=69 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:00.132050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.132623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.133070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.133805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.134265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.134694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.143982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=22 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:00.383059 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c18751f-23a8-4198-a5bf-135598ed5dac tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18" status: 200 len: 329 microversion: 2.1 time: 0.327849 Oct 10 10:41:00.391408 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 550/1001] 10.222.0.16 () {60 vars in 1263 bytes} [Mon Oct 10 10:41:00 2022] PUT /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18 => generated 329 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:00.396970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:00.397616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:00.404080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.404572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.405037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.406788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.407303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.407698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.566463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:00.574388 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1bc5885-af51-49b5-a35d-42134c7e48a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1360 microversion: 2.1 time: 0.181860 Oct 10 10:41:00.575889 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 551/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:00 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:00.580602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:00.581221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:00.588612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.589120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.589561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.590268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.590728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.591196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.688349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:00.702763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:00.713218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:00.721278 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f67257ed-a15f-4d35-92cb-8c4384dce11b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.145223 Oct 10 10:41:00.722190 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 552/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:00 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:00.739238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Action: 'update', calling method: .version_select at 0x7f677ca50b80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:00.824299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.824822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.825338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.826136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:00.826549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:00.827722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:00.935080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=19,nova_api:UPDATE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:01.134977 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e118e94c-bf40-4d4c-b67a-439ebd82addc tempest-QuotasAdminTestJSON-301723111 tempest-QuotasAdminTestJSON-301723111-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18" status: 200 len: 329 microversion: 2.1 time: 0.411697 Oct 10 10:41:01.135609 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 553/1004] 10.222.0.16 () {60 vars in 1263 bytes} [Mon Oct 10 10:41:00 2022] PUT /compute/v2.1/os-quota-sets/609cf70fe0ff47fdbcde2ef993348f18 => generated 329 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:01.148981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.149554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.161392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.162211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.162651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.163436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.163873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.164297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.199885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:41:01.293311 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73b2be3f-f586-4103-8fb8-f8ce770fa394 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 204 len: 0 microversion: 2.1 time: 0.156260 Oct 10 10:41:01.294476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 554/1005] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:01 2022] DELETE /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:01.301314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.302154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.310394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.311053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.318773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.318773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.318773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.318773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.387174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.402055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83521e79-7c53-4f5f-8fc3-1363bee27d31 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1221 microversion: 2.1 time: 0.105087 Oct 10 10:41:01.402812 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 555/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:01 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:01.427096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.427768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.447888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.448390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.448858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.449632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.450153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.450518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.624158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.633702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24c1b93e-c77e-48e0-9cf5-d2f86dead007 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1713 microversion: 2.1 time: 0.214522 Oct 10 10:41:01.634480 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 556/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:01 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1713 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:01.652836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.653957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.673229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.673853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.674518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.675312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.675906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.676397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.852783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.863795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7eaaced0-7c67-44a7-a3bd-2977c88e78f5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1543 microversion: 2.1 time: 0.228347 Oct 10 10:41:01.864445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 557/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:01 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1543 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:01.869414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.870133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.877472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.877472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.877760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.878215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.878672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.880116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.959532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.967971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.969596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:01.974485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81ab3f8a-4659-4946-aa91-114124d351f0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.109107 Oct 10 10:41:01.975078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 558/1009] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:01 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:01.982189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:01.982189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:01.988775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.989365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.989868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:01.990627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:01.991190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:01.991681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:02.083381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df42975f-271b-4eb7-817e-790b71be47c8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107221 Oct 10 10:41:02.084288 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 559/1010] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:41:01 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:02.426367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:02.427153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:02.433615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:02.434205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:02.434744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:02.435693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:02.436328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:02.436969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:02.453694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:02.778366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:02.786518 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d60b9f0-a7d2-4d22-b881-f6915c9ca878 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1221 microversion: 2.1 time: 0.364675 Oct 10 10:41:02.799956 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 560/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:02 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1221 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:02.808179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:02.808812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:02.815173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:02.815670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:02.816103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:02.816806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:02.817261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:02.817689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:03.138086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:03.147840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a18809f3-6467-4a71-a2fc-c1ce74e1658a tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1713 microversion: 2.1 time: 0.346756 Oct 10 10:41:03.148559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 561/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:02 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1713 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:03.153027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:03.153696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:03.161671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:03.162210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:03.162595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:03.163320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:03.163773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:03.164192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:03.270490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:03.281822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:03.282687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:03.288609 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a0f60f1-5d51-4a79-9313-c4fd3e02a72b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.139068 Oct 10 10:41:03.297404 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 562/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:03 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:03.502446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:03.567618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:03.814446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:03.815076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:03.835153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:03.837002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:03.838696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:03.839553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:03.840173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:03.841115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:03.973834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:03.986971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0bccb429-fb37-4812-b773-c6703554b070 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1221 microversion: 2.1 time: 0.176840 Oct 10 10:41:03.990109 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 563/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:03 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:03.998337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:04.038744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:04.039555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:04.040935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:04.062302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] Creating event network-changed:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h2-860687-2 Oct 10 10:41:04.070404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7c64f9aa-7da5-4fc9-b7a7-87582bb896b1 req-744e6857-14d9-4a0b-9656-af0371984da3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077503 Oct 10 10:41:04.072637 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 564/1015] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:04.180136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:04.181135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:04.209227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:04.209737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:04.210231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:04.211165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:04.211804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:04.212454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:04.370127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:04.388542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d53ea45-c998-4390-abbf-2c8fcaef5bc2 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1646 microversion: 2.1 time: 0.214489 Oct 10 10:41:04.390777 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 565/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:04 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1646 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:04.398358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:04.399301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:04.408782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:04.409531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:04.410147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:04.411067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:04.412970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:04.414388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:04.575887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:04.589972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:04.594763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:04.603314 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81b9d67d-feb5-4294-b294-55337bd46a29 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.210575 Oct 10 10:41:04.620772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 566/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:04 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:05.015741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:05.016427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:05.026526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.027040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.028094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.028229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.028631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.029064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.234953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.246782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07f79744-a4a9-4e43-a2a1-76d16260c2d6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1213 microversion: 2.1 time: 0.231397 Oct 10 10:41:05.254899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 567/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:05 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1213 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:05.338185 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9bd5d8e-8bbf-48b8-b288-d1e31735773b tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/action" status: 202 len: 0 microversion: 2.25 time: 11.913962 Oct 10 10:41:05.339158 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 452/1019] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:40:53 2022] POST /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/action => generated 0 bytes in 11916 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:05.349517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:05.368261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:05.382636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.384505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.398555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.399792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.400696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.401760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.419477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:05.420498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:05.438751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.444533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.445305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.446257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.447017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.447708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.695760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b9f90c3fc24f4fb0e03e557230db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c87ea9779ea549d8a893c36bbe69d962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.708870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64c5b7ae-3279-44f5-b300-eeb3ef456d2b tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 200 len: 1646 microversion: 2.1 time: 0.291930 Oct 10 10:41:05.713578 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 453/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:05 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 1646 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:05.727810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:05.728451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:05.738756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.739279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.744662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.746924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:05.750548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:05.750987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:05.927783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.939992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.943986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.954010 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-abdbe6c8-4b26-41d9-8611-927b1bde2c9f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.607389 Oct 10 10:41:05.954010 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 568/1021] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:05 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:05.968569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.977682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.979743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:05.988866 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6978955d-f9a8-4b88-bafe-4e88f4798893 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.271810 Oct 10 10:41:05.989715 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 454/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:05 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:06.138405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9df6cbb-e23c-4387-b4cc-26b529c75c94", "name": "network-vif-deleted", "tag": "291d1e03-eb74-48db-bbe8-10251394865a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:06.188218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.188824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.189344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.229113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] Creating event network-vif-deleted:291d1e03-eb74-48db-bbe8-10251394865a for instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 on n-h2-860687-2 Oct 10 10:41:06.243766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ddf75762-b10d-480f-ac7b-2819aaf66300 req-d587a32e-ebcb-4ae8-975c-038016d1b7a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121890 Oct 10 10:41:06.247770 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 569/1023] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:06.276963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.285363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:06.310390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.313912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.316417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.319576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.320454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.321770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.475741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:06.485782 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-851a8628-3a04-44ae-875e-fb68b3b7c5eb tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1269 microversion: 2.1 time: 0.213964 Oct 10 10:41:06.488635 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 455/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:06 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:06.724622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:06.727104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:06.738568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.739238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:06.739708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.740246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.740674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.741627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.742277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.742982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.753113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.753619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.754060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.754768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.755425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.756016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.773812 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 HTTP/1.1 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:41:06.775963 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:06.777626 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b9df6cbb-e23c-4387-b4cc-26b529c75c94'} Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:06.778556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:06.781383 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.783668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:06.793632 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08ca843b-994c-470f-be3a-dea00496a800 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 404 len: 111 microversion: 2.1 time: 0.059150 Oct 10 10:41:06.799559 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 456/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:06 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:06.808564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.809331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:06.819281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.820507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.821282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.822529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.823784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.824507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.850098 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 HTTP/1.1 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:41:06.852095 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.853395 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0cff59e5-7804-49cb-a842-394d2de7a908'} Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:06.854147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.855350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.859855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:06.861011 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5c8dd6e-ed9f-428d-b99d-aa5cc07dd086 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 404 len: 111 microversion: 2.1 time: 0.060108 Oct 10 10:41:06.865293 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 457/1026] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:06 2022] DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:06.870258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.871185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:06.880107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.880957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.881623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.882578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:06.883351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:06.884110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:06.903032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 HTTP/1.1 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:41:06.906099 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.907537 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0cff59e5-7804-49cb-a842-394d2de7a908'} Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:06.908377 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:06.910608 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:41:06.913080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:06.914133 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b3d4888-9e4f-4e25-bbe9-0b6fd9c92041 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 404 len: 111 microversion: 2.1 time: 0.047621 Oct 10 10:41:06.920054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 458/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:06 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:06.925422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5bc94ea-8677-45a0-a9ff-e7dec86026c9 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '.version_select at 0x7f677cd93f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.953606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5bc94ea-8677-45a0-a9ff-e7dec86026c9 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202871567" status: 202 len: 0 microversion: 2.1 time: 0.033356 Oct 10 10:41:06.954253 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 459/1028] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202871567 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:06.982135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:06.982750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:07.025290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.025794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.026232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.026949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.027427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.027852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.045233 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] HTTP exception thrown: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Request method failure captured: Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments/75de287a-62e4-4d2b-b6bf-16717512843c HTTP/1.1 Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 74 Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZhKAfFQTgkgV9-4zjld33nkteycXRfVWMNHVPCPYi8g6CHmQp4OXGlX3sQ0QasaqerPGuaRRAXOPji66BYu7hhl00aihkEtisSuHtP35iiZ8jTENBSERtAP9H6Rzxlk3sLsYFUzA4AKS5x4DgwJfxHxYWMjnN_tkXnZl7SMuT56NA Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 9749869d34bd4135a4aea98f898b53fa Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:41:07.051810 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9749869d34bd4135a4aea98f898b53fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9749869d34bd4135a4aea98f898b53fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9749869d34bd4135a4aea98f898b53fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9749869d34bd4135a4aea98f898b53fa"}]}] Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 9749869d34bd4135a4aea98f898b53fa Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesAdminNegativeTest-72111872-project-admin Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3ee62f964894435b8f33fcb9d00d417a Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesAdminNegativeTest-72111872-project-admin Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: {"volumeAttachment": {"volumeId": "5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb"}} Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:07.053238 n-d-860687-2 devstack@n-api.service[128800]: exception: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': '366b075f-2d79-4500-904e-f42558454b83', 'id': '75de287a-62e4-4d2b-b6bf-16717512843c', 'body': {'volumeAttachment': {'volumeId': '5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb'}}} Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:41:07.054267 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. (HTTP 404) (Request-ID: req-61c561b2-d12b-40a9-b0a8-7f1586c56d09) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:41:07.055353 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:07.056556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. Oct 10 10:41:07.057697 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:07.061804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Returning 400 to user: Volume 5c9e1ddc-6f38-4fbc-8763-c4a449e0d0cb could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:07.062985 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d008ab8-1682-404a-b396-d54da9e32b98 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments/75de287a-62e4-4d2b-b6bf-16717512843c" status: 400 len: 107 microversion: 2.1 time: 0.653361 Oct 10 10:41:07.064325 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 570/1029] 10.222.0.16 () {60 vars in 1433 bytes} [Mon Oct 10 10:41:06 2022] PUT /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments/75de287a-62e4-4d2b-b6bf-16717512843c => generated 107 bytes in 655 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:41:07.096165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:07.099384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:07.114766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.115043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.115402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.116099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.116547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.122679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.420840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.437583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.438975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.445614 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-090f1510-0fe9-4d7d-95af-fcf2750a6fd6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.379666 Oct 10 10:41:07.446198 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 571/1030] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:07 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:07.470445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:07.470967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:07.478559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.479091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.479537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.480257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.480716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.482257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.703498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.712577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.714020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:07.720739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17b88015-4cc0-485a-a035-578d51f03240 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.737072 Oct 10 10:41:07.721872 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 460/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:06 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:07.728107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:07.731736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:07.752973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.753647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.754264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.755146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:07.755753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:07.756331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:07.757102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lazy-loading 'services' on Instance uuid 366b075f-2d79-4500-904e-f42558454b83 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:07.977786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e8450dc-a953-41f9-85b5-830a54e26c6a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "DELETE /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments/75de287a-62e4-4d2b-b6bf-16717512843c" status: 202 len: 0 microversion: 2.1 time: 0.523900 Oct 10 10:41:07.978540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 572/1032] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:41:07 2022] DELETE /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments/75de287a-62e4-4d2b-b6bf-16717512843c => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:08.013458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:08.032144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:08.055398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.055905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.056336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:08.060384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.062724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.064084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:08.146744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:08.165323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5319dec1-2ee8-4600-b502-c96c22ba4d6c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1275 microversion: 2.1 time: 0.441953 Oct 10 10:41:08.175039 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 461/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:07 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1275 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:08.267252 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df1ab602-a480-428d-9b21-039e03a3defd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278044 Oct 10 10:41:08.267914 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 573/1034] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:07 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 197 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:08.476490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:08.477921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:08.490040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.490562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.491023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:08.491816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.492284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.492720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:08.666204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:08.679745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:08.681263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:08.691762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f74fb19a-fa80-4d3b-96a9-589714ed9d96 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.219531 Oct 10 10:41:08.698752 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 462/1035] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:08 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:08.755497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:08.756949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:08.759663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=78,nova_api:INSERT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:08.765982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.766911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.767804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:08.768740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:08.770690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:08.772020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.198571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.199258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.210691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.217363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.217918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.218664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.219179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.219611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.356184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.375048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.377882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.386420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da501313-ce0f-45db-a74c-dc86aca371da tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.637553 Oct 10 10:41:09.399025 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 574/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:08 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:09.399025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.404349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.407942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.416486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a5c8c37-da33-4e78-bb79-6612f7aed37a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1275 microversion: 2.1 time: 0.222579 Oct 10 10:41:09.417901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.418399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.422306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.423074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.423269 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 463/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:09.425041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.425481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.432367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bb3b2c0-02de-4937-8ef8-c993c7ccc1b3 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.481259 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bb3b2c0-02de-4937-8ef8-c993c7ccc1b3 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1668527963" status: 202 len: 0 microversion: 2.1 time: 0.056636 Oct 10 10:41:09.482070 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 464/1038] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:41:09 2022] DELETE /compute/v2.1/flavors/1668527963 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:09.490787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2f60afb-72b5-4789-bb03-e900b347fb76 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.508668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c71f0be-5764-4510-a2bf-8f17fc01bc6e tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120049 Oct 10 10:41:09.512254 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 575/1039] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:09.524935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2f60afb-72b5-4789-bb03-e900b347fb76 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.037757 Oct 10 10:41:09.526615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 465/1040] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:09.553150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6248f0eb-ca7a-4443-b0ea-1dbeb26be2d0 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.586281 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6248f0eb-ca7a-4443-b0ea-1dbeb26be2d0 tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1045431188" status: 202 len: 0 microversion: 2.1 time: 0.036929 Oct 10 10:41:09.587068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 576/1041] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:41:09 2022] DELETE /compute/v2.1/flavors/1045431188 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:09.597693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b0fb627-1e84-4a00-a2f1-82465bbb7cdd tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.642371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b0fb627-1e84-4a00-a2f1-82465bbb7cdd tempest-ServersWithSpecificFlavorTestJSON-854136231 tempest-ServersWithSpecificFlavorTestJSON-854136231-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045302 Oct 10 10:41:09.649792 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 466/1042] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:09.700197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.701285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.711547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.714021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.725390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.726317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.731447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.733974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.735606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.737449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.738207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.741784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.742483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.743670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.744357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.745629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.772111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 HTTP/1.1 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:09.774007 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.775573 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b9df6cbb-e23c-4387-b4cc-26b529c75c94'} Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:09.776474 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.777918 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.779362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:09.779993 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44e73c4d-9c97-4a63-8d95-6e487820694f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 404 len: 111 microversion: 2.1 time: 0.083753 Oct 10 10:41:09.783198 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 577/1043] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:09 2022] DELETE /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:09.793584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.794631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: b9df6cbb-e23c-4387-b4cc-26b529c75c94] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.807094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.810158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.812403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.813324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.816340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.817169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:09.885545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 HTTP/1.1 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:09.896999 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.898563 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b9df6cbb-e23c-4387-b4cc-26b529c75c94'} Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:09.899506 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. Oct 10 10:41:09.900987 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:09.902633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance b9df6cbb-e23c-4387-b4cc-26b529c75c94 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:09.902633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a707ecf-c246-4684-99df-21a66dc081bb tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94" status: 404 len: 111 microversion: 2.1 time: 0.113067 Oct 10 10:41:09.902633 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 578/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/servers/b9df6cbb-e23c-4387-b4cc-26b529c75c94 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:09.925798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:09.926320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:09.935607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.961086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.962551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:09.977175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:09.977689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:09.981994 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bc20673-1994-4f6c-84dd-457897903376 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1531 microversion: 2.91 time: 0.261486 Oct 10 10:41:10.000755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.001417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.001930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.002378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.014447 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 467/1045] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:09 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1531 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:41:10.034062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:10.034919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:10.050929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.052637 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.053349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.055221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 HTTP/1.1 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:10.056447 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.058120 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0cff59e5-7804-49cb-a842-394d2de7a908'} Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:10.059061 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.060677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.064626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.065650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:10.066458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.068821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8956c252-e55f-4720-8cf5-7fe19cf1ad74 tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 404 len: 111 microversion: 2.1 time: 0.164747 Oct 10 10:41:10.069485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.074230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 579/1046] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:09 2022] DELETE /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:10.100510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:10.101163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] [instance: 0cff59e5-7804-49cb-a842-394d2de7a908] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:10.148636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.149164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.149610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.150505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.150969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.151451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.197554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] HTTP exception thrown: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Request method failure captured: Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 HTTP/1.1 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_YjPP_kuQM371RaQCIbWkgdZTcE41ld6yw0dZHGLxb2rj00RVFyPSTizj2w8V1gcOCmkdPollEZ_GY2LIP7L62uUTGLa9T4_pPKjcW5O6du0ijTnJxkk-H1-ipOCV62IIJDQPB-fS0_ntNSKpvDhhItgktPZuaLnpz-3D7advgO3xI Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:10.202474 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c87ea9779ea549d8a893c36bbe69d962", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c87ea9779ea549d8a893c36bbe69d962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c87ea9779ea549d8a893c36bbe69d962"}]}] Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c87ea9779ea549d8a893c36bbe69d962 Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000 Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c0b9f90c3fc24f4fb0e03e557230db65 Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1775229000-project Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.204498 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0cff59e5-7804-49cb-a842-394d2de7a908'} Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:10.205385 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. Oct 10 10:41:10.206847 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:10.208167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] Returning 404 to user: Instance 0cff59e5-7804-49cb-a842-394d2de7a908 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:10.208167 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b76fb4c2-b52e-4714-be00-9d7e304ff30f tempest-ServersWithSpecificFlavorTestJSON-1775229000 tempest-ServersWithSpecificFlavorTestJSON-1775229000-project] 10.222.0.16 "GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908" status: 404 len: 111 microversion: 2.1 time: 0.127734 Oct 10 10:41:10.210899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 580/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:10 2022] GET /compute/v2.1/servers/0cff59e5-7804-49cb-a842-394d2de7a908 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:10.291874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lazy-loading 'services' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:10.329494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cedfaad4-66a9-4b41-b49f-5d6fb347156e tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1936 microversion: 2.91 time: 0.313607 Oct 10 10:41:10.380022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:10.381359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:10.384955 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 468/1048] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:10 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1936 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:10.390116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.390872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.391987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.393006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.393633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.394246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.419483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:10.420507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:10.431329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.439996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:10.441420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.441894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.442870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.443670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.444338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.483791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lazy-loading 'flavor' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:10.838193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:10.940231 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-51bce3a1-b13d-4920-9b4c-c147af4e3603 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action" status: 202 len: 0 microversion: 2.91 time: 0.570757 Oct 10 10:41:10.946536 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 581/1049] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:41:10 2022] POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:10.953872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:10.954854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:10.963180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.963980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.964656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:10.965799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:10.968649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:10.969316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.026347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.038985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.041101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.042556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33551514-4264-46bc-b5c7-74cb3d7fb67d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.629340 Oct 10 10:41:11.043802 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 469/1050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:10 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:11.049457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:11.052194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:11.064944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.065791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.067170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.071222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.071930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.072532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.125419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=67 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:11.150450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc7c10cd-4b4c-47b4-b9b6-f45dda4066a2 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104574 Oct 10 10:41:11.153304 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 470/1051] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:11 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:11.173765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:11.176406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:11.195853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.196359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.196799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.197509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.197960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.198387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.368324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.380546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.385613 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37dcb59a-6306-489c-9637-5fdaa64d6926 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.436270 Oct 10 10:41:11.394558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.396434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:11.400698 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 582/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:10 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:11.414063 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa6072c8-1133-4515-833b-c687a10cf554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.259497 Oct 10 10:41:11.414906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 471/1053] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:11 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:11.739178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:11.740149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:11.750598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.751337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.751942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.752845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.755609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.756261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.793023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:41:11.929336 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-435742d9-4111-49fa-bafe-53d0a65a4d4b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 204 len: 0 microversion: 2.1 time: 0.196012 Oct 10 10:41:11.931367 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 583/1054] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:11 2022] DELETE /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:11.943751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:11.944918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:11.966363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.967159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.968131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:11.972900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:11.973407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:11.973843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.074991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:12.078872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:12.093890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.096080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.098108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.099233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.101835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.105892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.341842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.361586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.364612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.365821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.366195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1682854-27ff-4f28-bdfa-cb6f0d129300 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.297033 Oct 10 10:41:12.367287 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 584/1055] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:12 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:12.373284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:12.376879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:12.379089 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-498bd6bb-1003-4a8d-b5b9-1e8f0f16e57e tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1665 microversion: 2.1 time: 0.441787 Oct 10 10:41:12.382316 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 472/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:11 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1665 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:12.396466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.397570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.398135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.398862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.399355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.399786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.413593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:12.414394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:12.421446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.422209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.422832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.423753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.424418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.425050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.461315 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d84a6ec1-77a5-4d7c-8062-befead474014 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092838 Oct 10 10:41:12.471339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 585/1057] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:12 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:12.483019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:12.484017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:12.505036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.505822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.506437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.507425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:12.508052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:12.508671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:12.676057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.686413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.694966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.711228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fda60d4f-bb69-431c-950c-55ee487baca5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.238468 Oct 10 10:41:12.714020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 586/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:12 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:12.815146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:12.833906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b5cfe9d-175d-4872-821a-cb3e3474f73b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.422261 Oct 10 10:41:12.836892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 473/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:12 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:13.170524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b57dde-042b-478c-9f69-4d951d1fe75d", "tag": "fdbb525f-1194-4b63-b390-f7231402a12e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:13.186289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:13.189579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:13.192190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:13.215205 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] Creating event network-changed:fdbb525f-1194-4b63-b390-f7231402a12e for instance 98b57dde-042b-478c-9f69-4d951d1fe75d on n-h1-860687-2 Oct 10 10:41:13.221361 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5346447c-3e3d-4271-bb28-e3f17ef56130 req-3d89f685-a9d5-45a3-95c1-5f2d5911c91a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054977 Oct 10 10:41:13.221915 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 587/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:13.398231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:13.398231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:13.408801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:13.409567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:13.417905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:13.418408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:13.418853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:13.419266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:13.419594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:13.420640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:13.421889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:13.435420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:13.438389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:13.439444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:13.440791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:13.441968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:13.972410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:13.997853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.008263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f6d2258-2762-4d9d-8835-c1eb6b33f6c1 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1665 microversion: 2.1 time: 0.608260 Oct 10 10:41:14.015135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.016929 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 588/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:13 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1665 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:14.037684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.044588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:14.050151 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7f47952-0083-43c4-be16-d5b213120391 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.657537 Oct 10 10:41:14.052463 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 474/1062] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:13 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:14.056950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:14.068854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:14.069476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:14.074698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.075449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.078158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.083801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.085345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.085829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.091393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.094173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.094787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.098522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.099107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.099499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.174837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:14.185070 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44f8d635-1fe4-426d-be19-bedd67d3be1a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166678 Oct 10 10:41:14.192461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 589/1063] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:14 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:14.199961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:14.203313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:14.213442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.214680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.215433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.216160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:14.219821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:14.220505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:14.301508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.316410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.319032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.329398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e3f38d5-c3d4-4929-8a97-307732ad891e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.274715 Oct 10 10:41:14.341288 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 475/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:14 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:14.892916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:14.903730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0143d28b-cf5e-48e9-bd4d-cd9d0afbd91c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.713598 Oct 10 10:41:14.904241 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 590/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:14 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:15.002800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4af6c227-0531-4032-adda-c84801713e54 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Action: 'create', calling method: .version_select at 0x7f677ca29820>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:15.041118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:15.042077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:15.059785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:15.060922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:15.061643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:15.062549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:15.063221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:15.063869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.057784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:16.072162 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd1dacbb-0dc0-4dee-ac3c-db21a1db6f7b tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1665 microversion: 2.1 time: 1.032494 Oct 10 10:41:16.076971 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 591/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:15 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1665 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:16.083335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:16.084545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:16.095914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.096415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.096900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.097923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.098388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.098814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.640973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:16.664487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:16.672306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:16.674135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea89b3fa-7c84-406b-9bb9-6dbf3eb32b94 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.595788 Oct 10 10:41:16.675265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 592/1067] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:16 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:16.691849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:16.697796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:16.724009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.724846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.727105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.729769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.743547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.745978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.848693 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8f0de71-b9a7-45cf-b55a-8e015494196c tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171653 Oct 10 10:41:16.853057 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 593/1068] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:41:16 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:41:16.888105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:16.891331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:16.909921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.910551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.911127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:16.911944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:16.912546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:16.913302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:17.166600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:17.176855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:17.181528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:17.194668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-15e9325d-9302-432e-b400-67cceb9aa007 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.340023 Oct 10 10:41:17.209862 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 594/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:16 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:17.211231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:17.212680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:17.223262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:17.224130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:17.225571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:17.229196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:17.229920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:17.230551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:17.237748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:17.766839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:17.775914 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0274c50-d6de-4bf4-b38a-3b35bafb3062 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.571554 Oct 10 10:41:17.781082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 595/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:17 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:17.792233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6baccc5e-d70d-418c-a077-26c0a75ad965", "name": "network-vif-deleted", "tag": "3c194fa2-d41c-4d94-8401-b53f677b269a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:17.815426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:17.818104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:17.819238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:17.848051 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] Creating event network-vif-deleted:3c194fa2-d41c-4d94-8401-b53f677b269a for instance 6baccc5e-d70d-418c-a077-26c0a75ad965 on n-h1-860687-2 Oct 10 10:41:17.862436 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1da887c0-7506-482d-88e7-e5952aa5eb23 req-7cb29a2c-cdd2-40e9-a451-605e48d02f59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079074 Oct 10 10:41:17.865165 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 596/1071] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:17.872691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:17.874266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:17.882019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:17.882871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:17.883647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:17.884624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:17.897053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:17.898015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:18.013328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:18.016125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:18.026789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:18.031691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lazy-loading 'fault' on Instance uuid 6baccc5e-d70d-418c-a077-26c0a75ad965 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:18.366035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3167e5e9262a4ee3a0a629c9b3148c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cff07e1dd54760babfcedffa37d81e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:18.379062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c953fff-bcd4-4b48-967a-431fc4c39a22 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 200 len: 1315 microversion: 2.1 time: 0.511935 Oct 10 10:41:18.380036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 597/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:17 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:18.384771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1792890958", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "5061736c-860b-401b-8fa7-abf1001c1980"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:18.501807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] validate_networks() for [('5061736c-860b-401b-8fa7-abf1001c1980', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:41:19.368279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:41:19.368946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:41:19.369397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:41:19.370042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:41:19.370584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:41:19.399577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.400224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.400767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:19.401901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.402185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.402717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:19.439752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for project 257f78a524be47438022f1d676de077e. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:19.454963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Getting quotas for user 8a76a87cf647471a93969cb2dcfb0f12 and project 257f78a524be47438022f1d676de077e. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:19.480400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:41:19.485276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:41:19.593718 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2764098-7ef4-4819-af34-22f64c0baa61 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212449 Oct 10 10:41:19.594424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 598/1073] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:41:19.605229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:19.609598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:19.626927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.628075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.628620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:19.630618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.631817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.632263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:19.759967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4af6c227-0531-4032-adda-c84801713e54 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.883948 Oct 10 10:41:19.760952 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 476/1074] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:41:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:41:19.767278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:19.768465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:19.788718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.789259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.789682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:19.790337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:19.790798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:19.791268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:20.033727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.042960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.046787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.056422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.067311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27caf81a-d541-48b0-83f6-ce98e3ad9198 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.305008 Oct 10 10:41:20.068212 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 477/1075] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:19 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:20.072834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.075165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.076963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:20.077710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e6583da0-9d48-41f5-9592-771d29bc3574 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.482288 Oct 10 10:41:20.078817 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 599/1076] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:19 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:20.079700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:20.095908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:20.096957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] [instance: 6baccc5e-d70d-418c-a077-26c0a75ad965] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:20.104787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:20.105277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:20.105925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:20.106606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:20.107097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:20.108356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:20.114661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:20.116253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:20.117415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:20.118469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:20.119167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:20.119797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:20.164784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] HTTP exception thrown: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Request method failure captured: Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 HTTP/1.1 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_aDUE8gBL9yo0JXmSdYtqcS2NlmhkgNN071KDXKwmgr8noXkjTzcAGDBn-B_EOzeBr_CBkSjRO8Tl56PDdOTwMT2CnuG9A9OMzAnHm3HPlCqL6zPdeWZ9sxJm33KGHTMWqtnVHP7RARyOD-sWaiOXNqUqcjij8tL0m9PQc0a5E_za0 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: c5cff07e1dd54760babfcedffa37d81e Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestFqdnHostnames-1028889179 Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:20.168592 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5cff07e1dd54760babfcedffa37d81e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5cff07e1dd54760babfcedffa37d81e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5cff07e1dd54760babfcedffa37d81e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5cff07e1dd54760babfcedffa37d81e"}]}] Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestFqdnHostnames-1028889179 Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: c5cff07e1dd54760babfcedffa37d81e Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1028889179 Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestFqdnHostnames-1028889179-project Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3167e5e9262a4ee3a0a629c9b3148c63 Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestFqdnHostnames-1028889179-project Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. Oct 10 10:41:20.170711 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '6baccc5e-d70d-418c-a077-26c0a75ad965'} Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:20.171895 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. Oct 10 10:41:20.173421 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:20.187983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Returning 404 to user: Instance 6baccc5e-d70d-418c-a077-26c0a75ad965 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:20.189261 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c799b92-c559-41ce-8c14-591602616615 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965" status: 404 len: 111 microversion: 2.1 time: 0.109257 Oct 10 10:41:20.190465 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 600/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:20 2022] GET /compute/v2.1/servers/6baccc5e-d70d-418c-a077-26c0a75ad965 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:20.204720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee11a82f-4917-4497-8b41-6c4b372ac114 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:20.205357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee11a82f-4917-4497-8b41-6c4b372ac114 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:20.348203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee11a82f-4917-4497-8b41-6c4b372ac114 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.372257 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee11a82f-4917-4497-8b41-6c4b372ac114 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1218 microversion: 2.1 time: 0.180294 Oct 10 10:41:20.390279 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 601/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:20 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:20.405628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e876412-32cb-48b0-9062-c2548d7d3666 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Action: 'create', calling method: .version_select at 0x7f677c841430>, body: {"pool": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:20.474663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:20.484011 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e9cf1fc-7ab1-44ec-9b06-38e8d5e994ad tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.414394 Oct 10 10:41:20.491140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 478/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:20 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:20.497642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f9b32db-5aa6-4447-8421-f8623d7d2c24 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] Calling method '.version_select at 0x7f677ca60af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:20.525413 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f9b32db-5aa6-4447-8421-f8623d7d2c24 tempest-ServersTestFqdnHostnames-1028889179 tempest-ServersTestFqdnHostnames-1028889179-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654559839" status: 202 len: 0 microversion: 2.1 time: 0.032732 Oct 10 10:41:20.526717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 479/1080] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654559839 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:21.102874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:21.103672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:21.121398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:21.122090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:21.123915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:21.128439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:21.129683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:21.130404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:21.348155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:21.362749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:21.366044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:21.381219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d91a1f6b-0b08-4d95-9f91-865d8af59575 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.282477 Oct 10 10:41:21.383858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 480/1081] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:21 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:41:21.405210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:21.405210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:21.414342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:21.414841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:21.415320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:21.416045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:21.416508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:21.420440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.052467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:22.072111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:22.078070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:22.080370 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-420d4815-f82f-4410-807c-f1053c8ef215 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.695406 Oct 10 10:41:22.082876 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 481/1082] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:21 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:22.097007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b57dde-042b-478c-9f69-4d951d1fe75d", "name": "network-vif-plugged", "status": "completed", "tag": "fdbb525f-1194-4b63-b390-f7231402a12e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:22.130916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.134590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.135859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.157747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] Creating event network-vif-plugged:fdbb525f-1194-4b63-b390-f7231402a12e for instance 98b57dde-042b-478c-9f69-4d951d1fe75d on n-h1-860687-2 Oct 10 10:41:22.164569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-16110c34-408f-4876-809c-95ba7d1f854f req-ac7093a7-3f12-4ec3-8d04-0355302b0800 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079566 Oct 10 10:41:22.170328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 482/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:22.176529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:22.178948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:22.187763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.189018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.189847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.190942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.191660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.192308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.412585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:22.422462 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5f11ec4-56ee-4e07-900b-40c759ada04a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1276 microversion: 2.1 time: 0.250322 Oct 10 10:41:22.424788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 483/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:22 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:22.443341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:22.446387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:22.462801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.462801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.463448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.464522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.465878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.467306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.892536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:22.900933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c49d44c7-0e20-46e3-88e1-e14f92c8cc4d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1317 microversion: 2.1 time: 0.474713 Oct 10 10:41:22.901514 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 484/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:22 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:22.907191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:22.908134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:22.916742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.917583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.918289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:22.919291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:22.919788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:22.920270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:23.263188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.280098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.282376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.290982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-504bd3e9-69e7-4325-bab2-d8b664fd25ce tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.388153 Oct 10 10:41:23.291883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 485/1086] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:22 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:23.297640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:23.298586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:23.305687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:23.306271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:23.306786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:23.308154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:23.308893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:23.309385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:23.787608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.797327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.798919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:23.800249 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa1da471-d300-48c2-954d-5d77f640c3bf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.507280 Oct 10 10:41:23.800932 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 486/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:23 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:23.825062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:23.825731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:23.836123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:23.837208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:23.837821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:23.838859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:23.839622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:23.840239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.005735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:24.016336 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58780b7c-d46b-4145-8d53-1815ee50bec8 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1276 microversion: 2.1 time: 0.204258 Oct 10 10:41:24.021143 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 487/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:23 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:24.023967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:24.024541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:24.033643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.034149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.034593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.035364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.035825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.036257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.322619 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e876412-32cb-48b0-9062-c2548d7d3666 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.930968 Oct 10 10:41:24.324581 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 602/1089] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:41:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:24.339330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:24.341227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:24.348187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.348673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.349100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.350169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.350778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.351504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.472813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:24.483919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:24.488198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:24.499373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e366ca05-a2c9-4449-8300-0bb2ef7e4f64 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.169921 Oct 10 10:41:24.514675 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 603/1090] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:24 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:24.531127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cbe23fc7-da89-45e0-9d59-830402a9c754 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Action: 'create', calling method: .version_select at 0x7f677c841d30>, body: {"pool": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:24.539126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:24.548366 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b1a664c-58c4-4cce-aeb9-1708da04cd08 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1466 microversion: 2.1 time: 0.529664 Oct 10 10:41:24.562565 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 488/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:24 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1466 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:24.579733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:24.580707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:24.589709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.590589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.591285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:24.593227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:24.594711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:24.595840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:25.101069 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-840a2813-e791-4343-8258-20f788f93779 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1617 microversion: 2.1 time: 0.530108 Oct 10 10:41:25.101670 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 489/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:24 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1617 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:25.107362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:25.108252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:25.114560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:25.118073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:25.119959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:25.120580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:25.124195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:25.125978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:25.126828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:25.936369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:25.950472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:25.953228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:25.954655 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ede7cbbd-d633-43bd-93c5-7f7a4ed925bc tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.851748 Oct 10 10:41:25.960356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 490/1093] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:25 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:25.978351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:25.985148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:25.999465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:26.000189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:26.000888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:26.001771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:26.002439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:26.003182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:26.396899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:26.406648 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9341017-decf-427f-b50b-95671e1bfdf4 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.444951 Oct 10 10:41:26.408054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 491/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:25 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:26.415263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-306524799", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["aa0eb006-0f97-46a3-80e9-f0eb428e91b2"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:26.487684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:41:27.190514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:41:27.191205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:41:27.191655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:41:27.192751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:41:27.193244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:41:27.206070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.206637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.207195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:27.208041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.208569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.209216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:27.231444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:27.238122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:27.252021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:41:27.255124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:41:27.320173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6144e66-1834-4e0e-8bb3-7ba8f142b3cc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910406 Oct 10 10:41:27.321199 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 492/1095] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:41:27.327736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:27.329197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:27.348191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.349390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.350769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:27.351738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.352411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.353718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:27.501112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:27.510725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:27.512211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:27.523837 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ddbe39e-ace3-4a2e-a4b5-e43174c754b2 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.200992 Oct 10 10:41:27.539993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 493/1096] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:27 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:27.562606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:27.563252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:27.569353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.570042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.570666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:27.571389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:27.572015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:27.572592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.097986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:28.108891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:28.110584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:28.122390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a1afbd4-a092-4543-b0f8-a2d0a9bc7171 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.580241 Oct 10 10:41:28.123452 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 494/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:27 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:28.140029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:28.140933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:28.151682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.152220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.152797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.153400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.154434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.154859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.172844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:28.350049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:28.362824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b920908-01c8-4a26-9518-9130e5b8ec45 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1220 microversion: 2.1 time: 0.238100 Oct 10 10:41:28.364204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 495/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:28 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1220 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:28.373640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:28.374472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:28.383984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.385047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.385883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.387564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.388925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.391860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.633578 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cbe23fc7-da89-45e0-9d59-830402a9c754 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.116878 Oct 10 10:41:28.649087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 604/1099] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:41:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:28.655117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52a4233-2ee4-4636-8119-c88a2c03deca", "tag": "b2c9fff4-8307-4d29-872f-2d0670a636fe"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:28.692205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.692965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.693518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.708625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] Creating event network-changed:b2c9fff4-8307-4d29-872f-2d0670a636fe for instance b52a4233-2ee4-4636-8119-c88a2c03deca on n-h2-860687-2 Oct 10 10:41:28.714616 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3f81b00b-9719-4093-b2cb-c291162ea9a5 req-7da1e0a3-1884-42f0-8b14-0d74f29493a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063950 Oct 10 10:41:28.717394 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 605/1100] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:28.722669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:28.723391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:28.737682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.740922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.745753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.749648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:28.750766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:28.756979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:28.794848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:28.807219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b587a84d-c087-4241-b1fc-40afce973225 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.441182 Oct 10 10:41:28.823398 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 496/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:28 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:28.838961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eee814e4-bac6-44c2-a343-ac7912c02ce2 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Action: 'create', calling method: .version_select at 0x7f677cc55ca0>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:29.235711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.244846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.246533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.252981 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47108615-0bb2-4ad1-bd48-595a744472e8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.534005 Oct 10 10:41:29.254123 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 606/1102] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:28 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:29.259076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:29.259896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:29.266828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:29.268867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.269644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.270235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:29.271410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.272018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.272593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:29.426066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:29.623475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.636580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.639742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.648862 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d0c39ee-71d2-4dc3-9e69-88c2e9e163cf tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.393394 Oct 10 10:41:29.652043 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 607/1103] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:29 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:29.664749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:29.665708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:29.672469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.673416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.674095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:29.675073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.675771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.676436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:29.838685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:29.847540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14dae969-1551-4ece-abfa-c466b0ac0b8e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1276 microversion: 2.1 time: 0.193975 Oct 10 10:41:29.848453 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 608/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:29 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:29.854120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:29.855774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:29.861892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.862652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.863349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:29.865936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:29.866641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:29.867356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:30.240049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:30.249035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d5613fc-1baf-4b64-8db7-a359e0317df9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.399218 Oct 10 10:41:30.255362 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 609/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:29 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:30.260406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "name": "network-vif-unplugged", "status": "completed", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:30.289062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:30.289542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:30.289976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:30.308476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] Creating event network-vif-unplugged:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h2-860687-2 Oct 10 10:41:30.317486 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-72ef7ca4-a219-4d5d-af52-264b2b278f50 req-1e07251c-b77a-447e-8a60-5260cd2caa67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060511 Oct 10 10:41:30.318895 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 610/1106] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:30.326352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:30.327511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:30.338888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:30.339822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:30.340510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:30.341592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:30.342665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:30.343351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:30.375756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:30.495131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:30.510052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:30.512132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:30.531096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e94caaf-16ef-4437-9016-4a83e66b3ce7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.210655 Oct 10 10:41:30.552337 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 611/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:30 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:30.678687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:30.679318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:30.685800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:30.686286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:30.687115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:30.688112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:30.688812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:30.689429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.111419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:31.127803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:31.130505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:31.133164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-132e6314-73c0-4a66-a66f-bdc1cbcc5dd6 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.459744 Oct 10 10:41:31.134973 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 612/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:30 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:31.148107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:31.149092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:31.159321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.162836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.163595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.165277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.166086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.166758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.340184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:31.358657 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8288c26f-a24a-452a-bd88-622862fee501 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1274 microversion: 2.1 time: 0.221367 Oct 10 10:41:31.380837 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 613/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:31 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:31.396392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:31.397856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:31.408096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.409647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.410346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.411354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.412796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.413492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.884134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:31.904276 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-21116b07-3f06-4031-939e-804f6535b90a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.514535 Oct 10 10:41:31.905513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 614/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:31 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:31.913795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:31.914537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:31.949552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.950312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.954429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:31.955792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:31.957094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:31.959472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.214290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.229828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.231586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.245436 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46ecf4f2-185b-457e-8299-fcff3e0049b4 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.338755 Oct 10 10:41:32.246653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 615/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:31 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:32.257278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:32.259795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:32.274240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:32.275101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:32.275745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.276683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:32.277350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:32.285269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.689368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.698402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.704912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:32.706144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-60fec0f6-5ed7-4b51-b961-5f96fbace46a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.457772 Oct 10 10:41:32.706715 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 616/1112] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:32 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:32.718735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:32.737352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:32.744190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:32.745315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.776218 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] Creating event network-changed:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h2-860687-2 Oct 10 10:41:32.788772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f14468e2-1430-4cc4-bac7-f016e64f516a req-f3b42b16-e2a0-41f1-a558-04d8a9f0cbfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080803 Oct 10 10:41:32.789886 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 617/1113] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:32.803086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:32.804041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:32.822715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:32.823265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:32.823688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.824391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:32.824850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:32.825273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:32.850184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:33.605719 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eee814e4-bac6-44c2-a343-ac7912c02ce2 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.789345 Oct 10 10:41:33.607820 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 497/1114] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:41:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:33.615982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:33.617130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:33.628241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:33.629203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:33.630483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:33.631621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:33.632404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:33.633053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:33.700060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:33.719274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-275a6828-bd2a-436f-888a-982c148efb91 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.927871 Oct 10 10:41:33.724670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 618/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:32 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:33.740635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:33.741493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:33.750174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:33.750579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:33.751041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:33.752219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:33.753038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:33.754629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:33.988309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.007058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.014412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.029945 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be510839-6d5d-4f6d-a7fd-b164fd40621b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.303453 Oct 10 10:41:34.032112 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 619/1116] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:33 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:34.066405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a34daf8c-4192-439f-8e0e-53af015c6dd8 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677c8388b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:34.315918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.334388 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b969eda-4ba2-4c3d-b7f2-fccc6d9958cf tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.725083 Oct 10 10:41:34.357441 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 498/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:33 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:34.370555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:34.371902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:34.387771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:34.388342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:34.388784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:34.389499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:34.389947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:34.390366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:34.669127 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a34daf8c-4192-439f-8e0e-53af015c6dd8 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/d352165e-d79f-477e-8d93-b85744f49434" status: 200 len: 142 microversion: 2.1 time: 0.613257 Oct 10 10:41:34.679036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 620/1118] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:41:34 2022] GET /compute/v2.1/os-floating-ips/d352165e-d79f-477e-8d93-b85744f49434 => generated 142 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:34.762227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.777056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.779467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:34.781205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8516902-8ffc-4d72-9868-421938ae9a47 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.422546 Oct 10 10:41:34.782316 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 499/1119] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:34 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:34.789683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93fa9134-1b93-40df-b34f-9d45da3247d1 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677c9f3f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:35.031693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00fbdefa-9165-41c9-8416-69d02e43928d tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Action: 'create', calling method: .version_select at 0x7f677c838700>, body: {"keypair": {"name": "tempest-keypair-1023684588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkSs5ebtvpIGMdPLEN44wAnuqCDWNVoqiSd4qHMZJ9Hsp4qAUDlujBTRojDR/fG+vUS0PNmTu3XOibuVkO9FhEq8Yl0KFrdO9Feg3cibmL24wpVYAkKSJTQMYM8NF2Hrw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:35.049905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-00fbdefa-9165-41c9-8416-69d02e43928d tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for project f24f5e216c7a4633b963f573721ba9bd. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:35.055365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-00fbdefa-9165-41c9-8416-69d02e43928d tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for user 7507ba987c4f41798019dd0e460ebf2c and project f24f5e216c7a4633b963f573721ba9bd. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:35.084126 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00fbdefa-9165-41c9-8416-69d02e43928d tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.403938 Oct 10 10:41:35.085206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 621/1120] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:41:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:35.090868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:35.092660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:35.099709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:35.100594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:35.101181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:35.102119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:35.102986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:35.103668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:35.604502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:35.616416 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af801911-5acf-43c1-ac4d-3261b9cf6650 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.529795 Oct 10 10:41:35.617853 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 622/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:35 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:35.683039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1026504801", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:35.746984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:41:36.298506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:41:36.300571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:41:36.301627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:41:36.302306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:41:36.303328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:41:36.323826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.324698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.326125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.327572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.328281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.328954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.352184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:36.369780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:36.396425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:41:36.399505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:41:36.471853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-99330c26-b690-4eb9-b54f-d4e2fdf7ffde tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852468 Oct 10 10:41:36.474558 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 623/1122] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:41:36.487146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:36.489296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:36.534971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.535539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.536070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.537500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.537962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.538390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.652904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:36.666398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:36.667892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:36.673849 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ed3b999-8406-47bd-9ef3-6f5e55f747c1 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.195309 Oct 10 10:41:36.674421 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 624/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:36 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:36.681199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdfef6ea-4d93-40a2-bb42-e82261106659", "tag": "f21bd547-8b3e-4158-9ef0-fad0498458bc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:36.688393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93fa9134-1b93-40df-b34f-9d45da3247d1 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d352165e-d79f-477e-8d93-b85744f49434" status: 202 len: 0 microversion: 2.1 time: 1.904602 Oct 10 10:41:36.694367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 500/1124] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:41:34 2022] DELETE /compute/v2.1/os-floating-ips/d352165e-d79f-477e-8d93-b85744f49434 => generated 0 bytes in 1911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:36.701949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:36.703265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:36.714890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.715405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.721842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.722222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.722652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.727092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.729902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.730387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.730817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.746156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] Creating event network-changed:f21bd547-8b3e-4158-9ef0-fad0498458bc for instance fdfef6ea-4d93-40a2-bb42-e82261106659 on n-h1-860687-2 Oct 10 10:41:36.774069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2661176a-64fa-470d-b904-4e12ebd28be1 req-8ab73af1-ea39-4e5d-ad32-9e9d8a015767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098137 Oct 10 10:41:36.775203 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 625/1125] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:36.790935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:36.792084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:36.822635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.828361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.830450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:36.832362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:36.833578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:36.834611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.220765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:37.245146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:37.320539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.329636 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-594017ad-8462-4693-8b32-c68d924db08b tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.634009 Oct 10 10:41:37.330777 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 501/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:36 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:37.335793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:37.336669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:37.344881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.345664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.346512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.347458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.349081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.349858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.382931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.392817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.398189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.405578 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-910dcf0f-05c5-4f2d-9429-fa7a7bb5cf2f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.628450 Oct 10 10:41:37.406326 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 626/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:36 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:37.420765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:37.421402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:37.437686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.438558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.439252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.440189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.440723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.441411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.446383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.457029 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9636dd22-d171-4545-a41e-2d08902c713c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1209 microversion: 2.1 time: 0.124855 Oct 10 10:41:37.458006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 502/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:37 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:37.464570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-215af1f0-ee03-4fc1-a81f-9f138489c5e2 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677ca10160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:37.753866 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-215af1f0-ee03-4fc1-a81f-9f138489c5e2 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.294748 Oct 10 10:41:37.754454 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 503/1129] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Oct 10 10:41:37 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:41:37.759344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a4233-2ee4-4636-8119-c88a2c03deca", "name": "network-vif-plugged", "status": "completed", "tag": "b2c9fff4-8307-4d29-872f-2d0670a636fe"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:37.775740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.776316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.776837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.790419 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] Creating event network-vif-plugged:b2c9fff4-8307-4d29-872f-2d0670a636fe for instance b52a4233-2ee4-4636-8119-c88a2c03deca on n-h2-860687-2 Oct 10 10:41:37.801331 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4d2495c2-9784-4d91-be6e-99b9ba5bbbc7 req-591d869c-d0b7-435e-bcf8-57061c46625d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045246 Oct 10 10:41:37.805615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 504/1130] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:37.814605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1509909018", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "455efde7-a929-4a8f-9677-f689a9e175c4"}], "security_groups": [{"name": "tempest-securitygroup--1700520589"}], "key_name": "tempest-keypair-1023684588", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:37.833155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:37.845962 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-886eb830-951c-46db-942e-96ca3f7c60b6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.438539 Oct 10 10:41:37.847654 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 627/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:37 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:37.852924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:37.853640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:37.862327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.863276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.867949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:37.871093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:37.873372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:37.874245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:38.102220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:38.118934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:38.127185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:38.144629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e7ecb69-26ac-4a7f-ac98-fcf89a6f2598 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.295165 Oct 10 10:41:38.147726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 628/1132] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:37 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:38.161907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed900210-ddf4-45ea-86c4-cdc4953e3029 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677c820700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:38.193973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] validate_networks() for [('455efde7-a929-4a8f-9677-f689a9e175c4', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:41:38.869234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed900210-ddf4-45ea-86c4-cdc4953e3029 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.719090 Oct 10 10:41:38.871433 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 629/1133] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:41:38 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:38.878453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:38.879456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:38.891033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:38.892130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:38.892832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:38.894691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:38.895700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:38.896402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.317339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:39.327706 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7eadbcef-0fb9-4bed-bf6b-07f7535ef079 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1318 microversion: 2.1 time: 0.453569 Oct 10 10:41:39.328494 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 630/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:38 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:39.349071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:39.349684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:39.364769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.365261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.365695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.366695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.366829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.367870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.607915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for project f24f5e216c7a4633b963f573721ba9bd. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:39.613714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for user 7507ba987c4f41798019dd0e460ebf2c and project f24f5e216c7a4633b963f573721ba9bd. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:39.629335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:41:39.629993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:41:39.630993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:41:39.631714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:41:39.632929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:41:39.643676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.644169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.644792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.645700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.646325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.646761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.666159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for project f24f5e216c7a4633b963f573721ba9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:39.673183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Getting quotas for user 7507ba987c4f41798019dd0e460ebf2c and project f24f5e216c7a4633b963f573721ba9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:39.683754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:39.689341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:41:39.691957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:41:39.706386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:39.710663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:39.712258 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82bb6d26-31fe-4014-a2cb-1410af07dfce tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.368157 Oct 10 10:41:39.726265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 631/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:39 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:39.734464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:39.735217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:39.741846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.742351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.742799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.743543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.744002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.744428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.756265 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc391225-8e36-4447-b514-051336b41ac4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.948522 Oct 10 10:41:39.757286 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 505/1136] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:41:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:41:39.761965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:39.762644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:39.787800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.788679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.794772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:39.796107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:39.796753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:39.797345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:40.298737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:40.315344 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db43e383-319e-441d-9542-94931f532847 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1271 microversion: 2.1 time: 0.587442 Oct 10 10:41:40.318652 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 632/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:39 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1271 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:40.335779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0eb862c3-b08c-4999-9df6-732d4618bd89 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677c8388b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:40.631088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:40.642738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91f0c399-281c-40f0-9a7c-181e115b4a5a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.884188 Oct 10 10:41:40.660266 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 506/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:39 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:40.667127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:40.668275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:40.675960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:40.676692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:40.677295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:40.678160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:40.678767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:40.680114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:40.828806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:40.838353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:40.840077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:40.847839 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6864b5a7-7d3b-49af-8d58-7ea9517129b5 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.186240 Oct 10 10:41:40.848431 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 507/1139] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:40 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:40.853970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:40.854589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:40.862176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:40.862765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:40.863519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:40.864518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:40.865382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:40.866154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:41.030569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:41.039280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cdda8c1-f2ce-400b-9529-a35a92b4e323 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1330 microversion: 2.1 time: 0.188825 Oct 10 10:41:41.039862 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 508/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:40 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:41.045287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:41.046117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:41.052546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:41.053261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:41.053868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:41.054767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:41.055456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:41.056094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:41.522992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:41.535339 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c16cf6a-4415-4531-85db-1c8b5c60fb41 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1507 microversion: 2.1 time: 0.494414 Oct 10 10:41:41.536709 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 509/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:41 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:41.543387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:41.544119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:41.550404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:41.550884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:41.551351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:41.552079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:41.552762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:41.553209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.097982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b51eb8bb-0811-47f8-9f36-2b7c125de708 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1813 microversion: 2.1 time: 0.559788 Oct 10 10:41:42.099887 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 510/1142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:41 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1813 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:42.109219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:42.110267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:42.118732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.120400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.121568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.123619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.124350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.125420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.797205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:42.814933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:42.819976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:42.827898 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0eb862c3-b08c-4999-9df6-732d4618bd89 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/98018a00-74ea-4dc0-9d1d-a454c891d763" status: 202 len: 0 microversion: 2.1 time: 2.507900 Oct 10 10:41:42.830848 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 633/1143] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:41:40 2022] DELETE /compute/v2.1/os-floating-ips/98018a00-74ea-4dc0-9d1d-a454c891d763 => generated 0 bytes in 2511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:42.835562 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-700bbcef-73f8-4442-b4aa-9db502748ed2 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.722786 Oct 10 10:41:42.836802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:42.837709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:42.837974 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 511/1144] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:42 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:42.845343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:42.845999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.846415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:42.847168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.848090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.849065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.850347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.851599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.855667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.856159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.857585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:42.859193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:42.859884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:42.860620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.680151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:43.691287 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39a4ebd0-3c29-47f8-84d3-85cebd202c5b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.852024 Oct 10 10:41:43.692969 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 512/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:42 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:43.699122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:43.699809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:43.711676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.712859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.713517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.714608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.716455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.717458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.725771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:43.746606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4ffc0c6-0000-457e-af4a-5b0d6381576d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.913193 Oct 10 10:41:43.747647 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 634/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:42 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:43.768765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:43.769800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:43.777371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.778122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.778727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.779812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.780449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.781037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.819737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:43.831219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:43.841129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:43.847503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ede3c3e-2c29-408c-bfd3-80dc5ab4d292 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.152892 Oct 10 10:41:43.849143 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 513/1147] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:43 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:43.875170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:43.879041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.879779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.880380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.881454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:43.882103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:43.882728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:43.910080 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44f2080e-9f1b-490b-9887-75ddddc2e7c3 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040025 Oct 10 10:41:43.910945 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 514/1148] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:41:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:43.916239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dace60e-0b9e-479d-a67a-477a14f958aa tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677ca53310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:44.018076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:44.032184 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45d6f6fe-ff23-4602-9147-a921ae703fed tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1404 microversion: 2.1 time: 0.267189 Oct 10 10:41:44.033134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 635/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:43 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1404 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:44.056756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd919caf-b177-4283-bb83-a4355b93bd0b", "tag": "2b13fdbd-0871-4a21-9de3-47a2290f5c78"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:44.072827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.073703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.074347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.097467 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] Creating event network-changed:2b13fdbd-0871-4a21-9de3-47a2290f5c78 for instance fd919caf-b177-4283-bb83-a4355b93bd0b on n-h2-860687-2 Oct 10 10:41:44.103291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-23b345cc-24a6-4ca4-8145-89d156241675 req-c3ae9c6b-5d5c-4f4e-a023-b1bb96ebf32f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051288 Oct 10 10:41:44.105641 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 636/1150] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:44.113439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfef6ea-4d93-40a2-bb42-e82261106659", "name": "network-vif-plugged", "status": "completed", "tag": "f21bd547-8b3e-4158-9ef0-fad0498458bc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:44.125633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.126501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.127188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.140730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] Creating event network-vif-plugged:f21bd547-8b3e-4158-9ef0-fad0498458bc for instance fdfef6ea-4d93-40a2-bb42-e82261106659 on n-h1-860687-2 Oct 10 10:41:44.148122 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1a1f5fdf-ccd8-4986-ba7e-839b6831fb18 req-0cb6ef40-cfdf-44c8-b3b9-fe294def7645 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038622 Oct 10 10:41:44.153718 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 637/1151] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:44.163457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:44.164453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:44.172134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.173005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.173660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.174799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.175491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.176159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.783877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:44.794687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:44.796537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:44.797960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dbed79ee-0fdb-4b0f-a95d-ff7808eea776 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1815 microversion: 2.25 time: 0.642747 Oct 10 10:41:44.798731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 638/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:44 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1815 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:44.821973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "420d460f-2384-4c6c-b886-9d0e029a773e"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:44.824665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:44.831650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.832487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.833132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.834103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.834772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.835431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.915791 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] HTTP exception thrown: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Request method failure captured: Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca/os-volume_attachments/d623d09a-4a98-4698-bd70-3c43ac5ca28f HTTP/1.1 Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 74 Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZhKAfFQTgkgV9-4zjld33nkteycXRfVWMNHVPCPYi8g6CHmQp4OXGlX3sQ0QasaqerPGuaRRAXOPji66BYu7hhl00aihkEtisSuHtP35iiZ8jTENBSERtAP9H6Rzxlk3sLsYFUzA4AKS5x4DgwJfxHxYWMjnN_tkXnZl7SMuT56NA Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 9749869d34bd4135a4aea98f898b53fa Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:41:44.918100 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9749869d34bd4135a4aea98f898b53fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9749869d34bd4135a4aea98f898b53fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9749869d34bd4135a4aea98f898b53fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9749869d34bd4135a4aea98f898b53fa"}]}] Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 9749869d34bd4135a4aea98f898b53fa Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-72111872 Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesAdminNegativeTest-72111872-project-admin Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3ee62f964894435b8f33fcb9d00d417a Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesAdminNegativeTest-72111872-project-admin Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: {"volumeAttachment": {"volumeId": "420d460f-2384-4c6c-b886-9d0e029a773e"}} Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:44.919647 n-d-860687-2 devstack@n-api.service[128800]: exception: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'b52a4233-2ee4-4636-8119-c88a2c03deca', 'id': 'd623d09a-4a98-4698-bd70-3c43ac5ca28f', 'body': {'volumeAttachment': {'volumeId': '420d460f-2384-4c6c-b886-9d0e029a773e'}}} Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:41:44.920472 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. (HTTP 404) (Request-ID: req-a200b707-93fd-4531-82f3-a59cb0168718) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:41:44.921575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:44.922735 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. Oct 10 10:41:44.925821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:44.928626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] Returning 404 to user: Volume d623d09a-4a98-4698-bd70-3c43ac5ca28f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:44.928626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d337309d-1bac-4a7b-9f27-219b2b548988 tempest-VolumesAdminNegativeTest-72111872 tempest-VolumesAdminNegativeTest-72111872-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca/os-volume_attachments/d623d09a-4a98-4698-bd70-3c43ac5ca28f" status: 404 len: 109 microversion: 2.1 time: 0.101581 Oct 10 10:41:44.935534 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 639/1153] 10.222.0.16 () {60 vars in 1433 bytes} [Mon Oct 10 10:41:44 2022] PUT /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca/os-volume_attachments/d623d09a-4a98-4698-bd70-3c43ac5ca28f => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:41:44.951835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:44.952470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:44.968928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.971232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.971626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:44.974028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:44.974508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:44.976519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:45.402070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:45.409974 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5a1d69f-fc30-4729-b75e-e58e0d3246bc tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1316 microversion: 2.1 time: 0.473096 Oct 10 10:41:45.410752 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 640/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:44 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:45.434354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:45.435508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:45.442238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:45.442659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:45.443127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:45.444319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:45.444972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:45.445565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:45.989492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.004203 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d78f1d4f-3a49-4795-867e-189bb090885d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.579524 Oct 10 10:41:46.006221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 641/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:45 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:46.023860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:46.024636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:46.035921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.037276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.038610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.039628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.040304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.040946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.048506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:46.274163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.303036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.303036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.311639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:46.320642 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d59eefb8-54e6-4a90-8f8b-fe8f04dab06b tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.307132 Oct 10 10:41:46.339034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 642/1156] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:46 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:46.366491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:46.367719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:46.370076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:46.399638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:46.405399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.409980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.410741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.411864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.413439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.414192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.472730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5dace60e-0b9e-479d-a67a-477a14f958aa tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/b8c9adb8-b8b3-4862-926e-bc2d0bd9a86c" status: 202 len: 0 microversion: 2.1 time: 2.560525 Oct 10 10:41:46.475317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 515/1157] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:41:43 2022] DELETE /compute/v2.1/os-floating-ips/b8c9adb8-b8b3-4862-926e-bc2d0bd9a86c => generated 0 bytes in 2563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:46.482108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:46.510072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.511491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.513566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.533295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] Creating event network-changed:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h2-860687-2 Oct 10 10:41:46.540531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4a28f54c-2722-4840-8b81-fe4ac6840dc5 req-bc2a6d26-5f16-459d-a338-16cf79d4b13b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063749 Oct 10 10:41:46.541388 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 516/1158] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:46.553661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:46.554620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:46.569630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.570414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.571507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.575538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.575714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.579222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.782095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.807643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66df4d04-4f66-45bf-af27-6da02a5760a1 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1404 microversion: 2.1 time: 0.478391 Oct 10 10:41:46.808282 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 643/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:46 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:46.825268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:46.826124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:46.838707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.841199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.841933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.842672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:46.843175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:46.843626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:46.924388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.939405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.943916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:46.948026 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a0ec604-e05e-4b59-917b-dc9aa4ac8fe7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1805 microversion: 2.25 time: 0.399088 Oct 10 10:41:46.951591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 517/1160] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:46 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1805 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:46.964756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b44391e8-a218-45fa-8c81-49c0f2c85657 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] Calling method '.version_select at 0x7f677ca273a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:47.257700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:47.269882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6dbaced0-534f-414b-8a2b-28dea20a0ef4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1465 microversion: 2.1 time: 0.460428 Oct 10 10:41:47.270785 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 644/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:46 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1465 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:47.278942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3d8ae4d-c6c9-49c2-9cff-d475afc6ce05", "device": "/dev/xvdb"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:47.300840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:47.326766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:47.327297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:47.338599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:47.342763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:47.346731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:47.347763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:47.947382 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55a2d2a1-dc40-4424-a9f0-742eef43ecf9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673203 Oct 10 10:41:47.949313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 645/1162] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:41:47 2022] POST /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:47.972395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9fa3f2fc-cdac-4149-9ca5-8fc8a7f97dcd tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '.version_select at 0x7f677c92a700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:47.978244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fa3f2fc-cdac-4149-9ca5-8fc8a7f97dcd tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:47.979091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fa3f2fc-cdac-4149-9ca5-8fc8a7f97dcd tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:47.979839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fa3f2fc-cdac-4149-9ca5-8fc8a7f97dcd tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:47.995665 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9fa3f2fc-cdac-4149-9ca5-8fc8a7f97dcd tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.043786 Oct 10 10:41:48.007104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 646/1163] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Oct 10 10:41:47 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:48.016808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:48.018143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:48.026498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.028660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.029655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.030649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.031338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.031950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.437684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:48.447483 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-448875e8-8bee-4978-ab87-4988448c24fc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.441086 Oct 10 10:41:48.448456 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 647/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:48 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:48.460231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:48.461043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:48.478811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.480126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.482350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.486581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.488057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.489183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.784573 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-141d5486-e11c-4e5b-b3d5-5177526f12a0 tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1616 microversion: 2.1 time: 0.332145 Oct 10 10:41:48.798632 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 648/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:48 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1616 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:48.798632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:48.798632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:48.804191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.804191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.804191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.804191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:48.804647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:48.805016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:48.978484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:48.991181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:48.994363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:49.008736 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48c805be-5ba6-45f8-ad84-a91b48a5f0b3 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.217990 Oct 10 10:41:49.009906 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 649/1166] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:48 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:49.022106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:49.023626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:49.038294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.041414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.044692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.047443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.048181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.049395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.114192 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b44391e8-a218-45fa-8c81-49c0f2c85657 tempest-FloatingIPDetailsTestJSON-541278467 tempest-FloatingIPDetailsTestJSON-541278467-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/7bda3525-0529-4046-b358-ff55084b931a" status: 202 len: 0 microversion: 2.1 time: 2.161093 Oct 10 10:41:49.115951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 518/1167] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:41:46 2022] DELETE /compute/v2.1/os-floating-ips/7bda3525-0529-4046-b358-ff55084b931a => generated 0 bytes in 2163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:49.123751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:49.124363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:49.140672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.145580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.146318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.147543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.148987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.149604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.200768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:49.432540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:49.464691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:49.478894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e5adbc4-5090-4b27-9473-b3b8164153ae tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1404 microversion: 2.1 time: 0.467896 Oct 10 10:41:49.492102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b55faff1-209e-47a3-9859-437e98177263 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 2424 microversion: 2.25 time: 0.374691 Oct 10 10:41:49.507022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 519/1169] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:49 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 2424 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:49.507022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1433138162", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "aa0eb006-0f97-46a3-80e9-f0eb428e91b2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:49.507314 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 650/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:49 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:49.520579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd919caf-b177-4283-bb83-a4355b93bd0b", "name": "network-vif-plugged", "status": "completed", "tag": "2b13fdbd-0871-4a21-9de3-47a2290f5c78"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:49.546421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.546924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.547396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.579562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] Creating event network-vif-plugged:2b13fdbd-0871-4a21-9de3-47a2290f5c78 for instance fd919caf-b177-4283-bb83-a4355b93bd0b on n-h2-860687-2 Oct 10 10:41:49.593683 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5a7f5f72-0b20-4771-85ae-3c98ca8b3257 req-62251fb6-5ca0-438c-a691-57310be414b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085599 Oct 10 10:41:49.594484 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 651/1170] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:49.600140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:49.600897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:49.608144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.608683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.609104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.609825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:49.610286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:49.611190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:49.652185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:41:49.686900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:50.072751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:50.084633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1591ebfb-d290-471b-b907-f54c9ec2a350 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.489120 Oct 10 10:41:50.087819 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 652/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:49 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:50.100317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:50.103487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:50.119501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.120001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.122409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.125509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.126165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.127770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.148981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:41:50.150068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:41:50.150742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:41:50.151359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:41:50.151944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:41:50.183071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.183788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.185072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.185997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.189401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.190363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.228771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:50.256373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:41:50.285325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Getting quotas for user 4bc180d4e9c14f57aec00e9ecd39beab and project 5cdb4c8a48cf45fb8c04cfc22387099f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:41:50.331980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:41:50.337340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:41:50.488015 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94dc3c52-1d4b-4109-98f8-446465f4dffe tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987421 Oct 10 10:41:50.494865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 520/1172] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:41:50.500106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:50.500623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:50.520058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.520574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.521016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.521731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.522191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.522618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.571336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:41:50.685271 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fea25281-754f-4770-a264-beb263a7e847 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 204 len: 0 microversion: 2.1 time: 0.193497 Oct 10 10:41:50.686402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 521/1173] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:41:50 2022] DELETE /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:50.700979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:50.703732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:50.719746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.721728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.722465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.724813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:50.726257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:50.727361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:50.868342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:50.881876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:50.889392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:50.905559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53aae8d2-3b8c-4830-90ce-9e3bbca9d69d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.217144 Oct 10 10:41:50.920855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 522/1174] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:50 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:50.930378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-825c4b2c-9be7-4af9-8303-a296290e376b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:50.953927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-825c4b2c-9be7-4af9-8303-a296290e376b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:50.999600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:51.030243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9592ceac-6e20-4e54-88af-1323bd372290 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 2424 microversion: 2.25 time: 0.938719 Oct 10 10:41:51.042218 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 653/1175] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:50 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 2424 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:51.072576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:51.076297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:51.110829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.113593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.115779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.116703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.119269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.119927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.158986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-825c4b2c-9be7-4af9-8303-a296290e376b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:51.166327 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-825c4b2c-9be7-4af9-8303-a296290e376b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1217 microversion: 2.1 time: 0.244176 Oct 10 10:41:51.166944 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 523/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:50 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:51.178726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:51.179381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:51.213679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.214430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.215959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.217623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.218317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.218955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.544329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:51.556020 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a407eb60-0ced-4ed8-a332-810b5381756a tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1404 microversion: 2.1 time: 0.512337 Oct 10 10:41:51.557370 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 654/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:51 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:51.562889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:51.563608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:51.573775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.575821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.577762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.578831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.581544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.583310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.595769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:51.614527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-604331f8-fc6e-415b-a85d-c9f7cf222ee6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1513 microversion: 2.1 time: 0.438972 Oct 10 10:41:51.616206 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 524/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:51 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:51.621404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:51.621958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:51.636806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.637377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.637825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.638534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.639058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.639459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.777985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:51.788199 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-25279dc0-614f-42fb-89c2-4863b1ac6ad7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.229975 Oct 10 10:41:51.808605 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 655/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:51 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:51.814901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "name": "network-vif-plugged", "status": "completed", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:51.838026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.838516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.838958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.864523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] Creating event network-vif-plugged:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h2-860687-2 Oct 10 10:41:51.882906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-399b1778-8796-4fe9-afa6-2bb69f9b6408 req-9f42c9dc-ca44-4c14-a186-49fb64097b72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072306 Oct 10 10:41:51.886647 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 656/1180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:51.944519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:51.946351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:51.957982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.960132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.961718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:51.974091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:51.975571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:51.977195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.025153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lazy-loading 'services' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:52.122612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:52.141593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:52.143641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:52.153848 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fdf24c84-4055-4148-bfeb-37ded9b32bf8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.214805 Oct 10 10:41:52.172078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 657/1181] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:51 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:52.204317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:52.207220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:52.231762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.234024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.236916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.239055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.240354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.242152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.317082 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb47e2d3-6178-4b5b-893c-85ae2e9aaf41 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments/fa463e7f-1c9b-4183-82f5-c6aaf7143c48" status: 202 len: 0 microversion: 2.25 time: 0.699322 Oct 10 10:41:52.318013 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 525/1182] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 10 10:41:51 2022] DELETE /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments/fa463e7f-1c9b-4183-82f5-c6aaf7143c48 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:41:52.327265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:52.342050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:52.364875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.365381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.366000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.366725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.377404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.377912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.402487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:52.422395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b7cca40-5a2c-4bf8-ab5f-67e12b2a71c6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1213 microversion: 2.1 time: 0.228191 Oct 10 10:41:52.424167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 658/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:52 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1213 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:52.495580 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4101063-22b4-451b-ba92-f6f78421b5af tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.173104 Oct 10 10:41:52.509764 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 526/1184] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:52 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:52.582545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:52.584150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:52.594696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.600212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.600865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.607270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.609312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.610336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.641781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:52.642710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:52.657537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.665935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.666973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.671017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:52.671777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:52.672311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:52.682241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:53.041311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.067374 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2218f80e-303a-48d5-a172-8d9a11a2b7ff tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1404 microversion: 2.1 time: 0.490029 Oct 10 10:41:53.080211 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 659/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:52 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:53.082346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:53.083054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:53.093457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.094453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.094959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.095434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.096377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.097465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.098220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.121896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af37b4e3-2098-4171-a0c5-31156a42b008 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1513 microversion: 2.1 time: 0.483925 Oct 10 10:41:53.124236 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 527/1186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:52 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:53.186725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:53.187731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:53.197792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.201766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.202455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.203721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.207817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.208592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.334442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.350099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.359056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.373968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5b6c81d-f424-4d6e-a259-c67f220b7c97 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.192592 Oct 10 10:41:53.387032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 528/1187] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:53 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:53.450217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:53.451030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:53.463534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.464864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.467156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.471146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.471752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.472372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.878072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.891973 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d1568de-83a7-4727-8d29-5c4b97362939 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1313 microversion: 2.1 time: 0.822362 Oct 10 10:41:53.914781 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 660/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:53 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:53.928941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:53.937231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:53.949064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.955697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:53.963356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.964014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.964801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:53.965018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bda5928-8a4c-4ef9-8c98-bd30d62ada7b tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1269 microversion: 2.1 time: 0.520216 Oct 10 10:41:53.965826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:53.966257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:53.967856 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 529/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:53 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1269 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:54.053083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d395506c-00a0-4ba8-aeab-bda74ed6db84 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134055 Oct 10 10:41:54.053717 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 661/1190] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:53 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:54.096681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:54.098401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:54.111398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.113208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.113824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.116363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.117924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.118601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.151110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:54.152041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:54.164123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.164916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.168142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.169997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.170755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.172788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.502348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:54.515777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f4770fd-872b-4ebd-bede-356daeb92ad0 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1471 microversion: 2.1 time: 0.365976 Oct 10 10:41:54.518653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 662/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:54 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:54.531574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:54.532204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:54.566878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.568051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.571945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.573318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.574105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.576769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.788764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:54.802702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:54.804495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:54.830093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72f5ce3a-8025-4bb6-a255-61082087e2e0 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.307512 Oct 10 10:41:54.831887 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 663/1192] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:54 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:54.922869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:54.924307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:54.941326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.950992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.952100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.964067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:54.964962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:54.966227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:54.970399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:54.981884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f5739d7-dcb1-43c5-a52a-1fae1a518b90 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1590 microversion: 2.1 time: 0.889668 Oct 10 10:41:54.984420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 530/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:54 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1590 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:55.009972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:55.011672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:55.024948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.025850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.026449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.029523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.030173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.030764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.286611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:55.296854 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e68bc2b-0fc7-4726-aa6e-00d6543df5b9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1275 microversion: 2.1 time: 0.295639 Oct 10 10:41:55.302408 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 531/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:54 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:55.307443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:55.315682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:55.316614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:55.328524 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f30021e-f37f-4328-8cea-83a6c0c0d687 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1463 microversion: 2.1 time: 0.410145 Oct 10 10:41:55.330422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.339167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 664/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:54 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1463 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:55.339749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.350579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.350897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:55.352327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.360103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:55.363718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.364844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.379795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.379795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.379795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.379795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.380273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.380626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.454958 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3eaaa0e3-1b90-4374-8680-6edf229b2c4a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120837 Oct 10 10:41:55.456403 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 665/1196] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:55 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:55.486849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52a4233-2ee4-4636-8119-c88a2c03deca", "name": "network-vif-deleted", "tag": "b2c9fff4-8307-4d29-872f-2d0670a636fe"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:55.500435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.501505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.502363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.537164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] Creating event network-vif-deleted:b2c9fff4-8307-4d29-872f-2d0670a636fe for instance b52a4233-2ee4-4636-8119-c88a2c03deca on n-h2-860687-2 Oct 10 10:41:55.554548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fff2322c-f55d-4ee0-9462-14c6898b465f req-acf96823-9e1f-4032-9137-3038797237cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076451 Oct 10 10:41:55.555380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 666/1197] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:55.688515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:55.689264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:55.703291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.703795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.704234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.704945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.705401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.705823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.879699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f270dd1c-f3d2-4e49-bb6c-189b202c52f6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.575934 Oct 10 10:41:55.881180 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 532/1198] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:41:55 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b/os-interface => generated 285 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:41:55.886526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:55.887925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:55.904595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.905919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.906683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.907715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.908390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.909029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.965984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:55.967132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:55.968241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:55.968914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lazy-loading 'fault' on Instance uuid b52a4233-2ee4-4636-8119-c88a2c03deca {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:41:56.046172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.063935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39a97cff-b934-40ad-b470-11d7c8c68a04 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 200 len: 1308 microversion: 2.1 time: 0.181528 Oct 10 10:41:56.065194 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 533/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:55 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:56.079903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:56.080970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:56.093777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.094608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.095512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.099965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.100698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.101337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.266660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.285677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.292051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.308947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-121dd1cd-478c-44e3-a2df-b38c1f47f872 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.242169 Oct 10 10:41:56.344642 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 534/1200] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:56 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:56.361583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:56.364325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:56.406667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.409413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.409920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.412711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.413668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.414587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.471774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:41:56.537130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.548434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6afb3fa9-e2df-42c1-9f5f-e255f02222cf tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1275 microversion: 2.1 time: 0.202410 Oct 10 10:41:56.549022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 535/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:56 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:56.563990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:56.567610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:56.582400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.582914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.585604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.586376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.586854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.589728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.640762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4a85687-2413-429f-9d7a-06244a7454c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090470 Oct 10 10:41:56.649417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 536/1202] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:56 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:56.743271 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b9c534e-81ea-44f8-80f8-393c6e5ed551 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1614 microversion: 2.1 time: 1.182069 Oct 10 10:41:56.746478 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 667/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:55 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1614 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:56.773128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:56.774146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:56.785387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.789124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.789680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.791111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:56.801121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:56.802696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:56.917663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b5ebe7f2d1146e6adaee015b62d9af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bf9a92754354aa2babcf44a3a8a904f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:56.921242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] flavor_id is None. Assuming migration. {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 10:41:56.922959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 10:41:57.092771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:57.093804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: b52a4233-2ee4-4636-8119-c88a2c03deca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:57.116536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.117268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.123254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.126443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.130668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.134167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.206232 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] HTTP exception thrown: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Request method failure captured: Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca HTTP/1.1 Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZQReBNIGXGkURgftQCHLk9Xn0Wecy-xfU4bnjlcABgxPPX5XyPyDULlngqtoZ_5Ith1a6_JtaDKFL0y3AGRvZT8t5Cyckuj2lGdgziVX7mwZyi8Uzg3pQ1p8O6NhXXCRFGXaEgnHGpy9s-xzv0SFbDs0CBiGwmMs_7HGjcIJZTLNc Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 257f78a524be47438022f1d676de077e Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:41:57.216148 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/257f78a524be47438022f1d676de077e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_257f78a524be47438022f1d676de077e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/257f78a524be47438022f1d676de077e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/257f78a524be47438022f1d676de077e"}]}] Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 257f78a524be47438022f1d676de077e Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesAdminNegativeTest-137025984-project Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8a76a87cf647471a93969cb2dcfb0f12 Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesAdminNegativeTest-137025984-project Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. Oct 10 10:41:57.218189 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b52a4233-2ee4-4636-8119-c88a2c03deca'} Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:41:57.219348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. Oct 10 10:41:57.220905 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:41:57.237374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Returning 404 to user: Instance b52a4233-2ee4-4636-8119-c88a2c03deca could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:41:57.238808 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-540906fa-3d22-46ac-903b-e22d52dd0eee tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca" status: 404 len: 111 microversion: 2.1 time: 0.151282 Oct 10 10:41:57.250670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 668/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:57 2022] GET /compute/v2.1/servers/b52a4233-2ee4-4636-8119-c88a2c03deca => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:41:57.272819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4304ba97-f5de-4d8f-bbfc-d32a2fd3a86a tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5/action" status: 202 len: 0 microversion: 2.1 time: 0.497824 Oct 10 10:41:57.274254 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 537/1205] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:41:56 2022] POST /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:41:57.283398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:57.283889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:57.294396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.296143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.296959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.298801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.299585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.300164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.368267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:57.368854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:57.400793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.401483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.401946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.410226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.411201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.411644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.556589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:57.568305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:57.581985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:57.588221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4806aa9e-7ac6-4d76-8ff4-2314b4fdf645 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.243144 Oct 10 10:41:57.588968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 538/1206] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:57 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:41:57.636761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:57.640924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:57.650300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.650893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.651369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:57.652108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:57.656202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:57.656202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:58.050727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:58.067680 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-641ed270-93a2-4602-af78-813cd3409024 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1472 microversion: 2.1 time: 0.788393 Oct 10 10:41:58.088059 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 669/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:57 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1472 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:41:58.108370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:58.119918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:58.181517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:58.182672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:58.183754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:58.188726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:58.195666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:58.196406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:58.197697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4008402c-fda8-4880-b79d-8625926c76c0 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.571143 Oct 10 10:41:58.198613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:58.212766 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 539/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:57 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:58.303105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-244736a2-47b7-48f2-ac50-b31c16709845 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.213691 Oct 10 10:41:58.304382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 670/1209] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:58 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:58.625191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:58.625967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:58.638965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:58.643715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:58.644524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:58.645539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:58.646235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:58.646906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:58.783220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:58.797730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:58.802432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:58.813666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3074ff4-6402-4ebc-bbff-69f6cd3c6c48 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.195610 Oct 10 10:41:58.828413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 540/1210] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:41:58 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:41:59.096621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:59.097825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:59.108254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.111818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.112487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.113423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.116787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.117436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.180915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74a5d17-3d36-4911-9556-50ba1a8168d0", "tag": "eacf7241-0b09-4e9c-8bf3-1ba7b6c08717"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:41:59.223913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.225790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.226781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.305377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] Creating event network-changed:eacf7241-0b09-4e9c-8bf3-1ba7b6c08717 for instance a74a5d17-3d36-4911-9556-50ba1a8168d0 on n-h2-860687-2 Oct 10 10:41:59.325774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4d2b10d0-bc10-45a9-a0a2-de2bf3f7d424 req-e7179041-a8e4-43da-9933-ba759e3c84de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151508 Oct 10 10:41:59.330453 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 541/1211] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:41:59.347731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:59.349947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:59.366790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.368921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.370722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.374010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.375266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.376779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.672437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:41:59.683405 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5e21ab3-3cc9-4915-8d36-0818a3e7b605 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.348459 Oct 10 10:41:59.684737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 542/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:59 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:41:59.691670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:59.705150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:59.720585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.731823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.732665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.734482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.735701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.736329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.784441 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4a9d099-bc97-42ba-86fe-8fdfe6606efe tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095710 Oct 10 10:41:59.785222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 543/1213] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:41:59 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:41:59.795558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:41:59.796684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:41:59.802896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.803607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.804884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:41:59.805914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:41:59.806521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:41:59.807134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.207806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:00.225931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:00.252055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3aa84f29-6e4e-44bb-8a24-1a2d08cad701 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1472 microversion: 2.1 time: 1.159316 Oct 10 10:42:00.312138 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 671/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:59 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1472 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:00.339727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd919caf-b177-4283-bb83-a4355b93bd0b", "tag": "2b13fdbd-0871-4a21-9de3-47a2290f5c78"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:00.374986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.379518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.381030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.381843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:00.390888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb39f184-70cc-456a-8eeb-f51465dd12f4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1590 microversion: 2.1 time: 0.600319 Oct 10 10:42:00.395448 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 544/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:41:59 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1590 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:00.400344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:00.406397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:00.422636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.423936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.424617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.429495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.430291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.431240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.446879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] Creating event network-changed:2b13fdbd-0871-4a21-9de3-47a2290f5c78 for instance fd919caf-b177-4283-bb83-a4355b93bd0b on n-h2-860687-2 Oct 10 10:42:00.510631 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c683b7f2-9d94-45e5-a05c-7c940888a561 req-e6dba47d-2baf-4392-b4db-99ed9be31f06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163428 Oct 10 10:42:00.515097 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 672/1216] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:00.692689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:00.705855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:00.708328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:00.709444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:00.710268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:00.717838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bed6d4f-bdf4-4ca3-a40f-4130d86678fe tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.320801 Oct 10 10:42:00.737329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.737329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.737329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.737329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.737762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.737762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.739123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 545/1217] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:00 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:00.798321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:00.803155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:00.828597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.829434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.833103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.836016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:00.837637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:00.839137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:00.929718 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3414dc1a-843a-47da-8758-f35a093f1231 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136590 Oct 10 10:42:00.937484 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 546/1218] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:42:00 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:42:01.094504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:01.104463 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66396a05-18e1-4b81-b649-eb8070334d7a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.399789 Oct 10 10:42:01.106860 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 673/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:00 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:01.297764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:01.298385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:01.300371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:01.319346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.321989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.322703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:01.328271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.329684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.330313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:01.592685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:01.601785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ee462da-078c-4734-9ec2-1ab3407471ba tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1472 microversion: 2.1 time: 0.307906 Oct 10 10:42:01.603588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 547/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:01 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:01.754615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:01.756052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:01.768875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.770093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.770720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:01.771682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.772674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.773638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:01.945812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:01.949447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:01.968388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.968963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.969714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:01.970608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:01.972112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:01.976620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.056794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb890160-0612-43a1-932e-f585bfd6dfe1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117078 Oct 10 10:42:02.057958 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 548/1221] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:42:01 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:42:02.129782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:02.147067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:02.149247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:02.165972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6340bf8-2705-4665-a5c4-ff937809f52c tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.419515 Oct 10 10:42:02.166913 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 674/1222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:01 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:02.175122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:02.184168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:02.193226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.194932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.199652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.202619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.205144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.205796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.343532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:02.345268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.346061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.346717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.347711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.349767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.350442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.409960 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ca9fa39-58f1-401e-b2e9-e7cf6a43c624 tempest-AZV2TestJSON-899526396 tempest-AZV2TestJSON-899526396-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.348767 Oct 10 10:42:02.425381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 549/1223] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Oct 10 10:42:02 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:42:02.630510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:02.631522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:02.641486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.642112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.644856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.645673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:02.646239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:02.646761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:02.682160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:02.696347 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95e50129-bd5d-4714-88cc-f2154087a745 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.527893 Oct 10 10:42:02.697818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 675/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:02 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:03.073099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:03.075895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:03.089402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.090924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.094388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.096974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.098439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.104615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.198724 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73693585-3459-4113-8a81-e6a8dbd76029 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129964 Oct 10 10:42:03.202389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 676/1225] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:42:03 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:42:03.212672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:03.214144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:03.223596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.224395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.225005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.225896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.226589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.227211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.627355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:03.634095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:03.640320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:03.649846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:03.656247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f1705f8-fcfc-4406-a438-7e13fe4616c8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.452503 Oct 10 10:42:03.659551 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 677/1226] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:03 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:03.722321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:03.723246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:03.739027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.743976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.744780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.745523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:03.748247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:03.748701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:03.763477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:03.772347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d62dad0-2e40-45d2-a83e-fb7ad4e54de8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1472 microversion: 2.1 time: 1.147797 Oct 10 10:42:03.775552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 550/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:02 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1472 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:04.033044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:04.042675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe0c2209-c647-4c0f-ae10-11ce69ad9979 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.324475 Oct 10 10:42:04.044351 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 678/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:03 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:04.214046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:04.217816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:04.239583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.240350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.240799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.241652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.241989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.242543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.272397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:04.286223 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6ff4322-f27f-41cb-9d11-e10c4bb1f2cb tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.075878 Oct 10 10:42:04.293127 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 551/1229] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:42:04 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:04.687990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:04.689800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:04.699584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.700454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.701193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.702205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.703361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.704292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.802781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:04.804467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:04.813506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:04.819756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.825364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:04.825613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.826861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.827831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:04.828288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:04.828731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:04.842816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:04.849448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:04.870639 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-474bcdcc-6fa6-4b61-9922-57180b10179e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.187242 Oct 10 10:42:04.876297 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 679/1230] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:04 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:05.066375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:05.072330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:05.084973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:05.085693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:05.086144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:05.090659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:05.091666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:05.092263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:05.196366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:05.207763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2d469c6-ab86-46b4-8bc4-b90c721d9ed8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.410505 Oct 10 10:42:05.211650 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 552/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:04 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:05.419425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:05.441303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a923c29-6771-47f6-9a0f-150d5c1f07aa tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.378274 Oct 10 10:42:05.442253 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 680/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:05 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:05.905672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:05.906269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:05.918697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:05.919234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:05.919678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:05.920391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:05.920851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:05.921281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:06.105637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:06.114349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:06.123498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:06.131178 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7af98238-82e8-417a-9ed2-58e5d4816824 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.229968 Oct 10 10:42:06.132730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 553/1233] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:05 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:06.241092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:06.241730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:06.253386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:06.253884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:06.254331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:06.268328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:06.268852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:06.269307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:06.471908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:06.472529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:06.485965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:06.486463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:06.486898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:06.491764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:06.494937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:06.495742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:06.892451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:06.892582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:06.901350 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b82e01e2-2a40-42f8-bef7-d14b6d49a030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.434849 Oct 10 10:42:06.923106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 554/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:06 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:06.924526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca391554-8fad-4d9d-a728-8225288e7adb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.688598 Oct 10 10:42:06.927593 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 681/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:06 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:07.143748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74a5d17-3d36-4911-9556-50ba1a8168d0", "name": "network-vif-plugged", "status": "completed", "tag": "eacf7241-0b09-4e9c-8bf3-1ba7b6c08717"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:07.164789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.165292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.165786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.166914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:07.168466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:07.193829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] Creating event network-vif-plugged:eacf7241-0b09-4e9c-8bf3-1ba7b6c08717 for instance a74a5d17-3d36-4911-9556-50ba1a8168d0 on n-h2-860687-2 Oct 10 10:42:07.202139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.203545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.204112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.205037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.208982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.209144 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c9f59750-9580-4dfa-90ff-e96c5361c484 req-3df8acf3-dc11-43fd-b299-1cc7d2ab0554 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069711 Oct 10 10:42:07.209957 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 555/1236] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:07.214968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.453908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:07.474321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:07.478658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:07.503224 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bae663ac-fd3b-47b3-ba11-e1e56dfbae1f tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.340429 Oct 10 10:42:07.507758 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 682/1237] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:07 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:07.930965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:07.931796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:07.951783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:07.952881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:07.954082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.954628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.955109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.955853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.959582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.961657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.963861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.965872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.966861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:07.970557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:07.971249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:07.972157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:08.374268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:08.390262 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c98475c-1bc9-4953-957f-f1502e049c77 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1317 microversion: 2.1 time: 0.463182 Oct 10 10:42:08.391639 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 556/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:07 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:08.419783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:08.429874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-468e6ae6-73dd-4be5-a0cb-2b0303e0880c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.482194 Oct 10 10:42:08.436651 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 683/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:07 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:08.540602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:08.541711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:08.553070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:08.553572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:08.556993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:08.559282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:08.559972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:08.561910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:08.728231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:08.757391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:08.758860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:08.766297 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1427d55-f8e7-442f-9b40-6b85458ea208 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1553 microversion: 2.91 time: 0.230842 Oct 10 10:42:08.767196 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 557/1240] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:08 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:42:09.414762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:09.416339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:09.430881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.431758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.432223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.434479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.434607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.434984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.459800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:09.460397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:09.471513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.471935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.472379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.473092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.473553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.473985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.818985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:09.828070 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3da04efe-0188-4d08-8bff-2bf25ba9f320 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.372032 Oct 10 10:42:09.829522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 558/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:09 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:09.843781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:09.844660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:09.856167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:09.860949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.861733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.862632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.863789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.866759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.867460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.882046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a313783-3bf8-4449-a69b-1aa089b3bd8a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1466 microversion: 2.1 time: 0.472028 Oct 10 10:42:09.882661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 684/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:09 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1466 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:09.921090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:09.921716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:09.951767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.953012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.953452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:09.954190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:09.954653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:09.955114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.109912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:10.120109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:10.121838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:10.140408 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-853f2b75-0145-44e2-8400-172ad2869675 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1535 microversion: 2.91 time: 0.305647 Oct 10 10:42:10.144855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 559/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:09 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1535 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:10.431148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38ddc878-7308-4bc1-8199-07c163c6b5ba tempest-ServersOnMultiNodesTest-533731852 tempest-ServersOnMultiNodesTest-533731852-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1617 microversion: 2.1 time: 0.513550 Oct 10 10:42:10.451072 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 685/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:09 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1617 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:10.457862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:10.458645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:10.467590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.469047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.469670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.470556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.471209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.471795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.501532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:10.608149 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-623d6ccf-de00-42f2-8e48-65fbb736076a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 204 len: 0 microversion: 2.1 time: 0.154432 Oct 10 10:42:10.612668 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 560/1245] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:10 2022] DELETE /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:10.618040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:10.618600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:10.623022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:10.633202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.633715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.635610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.636737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.637498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.638172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.853029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:10.853648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:10.868042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.868541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.868979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:10.869690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:10.870145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:10.870597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.224866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.233847 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f8b4c64a-bee9-46c1-8782-6e11e0f9c173 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1472 microversion: 2.1 time: 0.620624 Oct 10 10:42:11.255849 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 686/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:10 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1472 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:11.264782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:11.273409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:11.288021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.304215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.304908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.305868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.306461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.307375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.353690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:11.395905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.405188 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b079d23c-c57f-4710-a751-546fec2c5572 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.556392 Oct 10 10:42:11.408636 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 561/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:10 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:11.418639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:11.422748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:11.433976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.434907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.435608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.436557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.437322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.438181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.492872 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-981425e2-5d5c-40aa-8ac1-3c7c0512bdbe tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "DELETE /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 204 len: 0 microversion: 2.1 time: 0.233372 Oct 10 10:42:11.494520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 687/1248] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:11 2022] DELETE /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:11.508040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:11.509040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:11.517189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.518006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.518918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.520144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:11.520792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:11.521405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:11.547995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.559917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.561720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.581145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c155f9d-a6c9-4a51-8562-0a3be1d33e47 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1535 microversion: 2.91 time: 0.169377 Oct 10 10:42:11.581799 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 562/1249] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:11 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1535 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:11.807781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:11.816541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8562c2f-653d-4c57-9aaa-6b4e29e8ea50 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1682 microversion: 2.1 time: 0.316966 Oct 10 10:42:11.817330 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 688/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:11 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1682 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:12.266597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:12.267488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:12.276388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.279652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.280291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:12.281172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.281806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.284214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:12.363442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:12.431143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:12.432211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:12.442635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.444691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.446541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:12.452060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.452794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.456001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:12.786025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:12.815668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-647aa2f1-ebb4-4239-badd-bc1464c254ac tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1472 microversion: 2.1 time: 0.551550 Oct 10 10:42:12.817569 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 563/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:12 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:12.830163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:12.833869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:12.849067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.852486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.853521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:12.856278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:12.858035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:12.858719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:13.026441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:13.041741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:13.043818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:13.056293 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ea49795-fc85-472f-8dcd-a02665bfa998 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1535 microversion: 2.91 time: 0.233459 Oct 10 10:42:13.056884 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 564/1252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:12 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1535 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:13.063254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:13.064065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:13.070114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:13.070604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:13.071066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:13.071914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:13.072547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:13.072974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:13.116783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:13.151934 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e45e7b8-abcb-4e12-b36d-170db4825c63 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.722100 Oct 10 10:42:13.172666 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 689/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:12 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:13.788416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:13.789904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:13.800296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:13.801338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:13.801994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:13.803134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:13.803806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:13.804587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:13.971950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:13.983434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f18b049-57a9-4501-87a7-3994bef5d7b6 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1682 microversion: 2.1 time: 0.923811 Oct 10 10:42:13.990374 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 565/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:13 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1682 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:13.999718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:14.000566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:14.008714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.009667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.010533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.011709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.013473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.014103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.622547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ae8a506c-c346-4cd1-9870-8c7494b77603 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1859 microversion: 2.1 time: 0.838398 Oct 10 10:42:14.626747 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 690/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:13 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1859 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:14.639132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:14.640112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:14.648994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.649853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.650540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.653911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.656238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.656921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.739553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:14.753080 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9e100a9-246f-41cb-baec-1339629a4aae tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1472 microversion: 2.1 time: 0.760494 Oct 10 10:42:14.768181 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 566/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:13 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1472 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:14.775330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:14.776188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:14.783970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.784639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.785345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.786213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:14.786820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:14.787417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:14.794016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:14.970163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:14.984336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:14.986135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:14.998705 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16e6b1bd-4577-40f3-9c5d-c208c54d1554 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1478 microversion: 2.91 time: 0.370537 Oct 10 10:42:15.010019 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 691/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:14 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1478 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:15.016272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:15.019264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:15.031397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.032244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.035250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.036330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.036817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.037258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.080681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lazy-loading 'flavor' on Instance uuid 4bf671f2-4bd1-442c-b731-773d451d449d {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:15.086428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:15.097978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:42:15.219281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:15.228865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e2d8354-108f-4172-bb91-069a79196ca0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.459391 Oct 10 10:42:15.234774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 567/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:14 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:15.243854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b075f-2d79-4500-904e-f42558454b83", "name": "network-vif-deleted", "tag": "e23d90ff-faac-4edb-86f7-64ebc26f6f32"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:15.266542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.267032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.267467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.290216 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] Creating event network-vif-deleted:e23d90ff-faac-4edb-86f7-64ebc26f6f32 for instance 366b075f-2d79-4500-904e-f42558454b83 on n-h1-860687-2 Oct 10 10:42:15.304732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9c4515f8-4cb7-409c-b9dd-254cefc6d72a req-c346db2b-4e7c-47af-bb44-f368df6f8061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068494 Oct 10 10:42:15.305664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 568/1259] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:15.312317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:15.313028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:15.322307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.322800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.323262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.324668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.325125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.325546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.428268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.429069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.429657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.430275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lazy-loading 'fault' on Instance uuid 366b075f-2d79-4500-904e-f42558454b83 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:15.546554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a76a87cf647471a93969cb2dcfb0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257f78a524be47438022f1d676de077e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:15.573260 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b8f10f9-686c-4e82-ab60-169cfeef411a tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 200 len: 1331 microversion: 2.1 time: 0.262528 Oct 10 10:42:15.575026 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 569/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:15 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 1331 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:15.582095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:15.588891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:15.627898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.629456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.630077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:15.633700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:15.634460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:15.635114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.174762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860687-2". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 10:42:16.367972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14bcc688-a216-4bae-a3e5-98db9b70f77d tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action" status: 202 len: 0 microversion: 2.91 time: 0.789733 Oct 10 10:42:16.368774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 570/1261] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:42:15 2022] POST /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:16.384195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:16.384817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:16.405925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.406438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.406845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.411578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.412059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.412718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.496726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.505466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.506386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.506386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lazy-loading 'fault' on Instance uuid a74a5d17-3d36-4911-9556-50ba1a8168d0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:16.739940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:16.755730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa9e3c3c-4935-48c7-b0b9-75b7fccfb284 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 200 len: 1307 microversion: 2.1 time: 0.386078 Oct 10 10:42:16.763794 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 571/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:16 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:16.770259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74a5d17-3d36-4911-9556-50ba1a8168d0", "name": "network-vif-deleted", "tag": "eacf7241-0b09-4e9c-8bf3-1ba7b6c08717"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:16.808105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.808980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.809717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.829867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] Creating event network-vif-deleted:eacf7241-0b09-4e9c-8bf3-1ba7b6c08717 for instance a74a5d17-3d36-4911-9556-50ba1a8168d0 on n-h2-860687-2 Oct 10 10:42:16.840183 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d70aafa1-09fb-420b-a8e6-8232305b4cf6 req-f3331587-14c7-4fd9-8992-9767af7fa1c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073178 Oct 10 10:42:16.841955 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 572/1263] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:16.850636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:16.852046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:16.874886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.876157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.877286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:16.878228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:16.878887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:16.880510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.423503 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e64f1d9-2ea6-487a-917d-205f115f87dd tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/action" status: 202 len: 0 microversion: 2.1 time: 2.411582 Oct 10 10:42:17.425166 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 692/1264] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:42:15 2022] POST /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/action => generated 0 bytes in 2414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:42:17.432287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:17.433748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:17.469340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:17.473014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.473751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.476377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.482174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.483405 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a280c9a5-b807-45bb-9abe-5b14a6d850b8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.635418 Oct 10 10:42:17.484983 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 573/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:16 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:17.485278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.485741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.494126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:17.498896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] [instance: 366b075f-2d79-4500-904e-f42558454b83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:17.514454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.516906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.518282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.519916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.525380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.526177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.558749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] HTTP exception thrown: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Request method failure captured: Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 HTTP/1.1 Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZQReBNIGXGkURgftQCHLk9Xn0Wecy-xfU4bnjlcABgxPPX5XyPyDULlngqtoZ_5Ith1a6_JtaDKFL0y3AGRvZT8t5Cyckuj2lGdgziVX7mwZyi8Uzg3pQ1p8O6NhXXCRFGXaEgnHGpy9s-xzv0SFbDs0CBiGwmMs_7HGjcIJZTLNc Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 257f78a524be47438022f1d676de077e Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:17.564166 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/257f78a524be47438022f1d676de077e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_257f78a524be47438022f1d676de077e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/257f78a524be47438022f1d676de077e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/257f78a524be47438022f1d676de077e"}]}] Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 257f78a524be47438022f1d676de077e Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-137025984 Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesAdminNegativeTest-137025984-project Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8a76a87cf647471a93969cb2dcfb0f12 Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesAdminNegativeTest-137025984-project Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. Oct 10 10:42:17.565623 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '366b075f-2d79-4500-904e-f42558454b83'} Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:17.566430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. Oct 10 10:42:17.567870 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:17.574181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Returning 404 to user: Instance 366b075f-2d79-4500-904e-f42558454b83 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:17.575624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa9dc26e-dbd4-4805-a3b3-c6b7b99b6ac9 tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83" status: 404 len: 111 microversion: 2.1 time: 0.088608 Oct 10 10:42:17.577092 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 574/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:17 2022] GET /compute/v2.1/servers/366b075f-2d79-4500-904e-f42558454b83 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:17.582617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:17.583626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:17.592974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.593845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.594543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.595516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.596201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.596876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.744665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:17.759481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:17.765872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:17.785159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af3e189e-3b60-446f-b175-f262e0b41fbf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1486 microversion: 2.91 time: 0.355909 Oct 10 10:42:17.809405 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 693/1267] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:17 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1486 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:17.826077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9a937bd-fa42-4d98-8acc-6b79332d91cd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] Calling method '.version_select at 0x7f677ca30670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:17.902311 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9a937bd-fa42-4d98-8acc-6b79332d91cd tempest-VolumesAdminNegativeTest-137025984 tempest-VolumesAdminNegativeTest-137025984-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729539895" status: 202 len: 0 microversion: 2.1 time: 0.089654 Oct 10 10:42:17.903313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 694/1268] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729539895 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:42:17.929949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:17.932341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: a74a5d17-3d36-4911-9556-50ba1a8168d0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:17.968800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.969316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.974366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.975219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:17.975730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:17.981666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:17.982110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:17.993599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-976dc572-e02f-4b60-a857-721bedc69a75 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.415202 Oct 10 10:42:17.995306 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 575/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:17 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:18.036636 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 HTTP/1.1 Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:18.039580 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. Oct 10 10:42:18.041445 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a74a5d17-3d36-4911-9556-50ba1a8168d0'} Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:18.042326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. Oct 10 10:42:18.044454 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:18.045801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance a74a5d17-3d36-4911-9556-50ba1a8168d0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:18.053191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96810a13-901c-48d3-9962-9a2dfda28886 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0" status: 404 len: 111 microversion: 2.1 time: 0.133560 Oct 10 10:42:18.059264 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 695/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:17 2022] GET /compute/v2.1/servers/a74a5d17-3d36-4911-9556-50ba1a8168d0 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:18.069191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:18.069706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:18.081813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.082313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.084782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.085814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.091365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.092087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.178361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:18.403572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7ac0425-4fb7-4fa1-a305-d71f3e2a116d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 204 len: 0 microversion: 2.1 time: 0.342517 Oct 10 10:42:18.405989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 576/1271] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:18 2022] DELETE /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:18.422213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:18.424988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:18.442424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.444846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.445694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.446629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.451653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.452100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.511493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:18.512057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:18.527405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.528975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.535315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.538282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.539043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.545333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.802108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:18.814075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81b936bd-0316-4dc2-8527-e0e5f9aa6572 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1471 microversion: 2.1 time: 0.403853 Oct 10 10:42:18.818892 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 696/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:18 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:18.826431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:18.829067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:18.843317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.844209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.844823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.847149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:18.848895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:18.849758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:18.982471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:18.999070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:19.000943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:19.009118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e9568ef-db0d-4244-b744-33cb4e720ff6 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.188927 Oct 10 10:42:19.013578 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 697/1273] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:18 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:19.032773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:19.033602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:19.040905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:19.048538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:19.049694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:19.050296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:19.051569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:19.052204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:19.052824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:19.053497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de4be608-4800-4291-b6f7-1dca7a29677d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.544292 Oct 10 10:42:19.054656 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 577/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:18 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:19.462236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:19.473214 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03fe7dc6-1278-4241-a0a8-f8576c4fbeef tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.453218 Oct 10 10:42:19.475636 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 698/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:19 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:19.844531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:19.845096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:19.864724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:19.865229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:19.865672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:19.866394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:19.866854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:19.867877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.048943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:20.050323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:20.082845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.086238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.086893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.088690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.090041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.090802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.347646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:20.373328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:20.387989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:20.416926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8c3b6bb-d722-40ff-a3be-2e05c11d98bf tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.370162 Oct 10 10:42:20.457833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:20.467696 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 699/1276] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:20 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:20.481262 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ceaa666d-8145-470e-8ac4-1280cd3051bd tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1471 microversion: 2.1 time: 0.641044 Oct 10 10:42:20.483228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:20.484590 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 578/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:19 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:20.485523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:20.492282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.499916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:20.501069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:20.504554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.505232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.506150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.506779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.509422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.528542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.529536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.532963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:20.533911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:20.534574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:20.535237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:21.452596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:21.475746 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5033c10f-4fcd-48e2-8d0d-caf8d24d25fb tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.981881 Oct 10 10:42:21.477209 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 579/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:20 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:21.497542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:21.498741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:21.510650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:21.512733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:21.516951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:21.517989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:21.518827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:21.520631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:21.930097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:21.944498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:21.952292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:21.970020 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c5c4751-7040-4c7c-9d4b-8f2c84872753 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.489630 Oct 10 10:42:21.972003 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 580/1279] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:21 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:22.037621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:22.047375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:22.078249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:22.078758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:22.081132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:22.082983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:22.084944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:22.085472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:22.085632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:22.097623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66ce371b-7d5f-448d-947f-19c5ef75e37e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 1.625072 Oct 10 10:42:22.119210 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 700/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:20 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:22.504532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:22.505469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:22.516673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:22.517500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:22.518169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:22.519174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:22.519989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:22.520756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:22.613771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:22.628378 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94faa011-2b56-4795-b699-274581f00c51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1429 microversion: 2.1 time: 0.650827 Oct 10 10:42:22.629235 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 581/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:21 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1429 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:22.662692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfef6ea-4d93-40a2-bb42-e82261106659", "name": "network-vif-deleted", "tag": "f21bd547-8b3e-4158-9ef0-fad0498458bc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:22.689290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:22.693622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:22.695216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:22.710885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:22.736477 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] Creating event network-vif-deleted:f21bd547-8b3e-4158-9ef0-fad0498458bc for instance fdfef6ea-4d93-40a2-bb42-e82261106659 on n-h1-860687-2 Oct 10 10:42:22.753208 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ae3c12db-8f3a-48d2-bcd5-70e3e2e7c5e5 req-99115fe2-e8ab-414c-8435-57054eebae51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121297 Oct 10 10:42:22.757348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 582/1282] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:23.002253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:23.003598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:23.026618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.028120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.031717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.033095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.033794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.035212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.131159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:23.152921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4d67c36-a6b0-4f90-9d54-a36eb418556f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.653322 Oct 10 10:42:23.169724 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 701/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:22 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:23.195026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:23.201722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:23.241477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.244943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.247971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.251222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.252788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.254336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.386018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:23.431726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:23.447723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:23.489730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63ac4ba4-fb70-49c6-9fcb-6b2226e617d7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.486382 Oct 10 10:42:23.492707 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 583/1284] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:22 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:42:23.654823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:23.657463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:23.672184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.672994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.674769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.676194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.680556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.681189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.831950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:23.855867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:23.856657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:23.857298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:23.858715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lazy-loading 'fault' on Instance uuid fdfef6ea-4d93-40a2-bb42-e82261106659 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:24.032103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.042609 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3223aba0-8309-477b-9ba8-3c90751001da tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 200 len: 1306 microversion: 2.1 time: 0.391469 Oct 10 10:42:24.044161 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 584/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:23 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 1306 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:24.136523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.157653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee31cae4-ae2a-427f-8c2c-8d95ef6eb940 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.981704 Oct 10 10:42:24.159964 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 702/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:23 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:24.197445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:24.198841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:24.219507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:24.220926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:24.221631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:24.223951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:24.226107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:24.227030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:24.524119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:24.525366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:24.540990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:24.559194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:24.560304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:24.565239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:24.567384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:24.578482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:24.848497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.865402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.870922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.877638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:24.887756 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2786cffd-015f-4780-8ce1-1a052359244c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.694220 Oct 10 10:42:24.890539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 585/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:24 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:24.896213 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e797f325-bf87-4654-b33b-802826cb01ee tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.375800 Oct 10 10:42:24.898926 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 703/1288] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:24 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:42:25.078420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:25.080247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: fdfef6ea-4d93-40a2-bb42-e82261106659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:25.092841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.096823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.100433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.101636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.103565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.104599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.150968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 HTTP/1.1 Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:25.155598 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. Oct 10 10:42:25.157571 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'fdfef6ea-4d93-40a2-bb42-e82261106659'} Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:25.158495 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. Oct 10 10:42:25.159980 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:25.164599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance fdfef6ea-4d93-40a2-bb42-e82261106659 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:25.171553 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd3120f0-e896-4ee6-bbc0-94c6a840fa7c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659" status: 404 len: 111 microversion: 2.1 time: 0.095031 Oct 10 10:42:25.176819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 586/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:25 2022] GET /compute/v2.1/servers/fdfef6ea-4d93-40a2-bb42-e82261106659 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:25.181033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:25.182112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:25.189948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:25.195577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:25.201960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.202463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.202888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.212197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.216506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.217864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.218765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.219400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.223234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.224631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.225128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.225567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.330847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:25.584814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b094cfcd-6430-479e-bf71-9e83043a9e10 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 204 len: 0 microversion: 2.1 time: 0.406690 Oct 10 10:42:25.592074 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 704/1290] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:25 2022] DELETE /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:25.601510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:25.602972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:25.611363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.613002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.615482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.617090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:25.618061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:25.618635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:25.980451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:25.992460 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1559341b-77f2-44cc-a5ad-a2f6e99f8953 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 0.809711 Oct 10 10:42:25.994019 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 587/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:25 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:26.007629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:26.009788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:26.038555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:26.040831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:26.047434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:26.049157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:26.050440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:26.051716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:26.183507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:26.242072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4f3936f-d9c9-4f3d-9f25-ecbdbe7bc646 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1472 microversion: 2.1 time: 0.647190 Oct 10 10:42:26.254202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 705/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:25 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1472 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:26.262801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:26.267202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:26.308641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:26.309151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:26.309599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:26.310325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:26.310785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:26.317295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:26.979866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:27.013139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:27.023361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:27.048602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48ffb045-cb3d-4d8f-ac00-0af4e781caea tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.792792 Oct 10 10:42:27.083672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 706/1293] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:26 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:27.101503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:27.102320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:27.119404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:27.120834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:27.122827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:27.123739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:27.129615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:27.134413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:27.199649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:27.496544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:27.529923 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e034e76f-18c6-4448-8d1d-30d35f61a633 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 1.533862 Oct 10 10:42:27.533567 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 588/1294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:25 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:27.548357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:27.550727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:27.586064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:27.588298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:27.601717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:27.605062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:27.614114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:27.619552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:28.387493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:28.397569 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac5599fc-4a7d-4d0d-bfd4-f3066ef6f98a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1477 microversion: 2.1 time: 1.312146 Oct 10 10:42:28.412958 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 707/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:27 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1477 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:28.418891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:28.427878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:28.445227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:28.445654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:28.446107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:28.446846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:28.447355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:28.447789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:28.748051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:28.762067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:28.767743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:28.781117 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-177c5601-bffb-489f-9502-e2358fac23df tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.366926 Oct 10 10:42:28.783163 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 708/1296] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:28 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:28.793716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:28.797186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:28.834325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:28.835283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:28.836012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:28.837345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:28.838162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:28.839468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:28.945494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:28.969189 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-962b2620-ef5f-497f-a53e-7b19dc00cbec tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 200 len: 1472 microversion: 2.1 time: 1.430746 Oct 10 10:42:28.973464 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 589/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:27 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 1472 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:29.267981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b57dde-042b-478c-9f69-4d951d1fe75d", "name": "network-vif-deleted", "tag": "fdbb525f-1194-4b63-b390-f7231402a12e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:29.290182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:29.290938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:29.292350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:29.329345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] Creating event network-vif-deleted:fdbb525f-1194-4b63-b390-f7231402a12e for instance 98b57dde-042b-478c-9f69-4d951d1fe75d on n-h1-860687-2 Oct 10 10:42:29.336201 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-aa0334c8-5d40-46f8-b3a7-7c47b5d9b7c1 req-94d2a28a-abb3-4911-b5f6-ec4a9e2bf0ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073195 Oct 10 10:42:29.340338 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 590/1298] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:42:29.426817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:29.427990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:29.435724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:29.436709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:29.437362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:29.438253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:29.438934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:29.440717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.305223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.314188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.321365 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-20775c97-6778-446b-a417-28c5a5310373 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 2.536741 Oct 10 10:42:31.328504 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 709/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:28 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:31.330162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4dcb3319-5307-4e71-bd1a-14223e48bd2b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1476 microversion: 2.1 time: 1.907231 Oct 10 10:42:31.348586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:31.350258 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 591/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:29 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1476 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:31.367521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:31.381487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:31.386000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.387175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Searching by: {'deleted': False, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:42:31.407881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.408211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.408600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.411566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.413255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.416317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.418730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.421959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.423798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.424727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.425224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.429661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.514505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:42:31.615384 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-60a1b75b-7ecb-4c87-ade2-2a48e963bff9 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.285741 Oct 10 10:42:31.630450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 710/1301] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:42:31 2022] GET /compute/v2.1/servers => generated 340 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:31.639906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:31.642138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 98b57dde-042b-478c-9f69-4d951d1fe75d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:31.656967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.658711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.660007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.663918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.664604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.665342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.700137 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d HTTP/1.1 Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:31.711035 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. Oct 10 10:42:31.713002 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '98b57dde-042b-478c-9f69-4d951d1fe75d'} Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:31.714729 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. Oct 10 10:42:31.716691 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:31.718658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance 98b57dde-042b-478c-9f69-4d951d1fe75d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:31.722832 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22ede24e-e1ee-4159-a5fb-321243378048 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d" status: 404 len: 111 microversion: 2.1 time: 0.090339 Oct 10 10:42:31.723747 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 711/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:31 2022] GET /compute/v2.1/servers/98b57dde-042b-478c-9f69-4d951d1fe75d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:31.734146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.738120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:31.744138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.750366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.751474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Searching by: {'deleted': False, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:42:31.752856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:31.766890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.767678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.768290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.770973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.774778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.779672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.787350 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-242f9850-4068-4ed8-ad4b-bb7bc3220798 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.434388 Oct 10 10:42:31.790991 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 592/1303] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:31 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:31.799761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:31.804474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:31.812996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.814124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.814726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.815681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:31.817056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:31.817775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:31.850706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:32.108620 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c94b5123-c7a5-4822-a741-739e445a5fc6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 204 len: 0 microversion: 2.1 time: 0.309752 Oct 10 10:42:32.111222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 593/1304] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:31 2022] DELETE /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:32.145198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:32.145886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:32.175726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.178318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.178765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.184740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.186780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.189450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.220142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:42:32.282330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:32.436376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:32.467610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.469178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.470030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.491042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-538b2d5e-222d-4d2c-9b59-a688f2ce713c tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 204 len: 0 microversion: 2.1 time: 0.371502 Oct 10 10:42:32.499375 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 594/1305] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:32 2022] DELETE /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:32.507718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:32.508418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:32.521149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.522145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.522584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.523836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.524310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.524737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.801585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb5943d2-dd7d-4d51-ba09-69c87fa8ec98 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.070832 Oct 10 10:42:32.802179 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 712/1306] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:42:31 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:32.826838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:32.827777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:32.834180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.834923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.835581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:32.836466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:32.837590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:32.838194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:33.300185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:33.328444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-478bb23a-f8c8-4fb5-8ec1-d694f0723e97 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.827267 Oct 10 10:42:33.339688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 595/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:32 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:33.371135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:33.371135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:33.412280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:33.418330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:33.424467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:33.428019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:33.428855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:33.429531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:33.782983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:33.794145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a980fa4-b145-4929-bc33-69389d62d642 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1476 microversion: 2.1 time: 0.973878 Oct 10 10:42:33.813352 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 713/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:32 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1476 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:33.818509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:33.819682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:33.826987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:33.827916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:33.828596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:33.829549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:33.830239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:33.830887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:34.134869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:34.151691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:34.154681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:34.171930 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff62f217-71bc-4520-bb15-39ef012608fc tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.357169 Oct 10 10:42:34.173661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 714/1309] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:33 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:34.195182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74e08183-aaa7-430f-bf3b-080f0272be69 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:34.206361 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74e08183-aaa7-430f-bf3b-080f0272be69 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032551 Oct 10 10:42:34.207045 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 715/1310] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:34.390028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "name": "network-vif-unplugged", "status": "completed", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:34.417553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:34.418305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:34.424410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:34.452940 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Creating event network-vif-unplugged:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h1-860687-2 Oct 10 10:42:34.469119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:42:34.507281 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-05f7866b-4e83-417c-b015-ceb60452e47f req-6ecaea4d-1233-4dce-b939-a587e078698a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.270339 Oct 10 10:42:34.513079 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 716/1311] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:34.523222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:34.526480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:34.555873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:34.556783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:34.558278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:34.558749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:34.559834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:34.560397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:34.936992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:34.946785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e88326a-de78-433b-a097-e27ecfb06466 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1475 microversion: 2.1 time: 1.600878 Oct 10 10:42:34.957521 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 596/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:33 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1475 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:34.971687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:34.972685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:34.999954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:35.005695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:35.006784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:35.013238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:35.014102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:35.014841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:35.034138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:35.114979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:35.400637 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6d256fe-a8c2-4ab5-ab58-3cffa798460e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 204 len: 0 microversion: 2.1 time: 0.441453 Oct 10 10:42:35.402717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 597/1313] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:34 2022] DELETE /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:35.428132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:35.431383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:35.456867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:35.457397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:35.458992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:35.459783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:35.461709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:35.462610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.004575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:36.013516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75468c76-adc7-4a5c-9d4a-509e342781eb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1476 microversion: 2.1 time: 0.608952 Oct 10 10:42:36.014661 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 598/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:35 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1476 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:36.019700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:36.020504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:36.027197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.027919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.028539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.029419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.030032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.031106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.076551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:36.087394 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-562b254b-8b1a-4690-b33e-679a2e3754e4 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 1.572810 Oct 10 10:42:36.100482 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 717/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:34 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:36.113118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:36.114006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:36.121744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.122845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.123692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.124574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.125188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.125919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.163770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:36.181112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:36.183651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:36.199841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57c8afed-20a7-4e65-a5a4-b1ca0d643d5e tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.182007 Oct 10 10:42:36.202611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 599/1316] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:36 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:36.226356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:36.231508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:36.270209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.275575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.278220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:36.280781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:36.283505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:36.284068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:37.999326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:38.014649 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e09adbf-7270-40aa-9bb8-a81cfe9f64c6 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1715 microversion: 2.1 time: 1.912601 Oct 10 10:42:38.015169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:38.020282 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 718/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:36 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1715 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:38.040380 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ce60035-5ff9-4f56-8940-4dfb789d6030 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1475 microversion: 2.1 time: 1.836081 Oct 10 10:42:38.041029 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 600/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:36 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1475 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:38.042869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d00218-083c-4ad6-9546-b3e85513114b", "name": "network-vif-deleted", "tag": "e7ba385a-ad60-4b02-8c47-682dadb5f95b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:38.056078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:38.063127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.064596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.065634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.067399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:38.108965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.112353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.114157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.120174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] Creating event network-vif-deleted:e7ba385a-ad60-4b02-8c47-682dadb5f95b for instance f7d00218-083c-4ad6-9546-b3e85513114b on n-h1-860687-2 Oct 10 10:42:38.138458 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d239464b-97a0-45b3-86dc-b6c059b1bd86 req-867c7658-63f9-4a11-ad5f-b26ce2bfffe7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110514 Oct 10 10:42:38.141039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 719/1319] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:38.159985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:38.162000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:38.170668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Creating event network-changed:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h1-860687-2 Oct 10 10:42:38.193679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.194211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.198266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.201090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.202206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.204450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:42:38.205206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.223984 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fb8ff49c-20fa-4830-902f-801ede2c1ab4 req-b2a449c6-2ca2-45bf-8481-245511cdc5c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166728 Oct 10 10:42:38.226957 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 601/1320] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:38.239494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:38.240234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:38.261947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.262395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.264272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.265206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:38.265827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:38.267841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:38.967316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:38.980972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d413589-303f-459b-a79f-1d42e2a2667d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.752692 Oct 10 10:42:38.987806 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 602/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:38 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:39.003393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:39.004038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:39.015131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.015906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.016469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.017291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.018528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.019099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.042949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:39.057589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14ed9e31-293b-44d1-9758-b3cf987ba258 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1476 microversion: 2.1 time: 0.913188 Oct 10 10:42:39.062857 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 720/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:38 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1476 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:39.070874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bb3c83-3665-47bd-b4d6-d95b46bf417c", "name": "network-vif-unplugged", "status": "completed", "tag": "fad5a651-a636-4bf2-8717-d8b75d5bcf2a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:39.110443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.111243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.111949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.148327 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] Creating event network-vif-unplugged:fad5a651-a636-4bf2-8717-d8b75d5bcf2a for instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c on n-h2-860687-2 Oct 10 10:42:39.174766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d4f69477-a768-491a-9909-56d92dd6728b req-b02f4244-0712-4142-af66-c31784a7fb29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102523 Oct 10 10:42:39.180488 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 721/1323] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:39.202647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:39.203600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:39.217504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.218126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.222084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.223220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.225182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.225880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.286127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:39.300886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:39.302526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:39.317734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21ee1dd6-9d56-4b25-9e41-621c4c12e059 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.328517 Oct 10 10:42:39.343029 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 603/1324] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:38 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:39.343029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:39.343029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:39.374782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.375889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.377205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.378463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:39.380127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:39.381046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:39.656619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:39.671093 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b11773c6-5290-4918-b8ff-507fc5c60e4f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1433 microversion: 2.1 time: 0.337340 Oct 10 10:42:39.671915 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 604/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:39 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1433 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:40.014832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:40.015558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:40.030862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.032384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.034718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.036147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.046150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.047084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.122687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.144206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42081fce-8e12-4a98-8a66-b03f3a31bc92 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1715 microversion: 2.1 time: 0.962205 Oct 10 10:42:40.163840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 722/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:39 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1715 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:40.172680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:40.174108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:40.183890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.184752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.186259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.187513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.188201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.188870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.630466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.640674 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1dee979-3556-4275-a127-fd3308a85b6a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.630954 Oct 10 10:42:40.641391 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 605/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:40 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:40.669396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bb3c83-3665-47bd-b4d6-d95b46bf417c", "name": "network-vif-deleted", "tag": "fad5a651-a636-4bf2-8717-d8b75d5bcf2a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:40.698089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.698583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.699596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.714320 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] Creating event network-vif-deleted:fad5a651-a636-4bf2-8717-d8b75d5bcf2a for instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c on n-h2-860687-2 Oct 10 10:42:40.720264 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cc20d4b3-ea1a-4a26-8fc0-82caf911161e req-d09e605f-8adf-4122-8450-d6cf273d497a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067922 Oct 10 10:42:40.727537 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 606/1328] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:40.733384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:40.736367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:40.751053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.751538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.758407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.759470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.760619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.761249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.832887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.844105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f2ce6b95-4afd-44ce-b345-9cf59bf41a42 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1476 microversion: 2.1 time: 0.676341 Oct 10 10:42:40.845009 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 723/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:40 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1476 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:40.851449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:40.852368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:40.858780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.859666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.860439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.861377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.862031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.862453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.901888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:40.901888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:40.902888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:40.903183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lazy-loading 'fault' on Instance uuid c7bb3c83-3665-47bd-b4d6-d95b46bf417c {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:40.947491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.956329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.958054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:40.963803 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43f023c3-1cb6-4c70-b027-db2998e7cd62 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.234601 Oct 10 10:42:40.964605 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 607/1330] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:40 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:41.028180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:41.044864 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5d795ab-266b-4244-baba-cc15be33472e tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 200 len: 1309 microversion: 2.1 time: 0.198467 Oct 10 10:42:41.045925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 724/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:40 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:41.172538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:41.173883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:41.185890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:41.188845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:41.189701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:41.190620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:41.191292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:41.192389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:41.254408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd919caf-b177-4283-bb83-a4355b93bd0b", "name": "network-vif-unplugged", "status": "completed", "tag": "2b13fdbd-0871-4a21-9de3-47a2290f5c78"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:41.273775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:41.274448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:41.277570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:41.318748 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] Creating event network-vif-unplugged:2b13fdbd-0871-4a21-9de3-47a2290f5c78 for instance fd919caf-b177-4283-bb83-a4355b93bd0b on n-h2-860687-2 Oct 10 10:42:41.329598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ad03a1a7-5777-448a-9bca-d98b8514484e req-af86102b-4970-48a7-bbd6-2f3a8670733e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079113 Oct 10 10:42:41.331427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 725/1332] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:41.669568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:41.670515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:41.681329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:41.682426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:41.682975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:41.688057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:41.688524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:41.689728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:41.928396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:42.222126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.239970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-207d797d-d420-466b-bebc-ea30553a5543 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1715 microversion: 2.1 time: 1.074922 Oct 10 10:42:42.263383 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 608/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:41 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1715 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:42.269061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:42.269672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:42.277934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.278647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.279337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.280238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.280978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.281478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.311302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.320408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:42.325594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-200a4c8f-f779-4865-8dbd-3147135d5a99 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.661155 Oct 10 10:42:42.327134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 726/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:41 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:42.392026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:42.395386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:42.421873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.426754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.427656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.439256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.440152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.441529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.442500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:42.743518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.758868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.772805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.779434 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d24f4d8-91bb-4d46-b8f0-c577c0e1567d tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1544 microversion: 2.91 time: 0.450971 Oct 10 10:42:42.780284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 727/1335] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:42 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1544 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:42.786318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:42.787277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c7bb3c83-3665-47bd-b4d6-d95b46bf417c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:42.794255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.794739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.795374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.796226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.796857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.797432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.820241 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c HTTP/1.1 Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:42.832374 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. Oct 10 10:42:42.833868 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c7bb3c83-3665-47bd-b4d6-d95b46bf417c'} Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:42.834619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. Oct 10 10:42:42.836631 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.840267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance c7bb3c83-3665-47bd-b4d6-d95b46bf417c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:42.840267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab05187c-fa99-464a-939f-d0ac38e3dfd6 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c" status: 404 len: 111 microversion: 2.1 time: 0.052346 Oct 10 10:42:42.844829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 728/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:42 2022] GET /compute/v2.1/servers/c7bb3c83-3665-47bd-b4d6-d95b46bf417c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:42.849712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:42.880639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.881221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.881677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.916523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] Creating event network-vif-unplugged:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h2-860687-2 Oct 10 10:42:42.922574 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c420574d-9fe6-4568-a5f8-6b0c751e0a2e req-ff21cb9e-a19d-4cb9-88c7-8672c75fc5fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075809 Oct 10 10:42:42.923764 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 729/1337] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:42.929690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:42.930628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: f7d00218-083c-4ad6-9546-b3e85513114b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:42.939213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.939926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.940687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.941645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:42.942799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:42.943669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:42.960644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:42.975943 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f39850d-1ccf-4cdd-b721-a0836a1a0a7e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1474 microversion: 2.1 time: 0.710709 Oct 10 10:42:42.983747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b HTTP/1.1 Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:42.985562 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. Oct 10 10:42:42.987033 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f7d00218-083c-4ad6-9546-b3e85513114b'} Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:42.987857 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. Oct 10 10:42:42.989115 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:42.990242 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 609/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:42 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1474 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:42.996283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance f7d00218-083c-4ad6-9546-b3e85513114b could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:42.997397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-348d5e4b-5656-488d-843b-cd20c0681e6f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b" status: 404 len: 111 microversion: 2.1 time: 0.072344 Oct 10 10:42:42.998496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 730/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:42 2022] GET /compute/v2.1/servers/f7d00218-083c-4ad6-9546-b3e85513114b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:43.011628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd919caf-b177-4283-bb83-a4355b93bd0b", "name": "network-vif-deleted", "tag": "2b13fdbd-0871-4a21-9de3-47a2290f5c78"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:43.015119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1700621571", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "62cb77a7-f0f1-4c26-8da8-dc077cf999d2"}], "block_device_mapping_v2": [{"uuid": "34d7a25a-1ade-4716-9439-75e4338dd101", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:43.038975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.039486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.039919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.071821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] Creating event network-vif-deleted:2b13fdbd-0871-4a21-9de3-47a2290f5c78 for instance fd919caf-b177-4283-bb83-a4355b93bd0b on n-h2-860687-2 Oct 10 10:42:43.090500 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f900b846-1b04-4aaf-85e7-d58a484ecb1d req-cd540e49-ab28-4e41-8610-361a3284b501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089892 Oct 10 10:42:43.093906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 610/1340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:43.120672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7df7b6dd-9c56-43bc-add3-567a33578ce2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:43.207915 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7df7b6dd-9c56-43bc-add3-567a33578ce2 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/ca7703af-1dda-48fc-9a89-f1feb9b1c7ee" status: 204 len: 0 microversion: 2.1 time: 0.112690 Oct 10 10:42:43.208961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 611/1341] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 10:42:43 2022] DELETE /compute/v2.1/os-server-groups/ca7703af-1dda-48fc-9a89-f1feb9b1c7ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:43.226223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:43.229353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:43.243971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.248068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.249836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.251852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.252585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.254493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.288953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:43.512851 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e981a828-b864-4e5d-be5d-f29bc0541072 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 204 len: 0 microversion: 2.1 time: 0.297863 Oct 10 10:42:43.517591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 612/1342] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:43 2022] DELETE /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:43.524498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:43.525563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:43.534779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.535558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.536209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.537298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.540491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.541055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.586207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:43.606151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.606475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.607255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.608053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lazy-loading 'fault' on Instance uuid fd919caf-b177-4283-bb83-a4355b93bd0b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:43.707552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:43.723907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4e365db-8aea-4450-90d1-5a91b61ddefc tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1368 microversion: 2.1 time: 0.204949 Oct 10 10:42:43.724499 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 613/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:43 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:43.736551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:43.737572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:43.747300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:43.758523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.761246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.761906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.763692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:43.765756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:43.766309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:43.781505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] validate_networks() for [('62cb77a7-f0f1-4c26-8da8-dc077cf999d2', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:42:44.276355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:44.287052 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13a4d6fe-21bc-4c9c-8fd0-7e2c1de583c5 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.557315 Oct 10 10:42:44.288014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 614/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:43 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:44.294432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:44.295833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:44.309542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.310393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.312379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:44.313360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.314194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.315671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:44.367140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:44.513868 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce0f94b0-f0e7-44b9-a680-4668c34300a4 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 204 len: 0 microversion: 2.1 time: 0.224324 Oct 10 10:42:44.515014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 615/1345] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:44 2022] DELETE /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:44.521924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:44.523080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:44.540355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.541283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.542591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:44.545740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.548484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.550071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:44.733569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:44.743334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:44.751612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:44.764583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38f13e5a-2795-4afd-ab7e-0d07f224cb39 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1531 microversion: 2.91 time: 0.247350 Oct 10 10:42:44.799375 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 616/1346] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:44 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1531 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:44.807867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:44.815450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:44.835043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.835891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.837614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:44.839494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:44.840253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:44.842392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.139305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:42:45.139744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:42:45.142793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:45.144185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:42:45.144618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:42:45.145032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:42:45.156734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3933eb54-1ef8-4bac-95ec-743e151c02bb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1471 microversion: 2.1 time: 0.355318 Oct 10 10:42:45.167340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 617/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:44 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:45.175767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:45.176384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:45.181083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.182633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.183459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.184427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.185140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.185889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.192893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.193785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.194265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.194914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.195383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.195804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.219661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:42:45.229905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Getting quotas for user 78daecbab97943d5a26534e791ae8107 and project ff5e9dcf466b4acd8a44bcdc0cfbdde7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:42:45.349763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:42:45.352137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34d7a25a-1ade-4716-9439-75e4338dd101',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:42:45.378821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:45.390947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65ed9641-285a-4740-8ea0-0e92bbbb3777 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 200 len: 1474 microversion: 2.1 time: 0.232550 Oct 10 10:42:45.393010 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 618/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:45 2022] GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:45.406819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:45.408528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:45.424568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.425859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.426526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.428621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.430930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.431699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.490676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.491237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.491707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.496898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lazy-loading 'fault' on Instance uuid fd919caf-b177-4283-bb83-a4355b93bd0b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:45.565587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7507ba987c4f41798019dd0e460ebf2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24f5e216c7a4633b963f573721ba9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:45.578525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82be37b3-08af-4fef-ac45-f23ebe42bf5e tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 200 len: 1368 microversion: 2.1 time: 0.181769 Oct 10 10:42:45.579393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 619/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:45 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:45.584279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:45.585310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:45.593466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.594308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.595198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.596256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.596961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.597613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.629092 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df33cc97-f56a-4a88-83ba-ca3dd397210d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.629144 Oct 10 10:42:45.630318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 731/1350] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:42:45.752578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] Lazy-loading 'services' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:45.781753 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbc95562-e5e5-4876-9e41-62442ddfed9a tempest-UnshelveToHostMultiNodesTest-1756385241 tempest-UnshelveToHostMultiNodesTest-1756385241-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1936 microversion: 2.91 time: 0.200748 Oct 10 10:42:45.783760 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 620/1351] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:45 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1936 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:45.790128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:45.801062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.802165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.802966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.823092 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] Creating event network-changed:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h2-860687-2 Oct 10 10:42:45.845769 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-838c022b-5338-4375-af1c-102ec806bf3b req-e1cd686d-af13-4673-b27b-7441c78c8eee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054795 Oct 10 10:42:45.852603 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 621/1352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:45.862735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:45.868376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:45.882251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.884463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.886591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.889137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.890047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.891520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.944528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a249194-c486-4569-b0e3-9f92d126f073 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:45.958452 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a249194-c486-4569-b0e3-9f92d126f073 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.326802 Oct 10 10:42:45.959373 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 732/1353] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:45.972062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:45.972692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:45.979704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.980151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.980636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:45.981263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:45.981911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:45.982498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.008363 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c976063c-3d3c-4312-a891-225cdf50d203 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5/action" status: 204 len: 0 microversion: 2.1 time: 0.152841 Oct 10 10:42:46.009316 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 622/1354] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:42:45 2022] POST /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5/action => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:46.018040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.019624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:46.091743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.110752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.112753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.113974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a64ef4c5-d62a-415e-9c9e-1a1898230bfa tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1104 microversion: 2.25 time: 0.102960 Oct 10 10:42:46.114626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 623/1355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:46 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1104 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:46.131400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.131828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:46.141722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.142568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.143909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.144758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.145357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.146399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.192213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:46.301739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.311867 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6955a7d7-9d3b-4397-8998-2f633394bbb3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.351377 Oct 10 10:42:46.324439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 733/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:45 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:46.329889 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f66ac351-4b8b-4652-8444-5d09ad50a366 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 204 len: 0 microversion: 2.91 time: 0.213760 Oct 10 10:42:46.330805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 624/1357] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:42:46 2022] DELETE /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:42:46.347192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5629a07-4d89-436b-bbb1-f965f23905fe tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.357927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.359220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:46.388337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.392072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.392530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.395853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.398683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.399525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.410828 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5629a07-4d89-436b-bbb1-f965f23905fe tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.085080 Oct 10 10:42:46.415361 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 734/1358] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:42:46 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:46.423898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.430199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:46.448651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.451152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.455341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.457064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.460011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.461082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.735966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.747869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.751497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:46.769621 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8e5a17e-5219-4053-939f-15ae4d29dfc8 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.352666 Oct 10 10:42:46.797450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 735/1359] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:46 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:46.817251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:46.821041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:46.834717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.835259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.838264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:46.840216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:46.840969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:46.843398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:47.314759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:47.323364 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3941edca-82f4-4444-88a4-c224a321e836 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1471 microversion: 2.1 time: 0.990193 Oct 10 10:42:47.344880 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 625/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:46 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1471 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:47.352226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a09a873-bf17-4685-8e56-a89f6e2dd667 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:47.383857 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a09a873-bf17-4685-8e56-a89f6e2dd667 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037180 Oct 10 10:42:47.391732 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 626/1361] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:47.404877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:47.408269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] [instance: fd919caf-b177-4283-bb83-a4355b93bd0b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:47.429749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:47.431373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:47.433244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:47.435695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:47.437019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:47.438271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:47.456326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:47.504378 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] HTTP exception thrown: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Request method failure captured: Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b HTTP/1.1 Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_beM_gio_F9m855RmZJWTpCp0qzF5nzSA4j6MbvYycUrtBtqiqq0WV3rNnUQch6K6JRAgr2ht0Z61dUIX0lYUoJaVrEO2GXRn_DGoH2Ei-JJTUiS1kJSRRC9c_PTyzsD48ttJ84kxIToiTG5KcxPWgkfY3NzHsFWoELrLaxuD0VPEQ Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f24f5e216c7a4633b963f573721ba9bd Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestManualDisk-138440799 Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:47.512686 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f24f5e216c7a4633b963f573721ba9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f24f5e216c7a4633b963f573721ba9bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f24f5e216c7a4633b963f573721ba9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f24f5e216c7a4633b963f573721ba9bd"}]}] Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestManualDisk-138440799 Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f24f5e216c7a4633b963f573721ba9bd Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestManualDisk-138440799 Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestManualDisk-138440799-project Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7507ba987c4f41798019dd0e460ebf2c Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestManualDisk-138440799-project Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. Oct 10 10:42:47.514352 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'fd919caf-b177-4283-bb83-a4355b93bd0b'} Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:47.515323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. Oct 10 10:42:47.516790 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:47.518301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Returning 404 to user: Instance fd919caf-b177-4283-bb83-a4355b93bd0b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:47.518301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8e20b1a-7827-433b-83af-fa4b9187f497 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b" status: 404 len: 111 microversion: 2.1 time: 0.120840 Oct 10 10:42:47.521632 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 627/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:47 2022] GET /compute/v2.1/servers/fd919caf-b177-4283-bb83-a4355b93bd0b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:47.699434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "name": "network-vif-plugged", "status": "completed", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:47.734580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:47.738283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:47.739956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:47.776925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Creating event network-vif-plugged:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h1-860687-2 Oct 10 10:42:47.797180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:42:47.826908 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7c910c24-b11c-4c62-a842-5a23e063db68 req-16ded0d2-d463-4c78-9900-b228d9fe0fea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298888 Oct 10 10:42:47.831189 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 628/1363] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:47.858034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:47.858773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:47.874107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:47.874842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:47.875504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:47.876442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:47.877112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:47.877737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.217600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.228399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.230288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.231505 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36f098c9-b800-4130-b75d-917c794957b3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1233 microversion: 2.25 time: 0.397545 Oct 10 10:42:48.232556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 629/1364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:47 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1233 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:48.239712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:48.240654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:48.248661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.249438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.250161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.250891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.251402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.251826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.317879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.330475 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e42d3195-40d9-43e7-821e-107a2b3d373a tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 200 len: 1474 microversion: 2.1 time: 1.531736 Oct 10 10:42:48.331610 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 736/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:46 2022] GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 1474 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:48.343429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd484a10-be28-4985-91b9-ebcbd3a7ef6d tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:48.395405 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd484a10-be28-4985-91b9-ebcbd3a7ef6d tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060157 Oct 10 10:42:48.409015 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 737/1366] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:48.416165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e2991b2-63b6-4852-a4fc-1ff972e978d4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] Calling method '.version_select at 0x7f677ca50430>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:48.456583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e2991b2-63b6-4852-a4fc-1ff972e978d4 tempest-ServersTestManualDisk-138440799 tempest-ServersTestManualDisk-138440799-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023684588" status: 202 len: 0 microversion: 2.1 time: 0.045366 Oct 10 10:42:48.458217 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 738/1367] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 10:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023684588 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:42:48.480811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:48.481443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:48.499694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.500193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.501740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.504407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.509322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.510171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.830541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.847178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.849037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:48.859419 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a74d2634-613c-475a-a470-ac69d8f0f4c7 tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1537 microversion: 2.91 time: 0.389575 Oct 10 10:42:48.860516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 739/1368] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:48 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1537 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:48.866134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65535d9-6662-4ead-8fb5-95134fc5bf1d", "name": "network-vif-deleted", "tag": "3b8f7d3d-01a4-4534-849c-81d3212451db"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:48.880168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.880168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.880930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.911203 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] Creating event network-vif-deleted:3b8f7d3d-01a4-4534-849c-81d3212451db for instance c65535d9-6662-4ead-8fb5-95134fc5bf1d on n-h2-860687-2 Oct 10 10:42:48.922688 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d361177a-1db2-48ee-bed0-63928ef175ad req-17c577dd-0784-4e6a-8a2b-a229adf8b49e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060751 Oct 10 10:42:48.928832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 740/1369] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:48.941946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:48.946511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:48.967276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.969757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.970419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:48.970974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:48.971537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:48.972029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:49.464874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:49.500441 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39c2a232-211c-4023-b5c2-e077a24e870a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 1.266670 Oct 10 10:42:49.501381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 630/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:48 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:49.506380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ef023a0-74d4-4205-b437-2a3cf4740266 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:49.601664 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ef023a0-74d4-4205-b437-2a3cf4740266 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.099084 Oct 10 10:42:49.619995 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 631/1371] 10.222.0.16 () {58 vars in 1165 bytes} [Mon Oct 10 10:42:49 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:49.630570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:49.631916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:49.649211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:49.650692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:49.657227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:49.659175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:49.659885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:49.660710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.019520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.032914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.034630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.036081 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52953fa1-b0cd-476c-85f2-a86477c217b5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1251 microversion: 2.25 time: 0.414851 Oct 10 10:42:50.036821 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 632/1372] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:49 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1251 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:50.044053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.044986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: c65535d9-6662-4ead-8fb5-95134fc5bf1d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:50.052102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.054382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.055083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.056018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.057233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.057884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.092262 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d HTTP/1.1 Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:50.097180 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. Oct 10 10:42:50.098613 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c65535d9-6662-4ead-8fb5-95134fc5bf1d'} Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:50.099437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. Oct 10 10:42:50.100892 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:50.106088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance c65535d9-6662-4ead-8fb5-95134fc5bf1d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:50.107801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fac8f8ec-9466-493a-ac57-2c77ee879a51 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d" status: 404 len: 111 microversion: 2.1 time: 0.068902 Oct 10 10:42:50.110736 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 633/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/servers/c65535d9-6662-4ead-8fb5-95134fc5bf1d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:50.117023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.129779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ba2f88a-93e8-431f-b167-e2dcf0ef26e6 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.132708 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-52bb2956-9629-4878-b011-376f11a42c4d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1471 microversion: 2.1 time: 1.199745 Oct 10 10:42:50.134735 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 741/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:48 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1471 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:50.148398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ba2f88a-93e8-431f-b167-e2dcf0ef26e6 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033905 Oct 10 10:42:50.157906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 634/1375] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:50.165585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750b9f4-8c81-4867-91cb-2da7669238cc", "name": "network-vif-deleted", "tag": "e3236ca5-6f12-47b1-a597-c495d533c241"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:50.176608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.178233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:50.189403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.190199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.191956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.193137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.193706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.194232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.204502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.204991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.205420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.252069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] Creating event network-vif-deleted:e3236ca5-6f12-47b1-a597-c495d533c241 for instance 7750b9f4-8c81-4867-91cb-2da7669238cc on n-h2-860687-2 Oct 10 10:42:50.259810 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a687682c-4282-4a42-927e-d0516ddcca51 req-81ef62f9-4145-4d69-9d6a-ee2eaeaca48a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122803 Oct 10 10:42:50.262143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.263221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.263851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.266577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 742/1376] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:50.268661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lazy-loading 'fault' on Instance uuid 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:50.276164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.286596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:50.304581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.306113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.309230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.310317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.311096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.315054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.403192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.409890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.411576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.412869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.414321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lazy-loading 'fault' on Instance uuid 7750b9f4-8c81-4867-91cb-2da7669238cc {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:42:50.414443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.419849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd55390ca6db84ef79df2947f1f7f8101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563b176f9e7246f7ae7df171d17dad51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.434831 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4924e1f2-0669-41c7-ac3c-685826fca9ca tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 200 len: 1542 microversion: 2.91 time: 0.272285 Oct 10 10:42:50.451030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 635/1377] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 1542 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:50.451030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1546333-028b-40b6-a2bc-9b0e4da1d123 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.529865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1546333-028b-40b6-a2bc-9b0e4da1d123 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.092835 Oct 10 10:42:50.541911 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 636/1378] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:50.552150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.555525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:50.570277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.570836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.571561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.572872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:50.573423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:50.573944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:50.589771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:50.600767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-238e2bab-3e42-4883-a561-5c8acd96c051 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 200 len: 1308 microversion: 2.1 time: 0.332511 Oct 10 10:42:50.601356 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 743/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:50.616906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-446ba08f-74aa-406c-ac53-d8d765881fc3 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.639964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-446ba08f-74aa-406c-ac53-d8d765881fc3 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037463 Oct 10 10:42:50.640607 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 744/1380] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:50.655227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-183f7220-0786-4555-9645-4574265701ec tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.674417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-183f7220-0786-4555-9645-4574265701ec tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023524 Oct 10 10:42:50.675525 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 745/1381] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:50.689003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b7ac14a-73bd-4eac-a317-b201f2e9358f tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.748035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b7ac14a-73bd-4eac-a317-b201f2e9358f tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.063900 Oct 10 10:42:50.749747 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 746/1382] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:50.767880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dcd6cdcf-1115-450f-a078-7fce7666693c tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.777959 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dcd6cdcf-1115-450f-a078-7fce7666693c tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016036 Oct 10 10:42:50.779589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 747/1383] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:50.795382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b91f68bf-173b-4181-a2ab-b838ab8a776b tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.859041 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b91f68bf-173b-4181-a2ab-b838ab8a776b tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.071510 Oct 10 10:42:50.865254 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 748/1384] 10.222.0.16 () {58 vars in 1144 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:50.880513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b652d59a-ebb6-45a1-918f-ad6d6446f2cd tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:50.906654 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b652d59a-ebb6-45a1-918f-ad6d6446f2cd tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031820 Oct 10 10:42:50.916967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 749/1385] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:42:50.940095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e797d148-bb58-4567-b4ff-d179dad5f8f8 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.002082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e797d148-bb58-4567-b4ff-d179dad5f8f8 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.072187 Oct 10 10:42:51.005677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 750/1386] 10.222.0.16 () {58 vars in 1148 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:51.021404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a4ec84c-e663-4d41-9692-93259fbe09f4 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.038175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a4ec84c-e663-4d41-9692-93259fbe09f4 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021500 Oct 10 10:42:51.039129 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 751/1387] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:42:51.051859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:51.058675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc34c18e-5fec-48a7-8abc-f663fb26186e tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.066430 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2208565c-9de4-4974-aa12-afd8ece9b3be tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.534289 Oct 10 10:42:51.074806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc34c18e-5fec-48a7-8abc-f663fb26186e tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025036 Oct 10 10:42:51.075751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 637/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:50 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:51.076146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 752/1389] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:51.088642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.089634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:51.103399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.106661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.109315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.110402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.110887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.111356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.115663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-18c06966-1ef7-4e56-bd50-c86c9d74c880 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.179056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-18c06966-1ef7-4e56-bd50-c86c9d74c880 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.080711 Oct 10 10:42:51.185316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 753/1390] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:51.194991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.198882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:51.211472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.211980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.212440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.214360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.214832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.220363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.551154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:51.565787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:51.571747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:51.573714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6a60856-3420-45e9-b902-1bc59558dbb4 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.496581 Oct 10 10:42:51.575345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 638/1391] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:51.583078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28bd9093-4d7c-4328-9f0f-90657077734b tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.635539 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28bd9093-4d7c-4328-9f0f-90657077734b tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056245 Oct 10 10:42:51.642227 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 639/1392] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:51.655018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.655672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] [instance: 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:51.666460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.670124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.670659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.671457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.671939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.672378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.715127 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] HTTP exception thrown: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Request method failure captured: Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a HTTP/1.1 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_Zv--5fro7ddnVJIjNxDTeUozFqecuAyy4zFq1qe4Xybn-MGsu2Vq_2N5ar9ftvVUiZ7CFZO4oQhZekzBZ20t-ILTfyVnFjDJ31EaNtywognrS2bXvIL0ST2pyriuvelwsAd_VZ9FpQZdUKPa86Lrw-pMmfyrj4Pev8nwazJem9tWw Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.91 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 563b176f9e7246f7ae7df171d17dad51 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1963277801 Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:51.716991 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/563b176f9e7246f7ae7df171d17dad51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_563b176f9e7246f7ae7df171d17dad51", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/563b176f9e7246f7ae7df171d17dad51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/563b176f9e7246f7ae7df171d17dad51"}]}] Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1963277801 Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 563b176f9e7246f7ae7df171d17dad51 Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1963277801 Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-UnshelveToHostMultiNodesTest-1963277801-project Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: d55390ca6db84ef79df2947f1f7f8101 Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1963277801-project Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. Oct 10 10:42:51.718779 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a'} Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:51.719827 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. Oct 10 10:42:51.721235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.722651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] Returning 404 to user: Instance 43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:51.722651 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc95ddc9-f9b5-4d07-b1e1-37b8b635199a tempest-UnshelveToHostMultiNodesTest-1963277801 tempest-UnshelveToHostMultiNodesTest-1963277801-project] 10.222.0.16 "GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a" status: 404 len: 111 microversion: 2.91 time: 0.074778 Oct 10 10:42:51.725714 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 640/1393] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/servers/43acd22c-3a93-4a0e-8ccf-f2cce5b77c2a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:42:51.736908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.744841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: 7750b9f4-8c81-4867-91cb-2da7669238cc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:51.767490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.768001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.768713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.769668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.770319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.770928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.796047 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc HTTP/1.1 Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:42:51.802334 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. Oct 10 10:42:51.804167 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7750b9f4-8c81-4867-91cb-2da7669238cc'} Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:51.805021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. Oct 10 10:42:51.806831 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:42:51.814924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance 7750b9f4-8c81-4867-91cb-2da7669238cc could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:51.819342 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ab3f39b-1d5a-4a75-9f3b-ba70267e15d9 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc" status: 404 len: 111 microversion: 2.1 time: 0.092293 Oct 10 10:42:51.824515 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 641/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/servers/7750b9f4-8c81-4867-91cb-2da7669238cc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:51.832397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a94dcb2e-f6a9-4799-8c35-79a2802c2556 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.856921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:51.865886 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a49f022-eb61-46f6-86f4-f2bb1286487d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1471 microversion: 2.1 time: 0.684604 Oct 10 10:42:51.866573 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a94dcb2e-f6a9-4799-8c35-79a2802c2556 tempest-FlavorsV2TestJSON-1635583688 tempest-FlavorsV2TestJSON-1635583688-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040676 Oct 10 10:42:51.867236 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 642/1395] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:51.887880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d12a34f-82cd-4030-b375-e328f95c4a11 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.894515 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 754/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:51 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1471 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:51.948277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d12a34f-82cd-4030-b375-e328f95c4a11 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/c7d0c00f-94fa-4b38-9c6d-284504018129" status: 204 len: 0 microversion: 2.1 time: 0.079425 Oct 10 10:42:51.952128 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 643/1397] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 10:42:51 2022] DELETE /compute/v2.1/os-server-groups/c7d0c00f-94fa-4b38-9c6d-284504018129 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:42:51.957163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:51.957660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:51.967746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:51.970496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.973293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.974887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:51.978261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:51.981446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:51.983552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.080581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:42:52.095807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:52.096437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:52.111306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.112963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.114326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.115643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.116741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.118278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.277295 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7e31040-f823-4f6b-a01c-5327540b430f tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 204 len: 0 microversion: 2.1 time: 0.323806 Oct 10 10:42:52.278303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 755/1398] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:42:51 2022] DELETE /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:42:52.286372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:52.287099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:52.301461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.301957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.302568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.303791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.304267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.305174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.668778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:52.682777 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5999be5c-ce4e-4d3f-821f-a9b7e792d1b1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.591156 Oct 10 10:42:52.685603 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 644/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:52 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:52.695768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:52.703963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:52.710654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.711531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.717339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.718704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.719439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.720097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.777117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:52.788403 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0899961-1ab9-4bc8-ab1b-dcd6f1f78c1d tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1473 microversion: 2.1 time: 0.506006 Oct 10 10:42:52.789013 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 756/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:52 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1473 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:52.920955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:52.922183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:52.939814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.940398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.941927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:52.943646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:52.944102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:52.944542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:53.084272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:53.096275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:53.098066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:53.100215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b9d3323-5e9f-407d-b0b1-ffce41934fe3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.413233 Oct 10 10:42:53.101193 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 645/1401] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:52 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:53.691941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:53.710089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:53.710705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:53.725475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:53.726225 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73bb26a5-9761-42c9-bf72-0669fb604edb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1463 microversion: 2.1 time: 0.809556 Oct 10 10:42:53.739378 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 757/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:52 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1463 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:42:53.740773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:53.747920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:53.749549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:53.750358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:53.756216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:53.759978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:53.760985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:53.778385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:53.782985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:53.783706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:53.784695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:53.785381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:53.786032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:54.292473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:54.307302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-364b7f0b-db9d-4552-a435-5d0493ae4351 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 0.601137 Oct 10 10:42:54.325259 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 646/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:53 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:54.326759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:54.327715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:54.357710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:54.368133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:54.368752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:54.369825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef31f747-51d5-48c7-9e2d-4e016466a895 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1614 microversion: 2.1 time: 0.614541 Oct 10 10:42:54.370151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:54.370662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:54.371106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:54.393719 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 758/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:53 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1614 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:54.420023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:54.420699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:54.435579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:54.436126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:54.437581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:54.438321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:54.439348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:54.439726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:54.483975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:55.201418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:55.242297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:55.847664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:55.857392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:55.871782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:55.876093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57947252-c2b3-4cee-acf0-776cbd541fe5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 1.472236 Oct 10 10:42:55.881700 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 759/1405] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:54 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:55.904375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e699ef31-43fb-4199-b0a0-8d73aa0c72cc tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '.version_select at 0x7f677cd330d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:55.907381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e699ef31-43fb-4199-b0a0-8d73aa0c72cc tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:55.907880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e699ef31-43fb-4199-b0a0-8d73aa0c72cc tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:55.908327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e699ef31-43fb-4199-b0a0-8d73aa0c72cc tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:55.944637 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e699ef31-43fb-4199-b0a0-8d73aa0c72cc tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2711 microversion: 2.1 time: 0.061593 Oct 10 10:42:55.945608 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 760/1406] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:42:55 2022] GET /compute/v2.1/os-migrations => generated 2711 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:55.958894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:55.959548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:55.972570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:55.973075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:55.973516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:55.974538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:55.975026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:55.975511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:56.097492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:56.185774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc180d4e9c14f57aec00e9ecd39beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cdb4c8a48cf45fb8c04cfc22387099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:56.201081 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c919f6fc-530b-47c8-b822-b902d07204ed tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 200 len: 1473 microversion: 2.1 time: 1.884621 Oct 10 10:42:56.205339 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 647/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:54 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 1473 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:56.212056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4e44d5-7d3d-419e-ba77-12ae8d96b207", "tag": "67281e89-48cd-4bca-b831-e4fda996a728"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:56.258219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:56.258697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:56.267168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:56.335084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] Creating event network-changed:67281e89-48cd-4bca-b831-e4fda996a728 for instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 on n-h1-860687-2 Oct 10 10:42:56.364334 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8dc0d6a5-64a8-4891-b662-529acedd6623 req-d1f16652-203c-49ba-b591-ee682293026d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155545 Oct 10 10:42:56.364891 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 648/1408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:56.398226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-228566138", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:56.460144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:42:56.540047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:42:57.437110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:57.459701 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b8bf5668-ee6b-461d-b1df-b8ef87740d23 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1718 microversion: 2.1 time: 1.512994 Oct 10 10:42:57.463408 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 761/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:55 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1718 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:57.479723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:57.480881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:57.497455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:57.499680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:57.500471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:57.501585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:57.504409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:57.505366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:57.975570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:57.987735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:57.990634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:57.992174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c6399c8-c38e-47e0-b203-f5ec7dbe7afd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.527275 Oct 10 10:42:57.993301 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 762/1410] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:57 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:58.010349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:58.011140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] [instance: aa0eb006-0f97-46a3-80e9-f0eb428e91b2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:58.031191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.032443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.033632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.035280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.035978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.036660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.058645 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] HTTP exception thrown: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Request method failure captured: Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 HTTP/1.1 Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZvCb2krjTicUpZUBfENIAAPwBpmcGDJX8vCmCPiuPp1Qyce8g6ltUNs8OsghK71OyWKCRQlD5_l9XOx2vhn1NsGmbsNSFb1xJDDi7QLWGfLiI2DQbBot7WRcYw-LFkr7cLNewxauQCKb6l6mViHURzBoQaAX2FYuURVpidnX-y_QI Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:58.060368 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cdb4c8a48cf45fb8c04cfc22387099f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cdb4c8a48cf45fb8c04cfc22387099f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cdb4c8a48cf45fb8c04cfc22387099f"}]}] Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5cdb4c8a48cf45fb8c04cfc22387099f Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-234995853 Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc180d4e9c14f57aec00e9ecd39beab Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersOnMultiNodesTest-234995853-project Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. Oct 10 10:42:58.061777 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'aa0eb006-0f97-46a3-80e9-f0eb428e91b2'} Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:58.062656 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. Oct 10 10:42:58.064717 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.067283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] Returning 404 to user: Instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:58.067283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-edce45d5-f5cf-4b7f-a87e-202a7fa819d7 tempest-ServersOnMultiNodesTest-234995853 tempest-ServersOnMultiNodesTest-234995853-project] 10.222.0.16 "GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2" status: 404 len: 111 microversion: 2.1 time: 0.067081 Oct 10 10:42:58.067283 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 763/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:57 2022] GET /compute/v2.1/servers/aa0eb006-0f97-46a3-80e9-f0eb428e91b2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:42:58.199047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:42:58.200656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:42:58.202138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:42:58.203373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:42:58.204464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:42:58.239673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.244419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.247545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.252254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.253130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.254017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.257947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8dda52c8-9b44-4c8e-bb95-1f7a0ad0db80 tempest-ListImageFiltersNegativeTestJSON-1767927013 tempest-ListImageFiltersNegativeTestJSON-1767927013-project] Calling method '.version_select at 0x7f677cff1f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:58.291865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:42:58.293367 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8dda52c8-9b44-4c8e-bb95-1f7a0ad0db80 tempest-ListImageFiltersNegativeTestJSON-1767927013 tempest-ListImageFiltersNegativeTestJSON-1767927013-project] HTTP exception thrown: Image not found. Oct 10 10:42:58.311471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8dda52c8-9b44-4c8e-bb95-1f7a0ad0db80 tempest-ListImageFiltersNegativeTestJSON-1767927013 tempest-ListImageFiltersNegativeTestJSON-1767927013-project] Request method failure captured: Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/images/1bd5bae4-a500-4028-8c98-475851b022e3 HTTP/1.1 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_cxT3m6kQmZTB1PTqTnVSmGCE5NJ1kDBSPiklCfBWioAJTiiLHOF9fHXTTcwjsKCroLOKqBmTaQjKLBwyGlKCn0C7OTAgXLrYVMz4vfnsccjPAvp8DjHkvBc1iNzv5AS7W7bS_WbBQBelXqwtKJznjd4DAbx9mSKy7ea9KR54uckWI Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b1f994750a4d4a8e9446f930b54af3d5 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1767927013 Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:42:58.324073 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1f994750a4d4a8e9446f930b54af3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b1f994750a4d4a8e9446f930b54af3d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b1f994750a4d4a8e9446f930b54af3d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b1f994750a4d4a8e9446f930b54af3d5"}]}] Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1767927013 Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b1f994750a4d4a8e9446f930b54af3d5 Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1767927013 Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListImageFiltersNegativeTestJSON-1767927013-project Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 713b247fe4f145b0acb009861dbefa0c Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1767927013-project Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1bd5bae4-a500-4028-8c98-475851b022e3'} Oct 10 10:42:58.325769 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:42:58.326771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1bd5bae4-a500-4028-8c98-475851b022e3 Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:42:58.328880 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1bd5bae4-a500-4028-8c98-475851b022e3 could not be found. Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:42:58.331519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:42:58.333228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:42:58.344792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8dda52c8-9b44-4c8e-bb95-1f7a0ad0db80 tempest-ListImageFiltersNegativeTestJSON-1767927013 tempest-ListImageFiltersNegativeTestJSON-1767927013-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:42:58.346898 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8dda52c8-9b44-4c8e-bb95-1f7a0ad0db80 tempest-ListImageFiltersNegativeTestJSON-1767927013 tempest-ListImageFiltersNegativeTestJSON-1767927013-project] 10.222.0.16 "GET /compute/v2.1/images/1bd5bae4-a500-4028-8c98-475851b022e3" status: 404 len: 62 microversion: 2.1 time: 0.279905 Oct 10 10:42:58.348879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 764/1412] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:42:58 2022] GET /compute/v2.1/images/1bd5bae4-a500-4028-8c98-475851b022e3 => generated 62 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:42:58.366075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:42:58.374542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:42:58.414151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0eb006-0f97-46a3-80e9-f0eb428e91b2", "name": "network-vif-deleted", "tag": "48becb52-706a-42d2-b305-dff39afedfa7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:42:58.456043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.456713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.456954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.492085 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] Creating event network-vif-deleted:48becb52-706a-42d2-b305-dff39afedfa7 for instance aa0eb006-0f97-46a3-80e9-f0eb428e91b2 on n-h2-860687-2 Oct 10 10:42:58.504622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-23fd1123-f9dd-41f0-8b8f-b5593645ba44 req-85f2bcc4-662e-4659-96cf-ad62459c24c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094081 Oct 10 10:42:58.507384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 765/1413] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:42:58.519940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:58.521831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:58.538731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.542588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.545176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.546554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:58.548225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:58.548905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:58.559835 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e18d7c5b-dc45-4867-9367-c855b752c4c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190043 Oct 10 10:42:58.568703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 649/1414] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:42:58.605716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81ba99b0-120f-4482-8443-bd6bbcf61c21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:58.612206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81ba99b0-120f-4482-8443-bd6bbcf61c21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:58.992821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81ba99b0-120f-4482-8443-bd6bbcf61c21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:59.025869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81ba99b0-120f-4482-8443-bd6bbcf61c21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1212 microversion: 2.1 time: 0.444674 Oct 10 10:42:59.030801 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 650/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:58 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1212 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:59.057855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:59.066268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:42:59.100548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:59.101045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:59.104878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:59.106847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:59.111119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:59.111589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:59.852872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:59.869175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3eee6f55-10ff-4a36-844c-b9f74a1ee622 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1708 microversion: 2.1 time: 1.359363 Oct 10 10:42:59.883655 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 766/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:58 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1708 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:59.892495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:59.902234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1852b33-afa4-4322-b618-548abf095553 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '.version_select at 0x7f677ee08e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:59.907436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:59.909616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:42:59.910991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb96216f-8d1b-4e7e-9b5e-84ca64f6b70d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.878134 Oct 10 10:42:59.912430 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 651/1417] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:42:59 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:42:59.921337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1852b33-afa4-4322-b618-548abf095553 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:42:59.923195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1852b33-afa4-4322-b618-548abf095553 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:42:59.923655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1852b33-afa4-4322-b618-548abf095553 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:42:59.975793 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1852b33-afa4-4322-b618-548abf095553 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2711 microversion: 2.1 time: 0.083544 Oct 10 10:42:59.976388 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 767/1418] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:42:59 2022] GET /compute/v2.1/os-migrations => generated 2711 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:42:59.998906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:42:59.999721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:00.015547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.016116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.016851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.042857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.044815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.046761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.068666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:00.069468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:00.109114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.112193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.123672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.127605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.132725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.136900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.581750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:00.592111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f2b2586-5b56-42fc-a1ae-176a0d031f46 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1216 microversion: 2.1 time: 0.542251 Oct 10 10:43:00.619891 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 768/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:00 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1216 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:00.922414 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56cad27b-dbc5-4b5e-b6a0-084e42dcc3d1 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1859 microversion: 2.1 time: 0.930599 Oct 10 10:43:00.947160 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 652/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:42:59 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1859 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:00.953699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:00.956747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:00.959309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:00.963421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:00.982310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.983012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.983443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.983581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.984183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.987576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.988363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.989414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:00.990104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.990705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:00.994990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:00.999991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:01.590332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:01.616822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:01.621275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:01.628354 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6f656d08-a989-4d89-9d57-95b256781009 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.689665 Oct 10 10:43:01.641584 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 769/1421] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:00 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:01.652080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:01.653810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:01.681949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:01.687593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:01.688433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:01.689635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:01.692390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:01.693744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:01.697700 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c99fd12-d6e1-4862-9192-3668cc5d01f8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1859 microversion: 2.1 time: 0.747476 Oct 10 10:43:01.730084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 653/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:00 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1859 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:01.917861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:01.919192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:01.933316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:01.934642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:01.935432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:01.937725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:01.940167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:01.942172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:02.168823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:02.178600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lazy-loading 'services' on Instance uuid 4bf671f2-4bd1-442c-b731-773d451d449d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:43:02.341633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cae9da20-7453-4755-854a-7a96f34fe9d7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments/a3d8ae4d-c6c9-49c2-9cff-d475afc6ce05" status: 202 len: 0 microversion: 2.1 time: 0.427949 Oct 10 10:43:02.346796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 654/1423] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:43:01 2022] DELETE /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments/a3d8ae4d-c6c9-49c2-9cff-d475afc6ce05 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:43:02.354935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:02.358367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:02.370659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:02.372334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:02.373214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:02.374374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:02.375500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:02.376231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:02.416785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:02.426577 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d376370-d939-4cbd-af80-ea8baa41dba9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1270 microversion: 2.1 time: 0.782595 Oct 10 10:43:02.427762 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 770/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:01 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1270 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:02.463696 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ede25f6-08d4-4225-82d1-55728cce72b9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115116 Oct 10 10:43:02.464375 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 655/1425] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:02 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:02.671407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:02.672268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:02.687553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:02.688060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:02.688883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:02.689895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:02.690692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:02.692574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:02.985728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:03.001939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:03.008046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:03.011747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2cf4389-55d6-4c97-a3a1-1c377f229e1f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1293 microversion: 2.25 time: 0.346624 Oct 10 10:43:03.036425 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 771/1426] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:02 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1293 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:03.456923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:03.459518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:03.483342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:03.486006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:03.488009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:03.489768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:03.490838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:03.492134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:03.494778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:03.496806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:03.504965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:03.505476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:03.507540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:03.512537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:03.513258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:03.516782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:03.595462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59efe0da-77a0-42bc-8a6c-143585f5542d tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122813 Oct 10 10:43:03.604236 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 772/1427] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:03 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:43:03.687614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:03.707973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-538d230f-f8d5-457e-9717-c0eaec6949f8 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1270 microversion: 2.1 time: 0.251535 Oct 10 10:43:03.724893 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 656/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:03 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1270 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:04.040844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:04.042154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:04.055765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.065635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.067636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:04.069429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.073706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.074474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:04.516013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:04.537846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:04.542923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:04.549061 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-31b117dd-3f24-430d-91ef-7ebc01d6e363 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 0.511446 Oct 10 10:43:04.553030 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 773/1429] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:04 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:04.609946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:04.613493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:04.626902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.629664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.631546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:04.632287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.632753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.633184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:04.719082 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3850c7d-5ee7-4fc0-868c-ebf9f34dcf4a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114896 Oct 10 10:43:04.719631 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 657/1430] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:04 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:43:04.737476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:04.738290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:04.750469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.752264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.752938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:04.754114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:04.754772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:04.758606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:05.044479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:05.054576 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aefadab9-bdab-4e04-a91a-fcd6d1918b26 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1270 microversion: 2.1 time: 0.322403 Oct 10 10:43:05.055191 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 774/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:04 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1270 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:05.261549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72e981e6-2ae6-477d-9dd7-aefdc88e8c30 tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-09T10%3A43%3A04.962596&end=2022-10-11T10%3A43%3A04.962596" status: 404 len: 112 microversion: - time: 0.294774 Oct 10 10:43:05.262219 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 658/1432] 10.222.0.16 () {58 vars in 1316 bytes} [Mon Oct 10 10:43:04 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-09T10%3A43%3A04.962596&end=2022-10-11T10%3A43%3A04.962596 => generated 112 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 10:43:05.272235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb8d6b54-6f01-4e0e-b999-8b33d0a1f6ea tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] Calling method '.version_select at 0x7f677cbd6310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:05.283608 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-fb8d6b54-6f01-4e0e-b999-8b33d0a1f6ea tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb8d6b54-6f01-4e0e-b999-8b33d0a1f6ea tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] Request method failure captured: Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-simple-tenant-usage/75a02d8fc6fd42e1bf6a1ba9a4ba3302?start=2022-10-11T10%3A43%3A04.962596&end=2022-10-09T10%3A43%3A04.962596 HTTP/1.1 Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_c4ePk-UX2f2wfW9il6-CwXZM8teNZVjST-fYcInV4af0sADxOH5WV6bC25gvxhfUQy7B07GlU9cEEvo9ELXdi4PzVWIuqb4zM3pvxfuOI50xTG2FYeMHB7fMk9DYQfqzZgt8mgY4QGYrOTLzcP_AYtV0WDPFh80rHgdTJN6yWcuqg Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 2293b1486f2e4bfcb26323d05825535e Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1110999311 Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 10:43:05.296559 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2293b1486f2e4bfcb26323d05825535e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2293b1486f2e4bfcb26323d05825535e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2293b1486f2e4bfcb26323d05825535e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2293b1486f2e4bfcb26323d05825535e"}]}] Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1110999311 Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 2293b1486f2e4bfcb26323d05825535e Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1110999311 Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9e9c989116ba4b63a927ed4383f42ddb Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid start time. The start time cannot occur after the end time. Oct 10 10:43:05.298301 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '75a02d8fc6fd42e1bf6a1ba9a4ba3302'} Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 10:43:05.299358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb8d6b54-6f01-4e0e-b999-8b33d0a1f6ea tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:05.300893 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb8d6b54-6f01-4e0e-b999-8b33d0a1f6ea tempest-TenantUsagesNegativeTestJSON-1110999311 tempest-TenantUsagesNegativeTestJSON-1110999311-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/75a02d8fc6fd42e1bf6a1ba9a4ba3302?start=2022-10-11T10%3A43%3A04.962596&end=2022-10-09T10%3A43%3A04.962596" status: 400 len: 111 microversion: 2.1 time: 0.032200 Oct 10 10:43:05.302824 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 775/1433] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Oct 10 10:43:05 2022] GET /compute/v2.1/os-simple-tenant-usage/75a02d8fc6fd42e1bf6a1ba9a4ba3302?start=2022-10-11T10%3A43%3A04.962596&end=2022-10-09T10%3A43%3A04.962596 => generated 111 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:43:05.590078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:05.591737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:05.622705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:05.628250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:05.630907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:05.633520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:05.645927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:05.650440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:05.660641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e2528ef-03b2-46a8-86f8-31f9c34c4154 tempest-TenantUsagesNegativeTestJSON-1893545385 tempest-TenantUsagesNegativeTestJSON-1893545385-project] Calling method '.version_select at 0x7f677d0a31f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:05.678113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e2528ef-03b2-46a8-86f8-31f9c34c4154 tempest-TenantUsagesNegativeTestJSON-1893545385 tempest-TenantUsagesNegativeTestJSON-1893545385-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '2d58cb705f2a40118cdbe50e7150dfde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a02d8fc6fd42e1bf6a1ba9a4ba3302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e2528ef-03b2-46a8-86f8-31f9c34c4154 tempest-TenantUsagesNegativeTestJSON-1893545385 tempest-TenantUsagesNegativeTestJSON-1893545385-project] Request method failure captured: Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T10%3A43%3A04.962596&end=2022-10-11T10%3A43%3A04.962596&detailed=1 HTTP/1.1 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_c38tZ8XyjypfvWq9Kc-eXFToMU1Z1fOLwRtZn8sTes1EnkHCD_bech6n6pfMhPfcF_I9uYawin84TgLPsAsAh20qb1VvBbbGoShyCUqftP60-yodTK2kyKo2fhbF7EbsxLw7E0EcrXMb-l_vK1v0EhqnEljo83wYuwEAx6m3aB3Xs Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 75a02d8fc6fd42e1bf6a1ba9a4ba3302 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1893545385 Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:43:05.695469 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75a02d8fc6fd42e1bf6a1ba9a4ba3302"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_75a02d8fc6fd42e1bf6a1ba9a4ba3302", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75a02d8fc6fd42e1bf6a1ba9a4ba3302"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/75a02d8fc6fd42e1bf6a1ba9a4ba3302"}]}] Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1893545385 Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 75a02d8fc6fd42e1bf6a1ba9a4ba3302 Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1893545385 Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TenantUsagesNegativeTestJSON-1893545385-project Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 2d58cb705f2a40118cdbe50e7150dfde Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1893545385-project Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: action_args: {} Oct 10 10:43:05.697806 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:43:05.699382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:43:05.700774 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:43:05.702536 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 10:43:05.702536 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:05.705912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e2528ef-03b2-46a8-86f8-31f9c34c4154 tempest-TenantUsagesNegativeTestJSON-1893545385 tempest-TenantUsagesNegativeTestJSON-1893545385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:05.710863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e2528ef-03b2-46a8-86f8-31f9c34c4154 tempest-TenantUsagesNegativeTestJSON-1893545385 tempest-TenantUsagesNegativeTestJSON-1893545385-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T10%3A43%3A04.962596&end=2022-10-11T10%3A43%3A04.962596&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.400069 Oct 10 10:43:05.716458 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 659/1434] 10.222.0.16 () {58 vars in 1335 bytes} [Mon Oct 10 10:43:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T10%3A43%3A04.962596&end=2022-10-11T10%3A43%3A04.962596&detailed=1 => generated 123 bytes in 407 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:43:05.746125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:05.758478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:05.791921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:05.792956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:05.793404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:05.796405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:05.797069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:05.799262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:05.865454 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecfc8404-2e97-4fe9-9ea6-ea4187a35803 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138372 Oct 10 10:43:05.868791 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 660/1435] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:05 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:06.083087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:06.083731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:06.118761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:06.122992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:06.125399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:06.131361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:06.132559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:06.136645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:06.189399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:06.204866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:06.209054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:06.212810 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07456565-df45-440a-b6d7-dedab68f1fb1 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 0.629217 Oct 10 10:43:06.230098 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 776/1436] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:05 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:06.864006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:06.882089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:06.885881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:06.886640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d43a13e6-e225-4e9d-99f3-4f1c1828b38c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 0.806545 Oct 10 10:43:06.888169 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 661/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:06 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:06.905787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:06.914380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:06.914838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:06.918289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:06.921828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:06.923158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:07.049421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a40b81a-67f4-4ba6-bea6-1ac419e029f8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173019 Oct 10 10:43:07.050019 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 777/1438] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:06 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:43:07.241470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:07.242631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:07.256072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:07.256863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:07.260257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:07.261345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:07.262228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:07.263889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:07.914567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:07.916117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:07.929120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:07.932611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:07.933418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:07.937641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:07.940960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:07.942163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:08.152832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:08.163222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:08.191059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:08.192373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bc84123-dde5-45e1-bcc8-8e97e5c37bda tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 0.955909 Oct 10 10:43:08.203031 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 662/1439] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:07 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:08.207618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:08.210011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:08.234820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:08.244864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:08.247760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:08.249269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:08.250335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:08.250920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:08.287735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:08.316266 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0d2824b-6efa-4c43-9c33-a812e48ee73c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121719 Oct 10 10:43:08.319700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 663/1440] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:08 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:08.631758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:08.653992 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d9766e0-29f0-4df5-a23a-a84b1c4c1f7c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 0.744408 Oct 10 10:43:08.656803 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 778/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:07 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:43:08.854612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41a608c-76d1-46ae-a09a-60a06b3c449e", "tag": "667b7c05-ffd5-45b0-889a-81405610d0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:08.886631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:08.887973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:08.888889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:08.926305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] Creating event network-changed:667b7c05-ffd5-45b0-889a-81405610d0f8 for instance a41a608c-76d1-46ae-a09a-60a06b3c449e on n-h2-860687-2 Oct 10 10:43:08.949701 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9cc0b1dd-b209-412a-a0c8-10483fb1a78d req-1f1aacc1-7042-48ab-882f-75d78f5cac50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096385 Oct 10 10:43:08.953778 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 664/1442] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:43:09.227358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:09.227358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:09.234745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.248940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.249559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:09.256727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.257467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.258362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:09.332464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:09.338115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:09.341800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:09.373688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.374206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.378191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:09.379295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.379792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.380236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:09.495423 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5512349c-fd4d-4dff-8138-00659cfb881f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155138 Oct 10 10:43:09.497362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 665/1443] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:09 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:09.681389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:09.681948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:09.692149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.694816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.695329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:09.698650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:09.700072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:09.703543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:10.562520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:10.578332 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46595c65-c4c1-455b-8b2b-0bdab33496f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 0.901519 Oct 10 10:43:10.584308 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 666/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:09 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:10.596463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:10.602925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:10.622776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:10.624687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:10.626102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:10.627625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:10.629307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:10.630656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:10.694614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:10.709088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:10.712433 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a836130a-2905-4a03-bec0-0a5c3a05113a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126204 Oct 10 10:43:10.713466 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 667/1445] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:10 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:10.714131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:10.716199 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07768c65-49b1-433d-990c-e97719829282 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 1.494652 Oct 10 10:43:10.719187 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 779/1446] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:09 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:11.612499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:11.614248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:11.630421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:11.631129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:11.631748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:11.632628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:11.637606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:11.638509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:12.268202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1113872731", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "bc37d4a8-d423-4431-bf11-75e45447e335"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:12.355455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] validate_networks() for [('bc37d4a8-d423-4431-bf11-75e45447e335', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:12.999709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:13.017916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:13.039203 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2c45a49d-45ab-4f34-98a6-414841006fca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 1.427021 Oct 10 10:43:13.044703 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 780/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:11 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:13.056284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:13.067598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:13.087508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:13.088555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:13.092727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:13.093904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:13.095592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:13.098345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:13.216645 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d9586c2-d0d8-4c8e-82eb-2665af21e562 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168237 Oct 10 10:43:13.224157 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 781/1448] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:43:13 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:43:13.232926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:13.235040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:13.245493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:13.246332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:13.247636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:13.248650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:13.249360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:13.250159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:14.213796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:14.230272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:14.237693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:14.241883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d68937d2-341d-4455-bbd2-2431bed1f465 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 1.012684 Oct 10 10:43:14.263927 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 782/1449] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:13 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:14.278769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:14.279925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:14.289319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:14.290945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:14.291976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:14.293576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:14.297288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:14.298735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:15.228893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:15.229538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:15.229781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:15.230193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:15.230604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:15.260828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:15.261475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:15.261929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:15.263454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:15.264233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:15.265304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:15.313544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:15.324213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for user 4a03479b6c834827b95ea1aa84741578 and project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:15.366607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:15.371627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:15.421463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:15.453248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96b54ede-1006-4af9-abee-81146a56e901 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 1.184126 Oct 10 10:43:15.455022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 783/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:14 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:15.565380 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83052219-5d5b-4bcf-9de7-351b374c255d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.962764 Oct 10 10:43:15.578787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 668/1451] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:43:15.594042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:15.595600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:15.617925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:15.620187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:15.623105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:15.626609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:15.632596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:15.633343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:15.961615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-972300550", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cb671461-8f86-4f89-af36-d23b366da2d1"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:16.176942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] validate_networks() for [('cb671461-8f86-4f89-af36-d23b366da2d1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:16.808751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:16.839075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:16.841375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:16.849208 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69e723a9-36bf-4461-ab06-90d5b0f2a4f5 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 1.267303 Oct 10 10:43:16.854032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 669/1452] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:15 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:16.874173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1354709522", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "bc37d4a8-d423-4431-bf11-75e45447e335"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:17.011942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] validate_networks() for [('bc37d4a8-d423-4431-bf11-75e45447e335', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:19.386349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:19.387608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:19.388140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:19.388726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:19.389162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:19.402857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.403838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.405219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.406528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.407294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.408508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.467962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:19.494554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for user 4a03479b6c834827b95ea1aa84741578 and project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:19.537859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:19.546235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:19.554824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:19.556109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:19.556911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:19.557553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:19.558077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:19.579168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.582724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.583567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.584473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.588375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.592247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.700402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Getting quotas for project d567012affb746e59a1e14b6e28a36bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:19.714334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Getting quotas for user 25077c3099fe4defa08f24f6688e4904 and project d567012affb746e59a1e14b6e28a36bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:19.733077 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af9002ee-066d-4d46-ab90-7561139e860d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.876080 Oct 10 10:43:19.739805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 670/1453] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:43:19.774687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:19.780262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:19.783303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:19.786136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:19.812997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.814297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.815834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.817286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:19.819187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:19.820165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:19.910059 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d7b4e995-855b-4e99-8f3c-cbfa2e85f42e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.450294 Oct 10 10:43:19.920645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 784/1454] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:43:19.939906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:19.942484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:20.002648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:20.006741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:20.007370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:20.010674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:20.015871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:20.017085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:20.583806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:20.597934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05d1f2f0-e666-4e0c-808b-d704888428cc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 0.850872 Oct 10 10:43:20.599900 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 671/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:19 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:20.615589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4e44d5-7d3d-419e-ba77-12ae8d96b207", "name": "network-vif-plugged", "status": "completed", "tag": "67281e89-48cd-4bca-b831-e4fda996a728"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:20.645895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:20.647797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:20.648834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:20.689331 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] Creating event network-vif-plugged:67281e89-48cd-4bca-b831-e4fda996a728 for instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 on n-h1-860687-2 Oct 10 10:43:20.704819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-39d83aeb-d54b-4fef-a8e6-d6547c7d6b96 req-4e563f9d-1829-47c8-b6bb-1599498a7884 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099760 Oct 10 10:43:20.707493 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 672/1456] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:20.747040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ab5cfad-689f-459e-abf2-50246ce78385 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:20.761607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ab5cfad-689f-459e-abf2-50246ce78385 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:20.898498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:20.920051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:20.927313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:20.933520 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-08ff023b-601f-4dc0-88e7-3e549fd57a80 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 1.009679 Oct 10 10:43:20.940910 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 785/1457] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:19 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:20.964391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-325644740", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "451", "networks": [{"uuid": "bc37d4a8-d423-4431-bf11-75e45447e335"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:21.143296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] validate_networks() for [('bc37d4a8-d423-4431-bf11-75e45447e335', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:21.976642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ab5cfad-689f-459e-abf2-50246ce78385 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:21.986384 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ab5cfad-689f-459e-abf2-50246ce78385 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1231 microversion: 2.1 time: 1.276810 Oct 10 10:43:21.998411 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 673/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:20 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1231 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:22.005827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:22.006452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:22.030992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:22.032339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:22.033100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:22.034264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:22.034957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:22.035594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:22.955348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:22.964787 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-362bfbc0-fdae-491b-a53d-cf2f5d3c04d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 0.963479 Oct 10 10:43:22.973088 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 674/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:21 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:22.987178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:22.993806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:23.011806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:23.018635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:23.021192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:23.022136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:23.024908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:23.028523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.496877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:24.501899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:24.502666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:24.503296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:24.503822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:24.504364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:24.509523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:24.515148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:24.518457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:24.523282 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db352e8f-523e-42d1-b3b3-03f7a3806803 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1281 microversion: 2.25 time: 1.540092 Oct 10 10:43:24.531503 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 675/1460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:22 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1281 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:24.549351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.550320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.552114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.567444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41a608c-76d1-46ae-a09a-60a06b3c449e", "name": "network-vif-plugged", "status": "completed", "tag": "667b7c05-ffd5-45b0-889a-81405610d0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:24.571115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.572439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.572990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.599823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.601350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.602530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.622600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:24.643779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Getting quotas for user 4a03479b6c834827b95ea1aa84741578 and project d0ad8494e92d40e2839b25f7bcb318e3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:24.658309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] Creating event network-vif-plugged:667b7c05-ffd5-45b0-889a-81405610d0f8 for instance a41a608c-76d1-46ae-a09a-60a06b3c449e on n-h2-860687-2 Oct 10 10:43:24.680107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-962cbc57-3ad1-4cec-8528-23e1253bb951 req-a063c5d9-c915-4854-83c2-3084e04755c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143416 Oct 10 10:43:24.683483 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 676/1461] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:24.694714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:24.707552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:24.712199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:24.729772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.732077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.737363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.738346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.741015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:24.741261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.742027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.754417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:24.876189 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5b82b081-05ee-41f5-95e5-4300f5e1fbb0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.932705 Oct 10 10:43:24.881133 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 786/1462] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:43:24.900895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:24.905991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:24.916559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.922464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.923524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:24.927570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:24.928267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:24.928886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:25.410333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:25.436511 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7ffb870-054a-4a86-8ca2-522ab10842f6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1289 microversion: 2.1 time: 0.749167 Oct 10 10:43:25.457686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 677/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:24 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1289 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:25.485530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cceac4a-9c6d-4fca-a856-54111ed8d49a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:25.487580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6cceac4a-9c6d-4fca-a856-54111ed8d49a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:25.517505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:26.039923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6cceac4a-9c6d-4fca-a856-54111ed8d49a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:26.051973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cceac4a-9c6d-4fca-a856-54111ed8d49a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1220 microversion: 2.1 time: 0.589556 Oct 10 10:43:26.059392 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 678/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:25 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1220 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:26.069793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:26.075433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:26.099647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:26.100076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:26.106888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:26.107772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:26.108257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:26.108698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:26.254832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:26.267657 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12c15349-9238-4ff4-8ce3-ac5f96c16043 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1312 microversion: 2.1 time: 1.385381 Oct 10 10:43:26.268365 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 787/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:24 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1312 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:26.282584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b3d558-6604-4c5a-8af6-ea2203902c30", "tag": "2f131ca8-23ae-454e-83fc-7352119c5f66"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:26.302787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:26.306045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:26.310338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:26.330323 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] Creating event network-changed:2f131ca8-23ae-454e-83fc-7352119c5f66 for instance 60b3d558-6604-4c5a-8af6-ea2203902c30 on n-h2-860687-2 Oct 10 10:43:26.363541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-95a6af7c-fccb-499a-bda7-f6a65c48037b req-c016b70c-0a3a-489b-a646-7cb6dcf25f61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087041 Oct 10 10:43:26.367103 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 788/1466] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:26.463080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:26.463775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:26.480563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:26.480810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:26.483656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:26.490618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:26.491461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:26.495363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:27.452442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:27.478726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb82e3b1-c8e0-4c21-9381-18b3b448e78a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 1.020413 Oct 10 10:43:27.521848 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 789/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:26 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:43:27.528168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:27.538031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:27.573440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:27.575468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:27.576091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:27.579980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:27.580638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:27.584422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:28.773572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:28.786231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:28.793365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:28.802293 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd693fe2-524f-4530-968f-164deb2aa50c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1478 microversion: 2.25 time: 2.741678 Oct 10 10:43:28.806928 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 679/1468] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:26 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1478 bytes in 2747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:28.832772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:28.838413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:28.866340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:28.869322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:28.869955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:28.876955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:28.879021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:28.880473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:28.893141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:28.904875 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af0ed0eb-ec61-4832-9de8-c73c2be4e09c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1280 microversion: 2.1 time: 1.381431 Oct 10 10:43:28.911803 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 790/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:27 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1280 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:29.100440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Calling method '.version_select at 0x7f677cb38550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:29.421388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:29.754215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:43:29.754866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Neutron security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:43:29.755457 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] HTTP exception thrown: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.755457 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Request method failure captured: Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/2a8ead6f-5802-42c2-b607-c74cdfcfac3f HTTP/1.1 Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_dPBFYSmUBdHij4YsbWfm6ijUPnlTcXyXxKL4MoGG2LqeCIO7digX3pG5F2fk1alnzZb2KwGI5PE8j8dg4RV0Yu4Gba7x-xPH60-FfFSbZwlP5O1jYrtOoGw39TnwBI9EN7oBdZbFoETtQgpyubRv0SMd9sFTGray9WbJZbL8ThZJM Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:43:29.779149 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e7c2e700f814712acc5beafe0d34f3b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e7c2e700f814712acc5beafe0d34f3b"}]}] Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9a3d74468f7e491ebdc75ee4d8f6ed27 Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.780731 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2a8ead6f-5802-42c2-b607-c74cdfcfac3f'} Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:29.781659 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:43:29.784513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.785741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Returning 404 to user: Security group 2a8ead6f-5802-42c2-b607-c74cdfcfac3f does not exist Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-4fcf4b10-bb73-4a63-a32f-96b70b1e5696'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d703b4a6-b630-4515-abfd-d4197e1ce06c tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2a8ead6f-5802-42c2-b607-c74cdfcfac3f" status: 404 len: 194 microversion: 2.1 time: 0.866031 Oct 10 10:43:29.789947 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 791/1470] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:43:28 2022] DELETE /compute/v2.1/os-security-groups/2a8ead6f-5802-42c2-b607-c74cdfcfac3f => generated 194 bytes in 874 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:43:29.810916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:29.812361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:29.831200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:29.831710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:29.832153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:29.837398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:29.839935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:29.840681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:30.669402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:30.687817 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c640b74d-eb3e-4497-a03e-7a57251a77de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1462 microversion: 2.1 time: 1.879475 Oct 10 10:43:30.688420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 680/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:28 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1462 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:31.011124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:31.012037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:31.022753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.024251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.025527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.027571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.028776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.030091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.058492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:31.077660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e88b4a4e-68da-45b8-be3d-b6709a34d647 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 1.281995 Oct 10 10:43:31.081803 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 792/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:29 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:31.095140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7043fa8b-08b0-4bd1-859b-712eeaa1546e tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011890 Oct 10 10:43:31.098386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 793/1473] 10.222.0.16 () {58 vars in 1164 bytes} [Mon Oct 10 10:43:31 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 10:43:31.114255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:31.119108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:31.138282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.139929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.143924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.145154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.145869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.146826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.308248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:31.320042 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04e64242-47e9-456d-9faf-0b2e650edaca tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1278 microversion: 2.1 time: 0.218503 Oct 10 10:43:31.322575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 794/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:31 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:31.328843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:31.331224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:31.343220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.349728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.350440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.355029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:31.356391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:31.357647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:31.629872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:31.646256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 10:43:31.662241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:31.662241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:31.662749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:31.663240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:31.665120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:31.696753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid be4e44d5-7d3d-419e-ba77-12ae8d96b207 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:43:31.723226 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11d022a2-a2cc-4c20-98a0-e53cd03bced7 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1971 microversion: 2.25 time: 1.010473 Oct 10 10:43:31.746745 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 681/1475] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:30 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1971 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:31.845773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adbd4ede-adac-4215-b474-73518fe13151 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Action: 'create', calling method: .version_select at 0x7f677d02c430>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:31.900943 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be66387d-173a-478a-8cb8-8c39f54d3c85 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e/action" status: 202 len: 0 microversion: 2.1 time: 0.576664 Oct 10 10:43:31.901974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 795/1476] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:43:31 2022] POST /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:43:31.907680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1c701fe-a123-4ace-a215-9b7c5a2c7158 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Calling method '.version_select at 0x7f677c92a820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:33.694876 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1c701fe-a123-4ace-a215-9b7c5a2c7158 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.791332 Oct 10 10:43:33.696530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 796/1477] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:43:31 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:33.730944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:33.732196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:33.777298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:33.778109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:33.779930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:33.782014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:33.784488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:33.785628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:34.602109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:34.670650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:35.059695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid be4e44d5-7d3d-419e-ba77-12ae8d96b207 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:43:35.127562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-15466b48-e735-45fd-aee3-654e53572249 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1971 microversion: 2.25 time: 1.429482 Oct 10 10:43:35.140975 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 797/1478] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:33 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1971 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:35.159136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:35.160139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:35.182169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:35.183609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:35.184758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:35.186586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:35.189595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:35.197377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:36.045195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:36.078618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:36.098450 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de55f570-eed3-4292-9388-9c565a831419 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1471 microversion: 2.1 time: 0.955534 Oct 10 10:43:36.099411 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 798/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:35 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1471 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:36.108108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:36.108990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:36.118176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:36.118761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:36.119243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:36.124673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:36.125857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:36.126516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:37.028652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:37.044713 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-200ba4b7-557d-44ce-bf36-b552ad2a7194 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 0.944114 Oct 10 10:43:37.048762 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 799/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:36 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:37.065447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:37.065447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:37.088437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:37.089681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:37.090615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:37.091550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:37.092190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:37.092821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:37.481368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:37.483696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:37.504163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-76cb892d-55af-444e-acbd-66bae141cc36 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.454067 Oct 10 10:43:37.504718 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 800/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:37 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:37.516431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Calling method '.version_select at 0x7f6780d368b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:37.935550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:43:37.936340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 10 10:43:37.936340 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Request method failure captured: Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/582d3f3d-0e14-41dd-a5c3-1cfd8cc60741 HTTP/1.1 Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_dPBFYSmUBdHij4YsbWfm6ijUPnlTcXyXxKL4MoGG2LqeCIO7digX3pG5F2fk1alnzZb2KwGI5PE8j8dg4RV0Yu4Gba7x-xPH60-FfFSbZwlP5O1jYrtOoGw39TnwBI9EN7oBdZbFoETtQgpyubRv0SMd9sFTGray9WbJZbL8ThZJM Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:43:37.938169 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e7c2e700f814712acc5beafe0d34f3b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e7c2e700f814712acc5beafe0d34f3b"}]}] Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 9a3d74468f7e491ebdc75ee4d8f6ed27 Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: exception: Insufficient rights for removing default security group. Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.940065 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '582d3f3d-0e14-41dd-a5c3-1cfd8cc60741'} Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:37.941199 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 10 10:43:37.942787 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:37.944261 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-ff33570f-1da8-4666-93cc-ee485c94d5ce'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-76351c36-9c38-47c7-a1fd-cff1890e5562 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/582d3f3d-0e14-41dd-a5c3-1cfd8cc60741" status: 400 len: 182 microversion: 2.1 time: 0.433973 Oct 10 10:43:37.946030 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 801/1482] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:43:37 2022] DELETE /compute/v2.1/os-security-groups/582d3f3d-0e14-41dd-a5c3-1cfd8cc60741 => generated 182 bytes in 435 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:43:37.961968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d95e668-8ea3-411a-99c7-0a11663526e4", "tag": "154175ba-6a63-42aa-a098-001fe4c12f7e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:37.983149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:37.983639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:37.984102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:38.005961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] Creating event network-changed:154175ba-6a63-42aa-a098-001fe4c12f7e for instance 7d95e668-8ea3-411a-99c7-0a11663526e4 on n-h2-860687-2 Oct 10 10:43:38.025485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-87aadafa-54b1-46c0-a761-77f7ac8adee9 req-3bfcc2e4-0485-4a56-b7bf-996437948619 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084029 Oct 10 10:43:38.026163 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 802/1483] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:38.032386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:38.036460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:38.047827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:38.048568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:38.049552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:38.050201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:38.051055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:38.105504 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c63e85ce-d56b-48ea-836c-f033c8603a56 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077874 Oct 10 10:43:38.107180 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 803/1484] 10.222.0.16 () {60 vars in 1217 bytes} [Mon Oct 10 10:43:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:43:38.111879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b3d558-6604-4c5a-8af6-ea2203902c30", "name": "network-vif-plugged", "status": "completed", "tag": "2f131ca8-23ae-454e-83fc-7352119c5f66"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:38.122663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:38.123428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:38.124040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:38.145174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] Creating event network-vif-plugged:2f131ca8-23ae-454e-83fc-7352119c5f66 for instance 60b3d558-6604-4c5a-8af6-ea2203902c30 on n-h2-860687-2 Oct 10 10:43:38.151481 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f5bb1336-aebf-4265-8919-302c7d56f074 req-bf135011-e435-4598-a240-beb8a4973e1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042903 Oct 10 10:43:38.152574 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 804/1485] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:38.157798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:38.158732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:38.173466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:38.176057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:38.176708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:38.177642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:38.178328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:38.178926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:39.169108 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adbd4ede-adac-4215-b474-73518fe13151 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.420725 Oct 10 10:43:39.178302 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 682/1486] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:43:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:39.183550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Calling method '.version_select at 0x7f677d212ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:39.391033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:43:39.391839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Neutron security group 989a601b-a2a8-40e8-ace2-bbde9430d653 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:43:39.392552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] HTTP exception thrown: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.392552 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Request method failure captured: Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-security-groups/989a601b-a2a8-40e8-ace2-bbde9430d653 HTTP/1.1 Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dPBFYSmUBdHij4YsbWfm6ijUPnlTcXyXxKL4MoGG2LqeCIO7digX3pG5F2fk1alnzZb2KwGI5PE8j8dg4RV0Yu4Gba7x-xPH60-FfFSbZwlP5O1jYrtOoGw39TnwBI9EN7oBdZbFoETtQgpyubRv0SMd9sFTGray9WbJZbL8ThZJM Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:43:39.397580 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e7c2e700f814712acc5beafe0d34f3b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e7c2e700f814712acc5beafe0d34f3b"}]}] Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9a3d74468f7e491ebdc75ee4d8f6ed27 Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.400174 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '989a601b-a2a8-40e8-ace2-bbde9430d653'} Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:39.401394 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:43:39.403235 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.404731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Returning 404 to user: Security group 989a601b-a2a8-40e8-ace2-bbde9430d653 does not exist Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-53fa8420-33c2-41b2-9184-f31e16ceb8bb'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:39.406984 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ede55c6-2114-47d9-ae6e-4737ad7f7d64 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/989a601b-a2a8-40e8-ace2-bbde9430d653" status: 404 len: 194 microversion: 2.1 time: 0.220476 Oct 10 10:43:39.409287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:39.421314 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 683/1487] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:43:39 2022] GET /compute/v2.1/os-security-groups/989a601b-a2a8-40e8-ace2-bbde9430d653 => generated 194 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:43:39.425591 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d2de421-1c42-4c61-ac51-ea16a30e97cd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1476 microversion: 2.1 time: 1.271614 Oct 10 10:43:39.426194 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 805/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:38 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1476 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:39.432181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:39.432794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:39.441262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860687-2", "block_migration": "auto"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:39.447072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:39.448424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:39.448915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:39.449354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:39.453018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:39.453498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:39.458325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:39.464100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:39.464526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:39.465208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:39.465934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:39.466385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:39.466808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:39.555297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'flavor' on Instance uuid be4e44d5-7d3d-419e-ba77-12ae8d96b207 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:43:39.588387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Going to try to live migrate instance to n-h2-860687-2 {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:43:40.602421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:40.614835 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58bdca1a-4a3f-40c5-8b64-9883239a0698 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 1.192337 Oct 10 10:43:40.616327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 684/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:39 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:40.621491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:40.622107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:40.634525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:40.634525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:40.634525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:40.634826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:40.648806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:40.649555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:40.998540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:41.008092 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9830253-119f-448c-831a-e03cb7bb35cb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.389736 Oct 10 10:43:41.011311 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 685/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:40 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:41.027858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5891027b-3ce8-4dfd-82c1-7661b21d5c84 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677c82f430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:41.480119 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5891027b-3ce8-4dfd-82c1-7661b21d5c84 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/a5ccaf2b-6463-4167-a883-88a91581b151" status: 200 len: 142 microversion: 2.1 time: 0.465978 Oct 10 10:43:41.481930 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 686/1491] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:43:41 2022] GET /compute/v2.1/os-floating-ips/a5ccaf2b-6463-4167-a883-88a91581b151 => generated 142 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:41.488695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Action: 'update', calling method: .version_select at 0x7f677d1ffaf0>, body: {"security_group": {"name": "tempest-sg-1950309894", "description": "tempest-description-1291108034"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:41.538378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:43:41.539609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Neutron security group a9097d21-70b4-41f8-9747-1f2ed02a17cf not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:43:41.542655 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] HTTP exception thrown: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.542655 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Request method failure captured: Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-security-groups/a9097d21-70b4-41f8-9747-1f2ed02a17cf HTTP/1.1 Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 102 Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dPBFYSmUBdHij4YsbWfm6ijUPnlTcXyXxKL4MoGG2LqeCIO7digX3pG5F2fk1alnzZb2KwGI5PE8j8dg4RV0Yu4Gba7x-xPH60-FfFSbZwlP5O1jYrtOoGw39TnwBI9EN7oBdZbFoETtQgpyubRv0SMd9sFTGray9WbJZbL8ThZJM Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:43:41.546919 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1e7c2e700f814712acc5beafe0d34f3b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1e7c2e700f814712acc5beafe0d34f3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1e7c2e700f814712acc5beafe0d34f3b"}]}] Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1e7c2e700f814712acc5beafe0d34f3b Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-639969359 Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9a3d74468f7e491ebdc75ee4d8f6ed27 Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-639969359-project Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: {"security_group": {"name": "tempest-sg-1950309894", "description": "tempest-description-1291108034"}} Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:43:41.548391 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a9097d21-70b4-41f8-9747-1f2ed02a17cf', 'body': {'security_group': {'name': 'tempest-sg-1950309894', 'description': 'tempest-description-1291108034'}}} Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:43:41.549283 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:43:41.553758 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.558626 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] Oct 10 10:43:41.562237 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:43:41.569528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] Returning 404 to user: Security group a9097d21-70b4-41f8-9747-1f2ed02a17cf does not exist Oct 10 10:43:41.569528 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-34478212-e150-43bb-b9f2-04a434852ac7'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:43:41.572036 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9ff2e84-4283-4587-ae26-964a48165dc0 tempest-SecurityGroupsNegativeTestJSON-639969359 tempest-SecurityGroupsNegativeTestJSON-639969359-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/a9097d21-70b4-41f8-9747-1f2ed02a17cf" status: 404 len: 194 microversion: 2.1 time: 0.088747 Oct 10 10:43:41.576257 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 687/1492] 10.222.0.16 () {60 vars in 1290 bytes} [Mon Oct 10 10:43:41 2022] PUT /compute/v2.1/os-security-groups/a9097d21-70b4-41f8-9747-1f2ed02a17cf => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:43:41.617466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d", "tag": "bb3e6d7d-70ed-473e-9e63-ff45599f86a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:41.676770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:41.677719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:41.678242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:41.725627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] Creating event network-changed:bb3e6d7d-70ed-473e-9e63-ff45599f86a0 for instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d on n-h2-860687-2 Oct 10 10:43:41.741250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a53fc4e2-7147-4440-8f8c-fc16c4e24b02 req-30781a4f-5eac-4571-8ba2-f5c06eb1c625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162819 Oct 10 10:43:41.749824 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 688/1493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:41.773804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:41.775086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:41.790215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:41.792132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:41.792999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:41.794811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:41.797771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:41.799515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:42.213894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:42.223638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3138212f-d534-4047-ab03-8fe4acb6f7f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1476 microversion: 2.1 time: 0.472235 Oct 10 10:43:42.225204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 689/1494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:41 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1476 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:42.238028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-483f8793-36b8-4bde-8bf8-ebf6d6d80596 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Action: 'create', calling method: .version_select at 0x7f677ca60a60>, body: {"keypair": {"name": "tempest-keypair-1514643785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdn/AjxHyiYIxzU2Z1lIK54PVH2Xl2t4MfbbaAyEF71F+OeX5IE6tp+b8xUtqKAH+zOdhvxrgU+LYoP7trzVrCSnUotLLPDM5ieFm617ZSoqiQBCEIic87qpvpq+COxeg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:42.267945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-483f8793-36b8-4bde-8bf8-ebf6d6d80596 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Getting quotas for project e361f65b2bc842e3877e342ef7397fd1. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:42.279087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-483f8793-36b8-4bde-8bf8-ebf6d6d80596 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Getting quotas for user c3ca311c14814cb4b5ddab7eaacd5f80 and project e361f65b2bc842e3877e342ef7397fd1. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:42.320374 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-483f8793-36b8-4bde-8bf8-ebf6d6d80596 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.090655 Oct 10 10:43:42.324681 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 690/1495] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:43:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:43:42.333163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-060f9ce9-4185-4798-8ff5-8544816b85c4 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677ce7fca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:42.943808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-060f9ce9-4185-4798-8ff5-8544816b85c4 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.616238 Oct 10 10:43:42.948126 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 691/1496] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:43:42 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:42.965558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:42.967691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:42.983543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:42.985656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:42.987812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:42.989067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:42.989476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:42.992175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:43.219120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:43.230496 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ccf2650-d452-4053-85fa-73e7db0a34ce tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 0.280966 Oct 10 10:43:43.248060 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 692/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:42 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:43.253441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:43.254331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:43.262495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:43.263364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:43.264084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:43.265129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:43.265858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:43.266530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:43.385702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d042085-1ed0-4feb-bf43-54f39b796e09 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207/action" status: 202 len: 0 microversion: 2.25 time: 3.950487 Oct 10 10:43:43.386846 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 806/1498] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:43:39 2022] POST /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207/action => generated 0 bytes in 3960 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:43:43.396447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3684a72-007b-4d50-8c88-69b97995bfe8 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677cbabf70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:43.636425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:43.649731 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bba0f826-adc8-42b1-8269-7ba610cbcb62 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.400252 Oct 10 10:43:43.650626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 693/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:43 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:43.681906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:43.684388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:43.699913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:43.700417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:43.700859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:43.701574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:43.702034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:43.702469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:44.794852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:44.816638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5058e27-9980-4958-95e5-86a0f49f5215 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1476 microversion: 2.1 time: 1.142566 Oct 10 10:43:44.818297 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 694/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:43 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1476 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:44.825679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:44.826599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:44.838923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:44.841927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:44.843896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:44.845004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:44.846174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:44.846929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:45.589403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:45.605950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:45.608975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:45.610435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7c0d0a7-a562-40b5-a40a-c01950ff7a89 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.791018 Oct 10 10:43:45.613145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 695/1501] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:44 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:45.623933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d95e668-8ea3-411a-99c7-0a11663526e4", "name": "network-vif-plugged", "status": "completed", "tag": "154175ba-6a63-42aa-a098-001fe4c12f7e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:45.654774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:45.655636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:45.656243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:45.684630 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] Creating event network-vif-plugged:154175ba-6a63-42aa-a098-001fe4c12f7e for instance 7d95e668-8ea3-411a-99c7-0a11663526e4 on n-h2-860687-2 Oct 10 10:43:45.696359 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-07374e0f-c072-48c0-846f-28854a2eac42 req-fdaae6da-1116-4ae8-b51d-efdb42859777 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077844 Oct 10 10:43:45.697253 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 696/1502] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:45.717139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25bd25b8-7ba9-4106-9767-c44c3a1b3164", "tag": "774306d9-559c-446f-8718-c106af7ef6a8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:45.751169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:45.751664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:45.752101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:45.793617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] Creating event network-changed:774306d9-559c-446f-8718-c106af7ef6a8 for instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 on n-h1-860687-2 Oct 10 10:43:45.809136 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cb021a58-0671-4594-ad35-a8d345d5caf1 req-98226c69-d4a7-460d-b671-024ccb07c540 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107647 Oct 10 10:43:45.812476 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 697/1503] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:45.819228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:45.821305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:45.829925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:45.830635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:45.831448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:45.832489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:45.833217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:45.834019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:46.577674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:46.587516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c39d965-cc27-4ed9-b948-9f3ba189c3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1331 microversion: 2.1 time: 0.773255 Oct 10 10:43:46.588448 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 698/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:45 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1331 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:46.610521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:46.611520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:46.621314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:46.622084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:46.622769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:46.624102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:46.624797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:46.625533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:47.204085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:47.216375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f64b9c30-9a0f-43e6-847a-e6729a8ee692 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.609649 Oct 10 10:43:47.217364 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 699/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:46 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:47.223768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:47.225037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:47.234124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:47.235173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:47.236121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:47.237281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:47.238619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:47.239340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:47.294563 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3684a72-007b-4d50-8c88-69b97995bfe8 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/a5ccaf2b-6463-4167-a883-88a91581b151" status: 202 len: 0 microversion: 2.1 time: 3.906187 Oct 10 10:43:47.301821 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 807/1506] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:43:43 2022] DELETE /compute/v2.1/os-floating-ips/a5ccaf2b-6463-4167-a883-88a91581b151 => generated 0 bytes in 3913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:43:47.306993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:47.307626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:47.321853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:47.322365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:47.322810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:47.327876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:47.328432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:47.328897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:47.755983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:47.770676 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77707b79-8dc3-42ed-bcbd-aa2962d8b478 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1476 microversion: 2.1 time: 0.551953 Oct 10 10:43:47.771490 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 700/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:47 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:47.781118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:47.789557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd4fc638-6487-486e-afd3-25aec9778f0e tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Action: 'create', calling method: .version_select at 0x7f677d0594c0>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:47.812586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:47.823959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:47.825648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a702542-6931-48e4-9aa4-48fa8b2824ab tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.522786 Oct 10 10:43:47.826768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 808/1508] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:47 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:47.833688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-424745605", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "cad63d61-412d-4d6c-9849-4c933c49b65e"}], "block_device_mapping_v2": [{"uuid": "74a175e2-9d16-46f4-b9e6-bded05900d5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:47.924219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] validate_networks() for [('cad63d61-412d-4d6c-9849-4c933c49b65e', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:48.060073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:49.215737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:49.216885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:49.217374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:49.217823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:49.218467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:49.228021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.228976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.229768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.230515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.230972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.231414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.250221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:49.256103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Getting quotas for user d2bfae2396ee410c964701fd5d77615e and project 37e58734bc744586bda489a8e2edd009. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:49.333832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:49.336080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74a175e2-9d16-46f4-b9e6-bded05900d5b',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:49.550739 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32be24da-6c5a-43f2-a39d-51710d750785 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721997 Oct 10 10:43:49.558769 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 809/1509] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:43:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:43:49.564245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:49.565118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:49.572270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.573091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.573525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.574468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.575105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.575687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.827213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:49.837428 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85122915-267f-46c1-9d86-737ba80b19b2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1535 microversion: 2.1 time: 0.274949 Oct 10 10:43:49.839438 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 810/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:49 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1535 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:49.848006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d", "name": "network-vif-plugged", "status": "completed", "tag": "bb3e6d7d-70ed-473e-9e63-ff45599f86a0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:49.872563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.873957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.874795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.907289 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] Creating event network-vif-plugged:bb3e6d7d-70ed-473e-9e63-ff45599f86a0 for instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d on n-h2-860687-2 Oct 10 10:43:49.915294 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-da92e14d-918c-4a68-9aa0-23a50b3c4e0f req-1ba6b367-f22c-4525-8074-f909bcc0b635 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073902 Oct 10 10:43:49.922456 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 811/1511] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:49.945806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:49.948761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:49.962684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.963305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.963770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:49.964476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:49.965204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:49.971820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:50.318926 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd4fc638-6487-486e-afd3-25aec9778f0e tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.544769 Oct 10 10:43:50.320363 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 701/1512] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:43:47 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:50.334274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:50.338057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:50.359437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:50.360013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:50.364303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:50.366441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:50.367314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:50.370865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:50.371728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:50.380825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85662714-02c3-492f-a382-b3a3631b1798 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.456084 Oct 10 10:43:50.384590 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 812/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:49 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:50.390296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-195166067", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "503c4379-e8b7-4e24-872c-2222328d768e"}, {"port": "56698754-5517-4926-b856-1f98d0d5ac33", "tag": "port-1"}, {"port": "4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6", "tag": "port-2"}, {"uuid": "225952f1-d881-442b-ace1-741d4c07a799", "tag": "net-1"}, {"uuid": "225952f1-d881-442b-ace1-741d4c07a799"}, {"uuid": "2d530834-74b6-4af3-854d-0023a4ff24da", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2d530834-74b6-4af3-854d-0023a4ff24da", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "93a49dd3-cc42-47bd-8e79-691e9705cd3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b32d20c9-c1c0-4200-8f21-5c43140bc754", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ec3f47b3-b430-4708-aa8b-f36bbb5293da", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--104554455"}], "key_name": "tempest-keypair-1514643785", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:50.573189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] validate_networks() for [('503c4379-e8b7-4e24-872c-2222328d768e', None, None, None, None, None), (None, None, '56698754-5517-4926-b856-1f98d0d5ac33', None, None, None), (None, None, '4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6', None, None, None), ('225952f1-d881-442b-ace1-741d4c07a799', None, None, None, None, None), ('225952f1-d881-442b-ace1-741d4c07a799', None, None, None, None, None), ('2d530834-74b6-4af3-854d-0023a4ff24da', '10.2.2.100', None, None, None, None), ('2d530834-74b6-4af3-854d-0023a4ff24da', '10.2.2.200', None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:43:50.671607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:50.682695 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df4c5d0b-5ecb-4ab3-9c51-9e69d5a09919 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1476 microversion: 2.1 time: 0.360612 Oct 10 10:43:50.711369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 702/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:50 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:50.726298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:50.726847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:50.739179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:50.739696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:50.740142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:50.740863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:50.743122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:50.743836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:50.761915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:51.064262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:51.102212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:51.106449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:51.110759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9643d3a-e6ca-4f1d-b7c8-2b996f232311 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.398117 Oct 10 10:43:51.129425 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 703/1515] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:50 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:51.140212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:51.141104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:51.148325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:51.150125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:51.151429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:51.152372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:51.152993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:51.153578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:51.326743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:51.336572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-130421d7-79a9-43dd-b82d-c83317bc9e92 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1150 microversion: 2.1 time: 0.205872 Oct 10 10:43:51.353463 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 704/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:51 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1150 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:51.359367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56c8e92f-5c87-4891-9110-d96125c31efd tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'create', calling method: .version_select at 0x7f677ca91280>, body: {"pool": "74342e93-82e4-4559-8240-24cfc91f813d"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:52.293686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:56.596136 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56c8e92f-5c87-4891-9110-d96125c31efd tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.241279 Oct 10 10:43:56.596764 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 705/1517] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:43:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:56.611908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3fc3558-1b2a-449a-98af-5d89117f7a32 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677cf0eee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:57.779590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:43:57.780915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:43:57.784328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:43:57.786917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:43:57.789923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:43:57.803032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:57.823139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:57.823660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:57.827756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:57.830291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:57.831788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:57.833292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:57.872896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Getting quotas for project e361f65b2bc842e3877e342ef7397fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:43:57.885550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Getting quotas for user c3ca311c14814cb4b5ddab7eaacd5f80 and project e361f65b2bc842e3877e342ef7397fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:43:58.114358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:43:58.117571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='93a49dd3-cc42-47bd-8e79-691e9705cd3c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b32d20c9-c1c0-4200-8f21-5c43140bc754',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec3f47b3-b430-4708-aa8b-f36bbb5293da',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:43:58.622901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3fc3558-1b2a-449a-98af-5d89117f7a32 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4" status: 202 len: 0 microversion: 2.1 time: 2.016319 Oct 10 10:43:58.627508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 706/1518] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:43:56 2022] DELETE /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4 => generated 0 bytes in 2030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:43:58.640040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:58.640835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:58.643508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:43:58.650247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:58.651164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:58.651860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:58.652843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:58.653535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:58.654190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:58.683614 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bccf71b2-2809-4b6a-9220-e691ddd55617 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.297026 Oct 10 10:43:58.685032 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 813/1519] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Oct 10 10:43:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 8299 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:43:58.695785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:58.696591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:58.721852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:58.722364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:58.723014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:58.723925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:58.724567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:58.725261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:58.986506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:58.995076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:59.005248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e70254c7-9a94-4b66-b477-47e5f19db54d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1475 microversion: 2.1 time: 0.318716 Oct 10 10:43:59.006025 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 814/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:58 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:59.015218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bd25b8-7ba9-4106-9767-c44c3a1b3164", "name": "network-vif-plugged", "status": "completed", "tag": "774306d9-559c-446f-8718-c106af7ef6a8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:59.021485 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04d71d77-e2f1-4e7f-9fb9-b7b307c7891e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1320 microversion: 2.1 time: 0.384472 Oct 10 10:43:59.031426 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 707/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:58 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:59.053841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:59.057327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:59.066101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.066576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.068572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.075194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.075467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.076800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.077398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.077876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.078309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.092459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] Creating event network-vif-plugged:774306d9-559c-446f-8718-c106af7ef6a8 for instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 on n-h1-860687-2 Oct 10 10:43:59.119935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b0b895cc-67ce-42b2-be1a-7f7a6c53c15f req-ccc7caf4-3aa9-4112-800e-ec153042ce3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107562 Oct 10 10:43:59.121257 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 815/1522] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:59.129705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:43:59.132334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:59.139988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.142663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.143892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.144998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.149921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.150374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.879807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:59.882654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:59.893312 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-337a9fa0-893b-4904-a18d-7008f2a6d174 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1198 microversion: 2.1 time: 0.770168 Oct 10 10:43:59.894400 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 816/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:43:59 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1198 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:43:59.906103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:59.910019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: .version_select at 0x7f677f1b08b0>, body: {"addFloatingIp": {"address": "172.25.5.155"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:59.910261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:43:59.911732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22ce2bdc-6e0e-4049-87c5-213e1d4952c3 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.879380 Oct 10 10:43:59.913233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:43:59.914131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 708/1524] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:43:59 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:43:59.922252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cd53e4-4cac-4c86-9aca-8acc5820e1be", "tag": "4fe1c66e-14d9-40fb-b811-38af75c26b97"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:43:59.930410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.930917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.931394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.932950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.933421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.933853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.945953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:43:59.946709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:43:59.947196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:43:59.960549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] Creating event network-changed:4fe1c66e-14d9-40fb-b811-38af75c26b97 for instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be on n-h2-860687-2 Oct 10 10:43:59.966727 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8936e540-a024-4af4-8f56-3a96f7120175 req-4ddaf346-add8-475d-9c98-c67fce95a8da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051274 Oct 10 10:43:59.967828 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 709/1525] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:43:59.973750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677ce7f820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:00.028393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:44:00.028896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquired lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:44:00.073671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 14d9615a-beaa-44f9-ae71-f799933e3ab4 could not be found", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:44:00.074578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] HTTP exception thrown: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Request method failure captured: Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4 HTTP/1.1 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dSQExTAVCQzYOyOZU3Wj5wwaboBKdl5e-AAJCJBkkwhqqATxFBUPvS3sehXWkDXgVCipF-KidZKVkQpnmN27ua4YDNvTZFmW7qoLYxMgK88Qpmk3rYLdx761aLMRN_d_ijGT-x07LuhMiTNUROCw5LLF7Mgc4NRda9q8AVXbG9Ddo Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: adfbddf9f6fb4e97b421426f45cbe02e Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:00.076644 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adfbddf9f6fb4e97b421426f45cbe02e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adfbddf9f6fb4e97b421426f45cbe02e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adfbddf9f6fb4e97b421426f45cbe02e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adfbddf9f6fb4e97b421426f45cbe02e"}]}] Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: adfbddf9f6fb4e97b421426f45cbe02e Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsTestJSON-661327460-project Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9dac98d1dbf34e94a34ff7558e132b9d Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsTestJSON-661327460-project Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: exception: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '14d9615a-beaa-44f9-ae71-f799933e3ab4'} Oct 10 10:44:00.079926 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:44:00.081321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 14d9615a-beaa-44f9-ae71-f799933e3ab4 could not be found Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d34b1893-5936-41ac-bebb-74028fb20172'] Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4. Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:00.083611 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:00.086691 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:00.089522 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:00.089522 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:00.089522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Returning 404 to user: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:00.089522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7652b5a8-71e0-4e37-8541-b421b5165dea tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4" status: 404 len: 111 microversion: 2.1 time: 0.110390 Oct 10 10:44:00.089522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 710/1526] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:43:59 2022] GET /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:44:00.102405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:00.103061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:00.114895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:00.115430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:00.115941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:00.116844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:00.123229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:00.123741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:00.366349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:00.396775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:00.403119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:00.404434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0313d724-b2db-46c2-b4ce-0eb439e34a42 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1519 microversion: 2.42 time: 0.321227 Oct 10 10:44:00.405029 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 711/1527] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:00 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:00.654659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-597666434", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "acc986f1-7f5d-4804-b2aa-3d76e6b5ebf2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:00.725734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] validate_networks() for [('acc986f1-7f5d-4804-b2aa-3d76e6b5ebf2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:44:02.463991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:44:02.465043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:44:02.465640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:44:02.466103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:44:02.466721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:44:02.481556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:02.482103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:02.482547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:02.483459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:02.484003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:02.484439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:02.508786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Getting quotas for project 76f9336c7a9248b8ba5734dc4b051663. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:02.514825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Getting quotas for user 5401b464e3de4cad875fc9b8b8dfe077 and project 76f9336c7a9248b8ba5734dc4b051663. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:02.529260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:44:02.531852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:44:02.628655 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-738e3009-7ad3-4372-a4e5-935ec4d84c94 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206988 Oct 10 10:44:02.637695 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 712/1528] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:44:02.642646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:02.643551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:02.653213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:02.653712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:02.654149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:02.654858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:02.655341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:02.655767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:03.061322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:03.076435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-243c4dff-2ddb-4e43-b2f1-85b52bc924d1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1473 microversion: 2.1 time: 0.437607 Oct 10 10:44:03.077356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 713/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:02 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:03.094670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:03.095898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:03.116733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:03.117491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:03.117937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:03.118664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:03.119175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:03.119807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:03.580067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:03.591278 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-244a9e53-2a95-4f5d-9abc-9ac2310e0e7f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1511 microversion: 2.1 time: 0.512783 Oct 10 10:44:03.592083 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 714/1530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:03 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:03.601145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Calling method '.version_select at 0x7f677d02cdc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:03.701932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 14d9615a-beaa-44f9-ae71-f799933e3ab4 could not be found", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:44:03.702621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] HTTP exception thrown: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Request method failure captured: Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4 HTTP/1.1 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dSQExTAVCQzYOyOZU3Wj5wwaboBKdl5e-AAJCJBkkwhqqATxFBUPvS3sehXWkDXgVCipF-KidZKVkQpnmN27ua4YDNvTZFmW7qoLYxMgK88Qpmk3rYLdx761aLMRN_d_ijGT-x07LuhMiTNUROCw5LLF7Mgc4NRda9q8AVXbG9Ddo Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: adfbddf9f6fb4e97b421426f45cbe02e Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:03.704954 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adfbddf9f6fb4e97b421426f45cbe02e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adfbddf9f6fb4e97b421426f45cbe02e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adfbddf9f6fb4e97b421426f45cbe02e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adfbddf9f6fb4e97b421426f45cbe02e"}]}] Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: adfbddf9f6fb4e97b421426f45cbe02e Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsTestJSON-661327460 Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsTestJSON-661327460-project Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9dac98d1dbf34e94a34ff7558e132b9d Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsTestJSON-661327460-project Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: exception: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '14d9615a-beaa-44f9-ae71-f799933e3ab4'} Oct 10 10:44:03.706787 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:44:03.707829 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 14d9615a-beaa-44f9-ae71-f799933e3ab4 could not be found Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2306637-0ae7-4495-8480-54f61ac5901b'] Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4. Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:03.709309 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:03.711115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:03.712656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 Oct 10 10:44:03.712656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:03.712835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:44:03.716586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] Returning 404 to user: Floating IP not found for ID 14d9615a-beaa-44f9-ae71-f799933e3ab4 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:03.717473 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d490ee27-77fd-4e36-b1f7-3cad7ea64d13 tempest-FloatingIPsTestJSON-661327460 tempest-FloatingIPsTestJSON-661327460-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4" status: 404 len: 111 microversion: 2.1 time: 0.124272 Oct 10 10:44:03.718233 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 715/1531] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:44:03 2022] DELETE /compute/v2.1/os-floating-ips/14d9615a-beaa-44f9-ae71-f799933e3ab4 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:44:03.729120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:03.729769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:03.751031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:03.751558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:03.752003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:03.752728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:03.753193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:03.753630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:04.457035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:04.473366 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9bebe403-dd1e-449f-8790-05369ee156e6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1198 microversion: 2.1 time: 0.748018 Oct 10 10:44:04.474084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 716/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:03 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1198 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:04.478855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:04.482660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:04.489335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:04.490158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:04.491423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:04.492528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:04.493235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:04.494009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:05.879127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:05.904528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:05.906047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:05.907291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2601d14-b8a1-45bc-9506-b778460a6515 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 1.432231 Oct 10 10:44:05.907861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 717/1533] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:04 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:05.919548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:05.919548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:05.929845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:05.930349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:05.932476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:05.933382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:05.933858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:05.934297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.130079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Updating instance_info_cache with network_info: [{"id": "154175ba-6a63-42aa-a098-001fe4c12f7e", "address": "fa:16:3e:9b:ef:5c", "network": {"id": "cb671461-8f86-4f89-af36-d23b366da2d1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1754584266-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d567012affb746e59a1e14b6e28a36bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap154175ba-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:44:06.179195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Releasing lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:44:06.185959 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37a7634c-74ab-444f-a1a1-0e5e799238e2 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 202 len: 0 microversion: 2.1 time: 6.287122 Oct 10 10:44:06.188222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 817/1534] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:43:59 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 0 bytes in 6293 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:44:06.204915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41a608c-76d1-46ae-a09a-60a06b3c449e", "name": "network-vif-unplugged", "status": "completed", "tag": "667b7c05-ffd5-45b0-889a-81405610d0f8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:06.223238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.226582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.227110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.254683 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Creating event network-vif-unplugged:667b7c05-ffd5-45b0-889a-81405610d0f8 for instance a41a608c-76d1-46ae-a09a-60a06b3c449e on n-h2-860687-2 Oct 10 10:44:06.268986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] Instance a41a608c-76d1-46ae-a09a-60a06b3c449e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:44:06.279866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-15a9a380-aa68-4518-8e63-09375384437e req-2a0069ab-7d6a-4002-b584-5b46222ea472 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088718 Oct 10 10:44:06.284949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 818/1535] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:06.292191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4e44d5-7d3d-419e-ba77-12ae8d96b207", "name": "network-vif-unplugged", "status": "completed", "tag": "67281e89-48cd-4bca-b831-e4fda996a728"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:06.304820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.305615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.306320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.323632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] Creating event network-vif-unplugged:67281e89-48cd-4bca-b831-e4fda996a728 for instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 on n-h1-860687-2 Oct 10 10:44:06.329775 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5aa85384-8c11-45e7-9111-e6b98ffdb123 req-f72bd3c0-0f49-4f95-ae47-866464bc6ca8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043029 Oct 10 10:44:06.331125 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 819/1536] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:06.337954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:06.339031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:06.346893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.347753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.348416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.349409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.351667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.352501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.373386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:06.387782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:06.389236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:06.390412 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9842330-8d06-444a-8568-5866debe2dc1 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1660 microversion: 2.42 time: 0.481619 Oct 10 10:44:06.413703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 718/1537] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:05 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1660 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:06.418823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:06.443551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:06.459659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.460687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.461433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.462371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.463032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.463687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.623619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:06.632187 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c1d91d5-4c13-4737-831f-a13e899aa312 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1274 microversion: 2.1 time: 0.299306 Oct 10 10:44:06.637737 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 820/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:06 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:06.653616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:06.654639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:06.666966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.668000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.668651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.673657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.674423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.675204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.926932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:06.952042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae540579-74e3-4a8f-a66b-2d3b8ae5d50b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1512 microversion: 2.1 time: 0.526631 Oct 10 10:44:06.953344 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 719/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:06 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1512 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:06.968078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:06.971274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:06.985230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.985976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.986583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:06.987888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:06.988513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:06.989188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:07.152931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:07.161132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90aab8fa-1e9b-422c-8bb3-b0348d12e288 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1470 microversion: 2.1 time: 0.521775 Oct 10 10:44:07.181590 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 821/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:06 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:07.188111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0c1fda5-f2f1-4817-aad6-93b761e56f10 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'create', calling method: .version_select at 0x7f677cb385e0>, body: {"pool": "74342e93-82e4-4559-8240-24cfc91f813d"} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:07.564667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:07.579699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8ab2ff7-18dd-4ac5-8932-e35c82f30a74 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1198 microversion: 2.1 time: 0.625014 Oct 10 10:44:07.580583 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 720/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:06 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1198 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:07.585983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:07.590193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:07.611997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:07.612796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:07.613421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:07.614321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:07.614948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:07.616052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:07.864935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:07.906578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:08.456920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:08.469586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:08.474168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:08.477967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37260571-0cf1-4509-b87e-a541d3796dcd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.895327 Oct 10 10:44:08.479346 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 721/1542] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:07 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:08.485627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:08.486559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:08.494004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:08.494833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:08.495541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:08.496433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:08.498638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:08.499530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:09.266100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:09.282146 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18efe30f-7951-45b6-bf0c-ba68abc00581 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1513 microversion: 2.1 time: 0.800644 Oct 10 10:44:09.282504 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 722/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:08 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1513 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:09.290121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:09.290817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:09.306980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:09.314298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:09.315068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:09.316019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:09.316684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:09.317297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:09.460309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cb43be2-555f-41ff-bb0b-d9b5fad05e6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e/action" status: 204 len: 0 microversion: 2.1 time: 0.176125 Oct 10 10:44:09.462214 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 723/1544] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:09 2022] POST /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e/action => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:44:09.468989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:09.471390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:09.481062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:09.482070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:09.482792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:09.484846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:09.485846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:09.486799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:09.519811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:10.805685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:10.815825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:10.817563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:10.819514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f873e68b-4566-42ab-88b1-002e64f2a456 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1706 microversion: 2.42 time: 1.355884 Oct 10 10:44:10.820245 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 724/1545] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:09 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1706 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:10.824979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:10.825794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:10.831934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:10.832653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:10.833273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:10.834723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:10.835531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:10.836130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:11.459901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:11.468331 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46a6a42c-9a0c-4434-bd50-b8ef899d2908 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1316 microversion: 2.1 time: 0.646863 Oct 10 10:44:11.469253 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 725/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:10 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:11.474181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41a608c-76d1-46ae-a09a-60a06b3c449e", "name": "network-vif-plugged", "status": "completed", "tag": "667b7c05-ffd5-45b0-889a-81405610d0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:11.487328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:11.487994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:11.488708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:11.502502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Creating event network-vif-plugged:667b7c05-ffd5-45b0-889a-81405610d0f8 for instance a41a608c-76d1-46ae-a09a-60a06b3c449e on n-h2-860687-2 Oct 10 10:44:11.510440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] Instance a41a608c-76d1-46ae-a09a-60a06b3c449e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:44:11.517502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-484cc482-5dfa-40cb-9910-060f1a7ef4eb req-5fdf69bf-e97d-4eab-aa87-baa59ff47ae1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046812 Oct 10 10:44:11.518500 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 726/1547] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:11.526804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4e44d5-7d3d-419e-ba77-12ae8d96b207", "tag": "67281e89-48cd-4bca-b831-e4fda996a728"}, {"name": "network-changed", "server_uuid": "7d95e668-8ea3-411a-99c7-0a11663526e4", "tag": "154175ba-6a63-42aa-a098-001fe4c12f7e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:11.539241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:11.540187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:11.540870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:11.559826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Creating event network-changed:67281e89-48cd-4bca-b831-e4fda996a728 for instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 on n-h1-860687-2 Oct 10 10:44:11.560593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] Creating event network-changed:154175ba-6a63-42aa-a098-001fe4c12f7e for instance 7d95e668-8ea3-411a-99c7-0a11663526e4 on n-h2-860687-2 Oct 10 10:44:11.571532 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ea8714b7-3600-469a-8c46-544d821176a4 req-82890e41-db2e-42b3-a765-6d7f8d2663c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050992 Oct 10 10:44:11.572850 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 727/1548] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:11.591473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:11.593047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:11.600775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:11.601678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:11.602359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:11.603343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:11.604777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:11.605459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:12.380349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:12.399517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2bdc89b-82db-4522-9106-6a8d047a17da tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1198 microversion: 2.1 time: 0.825093 Oct 10 10:44:12.400215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 728/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:11 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1198 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:12.410294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:12.448265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:12.452426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:12.481376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:12.483644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:12.484420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:12.485589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:12.486470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:12.487116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:12.531245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:12.637979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:12.765340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:12.775305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:12.776216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:12.777138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:12.979633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0c1fda5-f2f1-4817-aad6-93b761e56f10 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.795693 Oct 10 10:44:12.980177 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 822/1550] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:44:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:12.986186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:12.986917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:13.009892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:13.010587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:13.011197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:13.012070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:13.012780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:13.013312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:13.039398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:13.357859 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d24e8843-9f4b-45ba-8d54-b4e6ffcfca5d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.956202 Oct 10 10:44:13.359060 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 729/1551] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 10:44:12 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:13.364322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:13.365771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:13.387552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:13.388128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:13.388475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:13.389194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:13.389644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:13.390075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:13.864671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:13.877541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b3299bb5-6916-48ff-a805-64a225272752 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1470 microversion: 2.1 time: 0.894746 Oct 10 10:44:13.878480 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 823/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:12 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1470 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:14.157812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b5ba515-96e6-4312-b54e-d41252fd991d tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Calling method '.version_select at 0x7f6780d3de50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:14.174020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.195070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.196632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.197496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0b5ba515-96e6-4312-b54e-d41252fd991d tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:14.197906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-310acc70-864b-4333-9e62-0d310f0ff218 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1488 microversion: 2.25 time: 0.837622 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b5ba515-96e6-4312-b54e-d41252fd991d tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/d839e625-633f-4e43-9e1b-d5e19bd29815/metadata/os_distro HTTP/1.1 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:14.213937 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'image_id': 'd839e625-633f-4e43-9e1b-d5e19bd29815', 'id': 'os_distro'} Oct 10 10:44:14.215903 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:14.216934 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d839e625-633f-4e43-9e1b-d5e19bd29815 Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:14.218191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d839e625-633f-4e43-9e1b-d5e19bd29815 could not be found. Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:14.219594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:14.220898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:14.222102 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 730/1553] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:13 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1488 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:14.222338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:14.227454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b5ba515-96e6-4312-b54e-d41252fd991d tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:14.228170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:14.230880 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b5ba515-96e6-4312-b54e-d41252fd991d tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "DELETE /compute/v2.1/images/d839e625-633f-4e43-9e1b-d5e19bd29815/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.321229 Oct 10 10:44:14.233379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 824/1554] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Oct 10 10:44:13 2022] DELETE /compute/v2.1/images/d839e625-633f-4e43-9e1b-d5e19bd29815/metadata/os_distro => generated 62 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:14.245908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:14.246736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.247343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.247789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.247916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:14.248513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.248971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.249396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.263980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.266345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.266801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.267613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.268085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.268521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.617065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.622513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.625617 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c255e5f5-fe2a-42eb-9434-7c2b16a1b58f tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1316 microversion: 2.1 time: 0.390212 Oct 10 10:44:14.636078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.636686 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 825/1555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:14 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:14.638138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.639786 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbaa4cd3-42a0-41f7-b41d-3401abf43562 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1752 microversion: 2.42 time: 0.421319 Oct 10 10:44:14.651317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.89"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:14.653096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 731/1556] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:14 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1752 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:14.655588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:14.665307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.666071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.666681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.667638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.668301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.668895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.669623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:14.675260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.676175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1113872731', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:14.681633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.682245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.682786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.683635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.684211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.684739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:14.700759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:44:14.701403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquired lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:44:14.803528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:14.890988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:14.899482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:14.899693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:14.900230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.281948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edf7b3df-4ebf-45d9-b537-619b0f55efd9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1113872731" status: 200 len: 1515 microversion: 2.1 time: 0.627434 Oct 10 10:44:15.288450 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 732/1557] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:44:14 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1113872731 => generated 1515 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:15.294552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:15.295731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:15.304559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.305264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.305911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.306727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.307381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.307920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.507875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d.", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:44:15.508616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Releasing lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:44:15.509310 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.509310 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Request method failure captured: Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action HTTP/1.1 Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 45 Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_dCY-dezhlgjneSiWcjxv5leTUReysNfTlbq5Ng8SYzNA1ONATv9u9F63gywhbO6M8V4fyhLvxXIKIrCu_KgPOOYyb-sOC-frL7EVJ_DlCt_tJltICi1E0cCTgHypDlk3oMCUfTlR-mS1AB8n5BsYre_y8X4r2-GaPIxUXlxgVdujo Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:15.511523 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d567012affb746e59a1e14b6e28a36bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d567012affb746e59a1e14b6e28a36bf"}]}] Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 25077c3099fe4defa08f24f6688e4904 Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: {"addFloatingIp": {"address": "172.25.5.89"}} Oct 10 10:44:15.513217 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7d95e668-8ea3-411a-99c7-0a11663526e4', 'body': {'addFloatingIp': {'address': '172.25.5.89'}}} Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.514218 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:44:15.515703 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.517051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.518371 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Returning 400 to user: Cannot associate floating IP 172.25.5.89 (e2b9f5e0-1bf5-4c84-a072-16a607306fec) with port 154175ba-6a63-42aa-a098-001fe4c12f7e using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 74342e93-82e4-4559-8240-24cfc91f813d. Oct 10 10:44:15.519961 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-a56b72f0-e826-4408-b5c2-fb38779fa0ad'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:15.521975 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9371f6d-d0a6-4314-95e3-131f90e9b029 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 400 len: 380 microversion: 2.1 time: 0.882363 Oct 10 10:44:15.525741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 826/1558] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:14 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 380 bytes in 885 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:15.527534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd53e4-4cac-4c86-9aca-8acc5820e1be", "name": "network-vif-plugged", "status": "completed", "tag": "4fe1c66e-14d9-40fb-b811-38af75c26b97"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:15.540832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.541840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.542022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.562097 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] Creating event network-vif-plugged:4fe1c66e-14d9-40fb-b811-38af75c26b97 for instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be on n-h2-860687-2 Oct 10 10:44:15.569772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1a68bb3a-bd90-40cb-83a5-9301cdaa5eb5 req-bcc77ebb-cb8f-4288-9bfb-e8829642703c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045840 Oct 10 10:44:15.570364 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 827/1559] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:15.576879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c997ff-7455-4af1-a1c6-5d4f51c966f5", "tag": "5a634641-7011-4942-aa65-25a2b596121b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:15.587764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.588240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.588665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.595324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:15.606680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4fc9374-0979-4472-a965-2f535129951b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1198 microversion: 2.1 time: 0.322934 Oct 10 10:44:15.606893 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] Creating event network-changed:5a634641-7011-4942-aa65-25a2b596121b for instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 on n-h2-860687-2 Oct 10 10:44:15.619948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 733/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:15 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1198 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:15.620561 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ecf36c7e-f391-4461-924b-17c7e43e60a3 req-013e0876-f0db-4d5c-94fa-9aa2b168dd45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040990 Oct 10 10:44:15.620561 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 828/1561] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:15.620767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a772f89-336c-4f7f-81ad-25a3b2b7010a tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Calling method '.version_select at 0x7f677d25e820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:15.628024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:15.628800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:15.636912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.637019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.637394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.638370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.638738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.639253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.640086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6a772f89-336c-4f7f-81ad-25a3b2b7010a tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a772f89-336c-4f7f-81ad-25a3b2b7010a tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/images/24777e0d-2387-4287-976c-de72db50d8e4/metadata/os_version HTTP/1.1 Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:15.643973 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: exception: Image not found. Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'image_id': '24777e0d-2387-4287-976c-de72db50d8e4', 'id': 'os_version'} Oct 10 10:44:15.645726 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:15.648905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 24777e0d-2387-4287-976c-de72db50d8e4 Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:15.650115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24777e0d-2387-4287-976c-de72db50d8e4 could not be found. Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:15.651660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:15.653194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a772f89-336c-4f7f-81ad-25a3b2b7010a tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:15.656064 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a772f89-336c-4f7f-81ad-25a3b2b7010a tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "GET /compute/v2.1/images/24777e0d-2387-4287-976c-de72db50d8e4/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.034355 Oct 10 10:44:15.656064 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 734/1562] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Oct 10 10:44:15 2022] GET /compute/v2.1/images/24777e0d-2387-4287-976c-de72db50d8e4/metadata/os_version => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:15.656404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:15.657001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:15.666196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.666751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.667223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:15.668015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:15.668585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:15.669013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:16.055813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.062822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.069131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.070846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.072277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27444332-e727-4050-98ff-a805ff353507 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1478 microversion: 2.25 time: 0.420496 Oct 10 10:44:16.072629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98aa92a2-0b9d-4ae2-aba7-251887a21662 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1462 microversion: 2.1 time: 0.458044 Oct 10 10:44:16.073653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 829/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:15 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1462 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:16.078721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:16.084323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.085588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:16.092924 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 735/1564] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:15 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1478 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:16.093268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:16.094292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:16.094913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:16.096029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:16.096647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:16.097235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:16.097493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b65e93d-7f03-4678-8e11-f2eac3088837 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '.version_select at 0x7f677ca1a790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:16.262195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:16.340170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:16.347703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:16.348361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:16.348811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:16.763917 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a213b56-df9a-41ea-bf60-6c148d7fbf0c tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.688875 Oct 10 10:44:16.772993 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 830/1565] 10.222.0.16 () {58 vars in 1173 bytes} [Mon Oct 10 10:44:16 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:16.778444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:16.779626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:16.788858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:16.789553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:16.790101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:16.790973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:16.791569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:16.792137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:17.623044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:17.632026 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40654be7-c418-4411-8bc8-21f79cc0c794 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1316 microversion: 2.1 time: 0.857467 Oct 10 10:44:17.636287 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 831/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:16 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1316 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:17.644635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27e5297c-8704-4bf0-b071-d630cc5e1094 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Calling method '.version_select at 0x7f677cd73c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:17.670698 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-27e5297c-8704-4bf0-b071-d630cc5e1094 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27e5297c-8704-4bf0-b071-d630cc5e1094 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/images/99aeef68-fb41-4668-895d-8b37c754957d/metadata HTTP/1.1 Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:17.679354 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'image_id': '99aeef68-fb41-4668-895d-8b37c754957d'} Oct 10 10:44:17.681147 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:17.682191 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 99aeef68-fb41-4668-895d-8b37c754957d Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:17.683601 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99aeef68-fb41-4668-895d-8b37c754957d could not be found. Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:17.684963 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:17.686381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:17.687626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27e5297c-8704-4bf0-b071-d630cc5e1094 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:17.693880 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27e5297c-8704-4bf0-b071-d630cc5e1094 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "GET /compute/v2.1/images/99aeef68-fb41-4668-895d-8b37c754957d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050550 Oct 10 10:44:17.693880 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 832/1567] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:44:17 2022] GET /compute/v2.1/images/99aeef68-fb41-4668-895d-8b37c754957d/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:17.703088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:17.705741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:17.724227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:17.724227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:17.731565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:17.732519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:17.737882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:17.738476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.280786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.292991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.295812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.297313 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65944ccb-0166-4f7f-8fb9-5c1948160672 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1844 microversion: 2.42 time: 0.604454 Oct 10 10:44:18.300152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 833/1568] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:17 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1844 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:18.322723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:18.325102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:18.346166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.347345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.347992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.348707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.349320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.349746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.689771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.700419 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74a37e8e-04d5-43a5-80aa-609b770df7c0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 200 len: 1462 microversion: 2.1 time: 0.400959 Oct 10 10:44:18.701130 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 834/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:18 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 1462 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:18.705150 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b65e93d-7f03-4678-8e11-f2eac3088837 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/e2b9f5e0-1bf5-4c84-a072-16a607306fec" status: 202 len: 0 microversion: 2.1 time: 2.611446 Oct 10 10:44:18.705917 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 736/1570] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:44:16 2022] DELETE /compute/v2.1/os-floating-ips/e2b9f5e0-1bf5-4c84-a072-16a607306fec => generated 0 bytes in 2613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:18.712104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:18.713036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:18.714856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6855075-00d1-41bd-8a95-69a2a90b2b19 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '.version_select at 0x7f6780d3d790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:18.718265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6855075-00d1-41bd-8a95-69a2a90b2b19 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.719040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6855075-00d1-41bd-8a95-69a2a90b2b19 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.719266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6855075-00d1-41bd-8a95-69a2a90b2b19 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.723019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.723775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.725035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.726154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.727034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.727696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.761024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6855075-00d1-41bd-8a95-69a2a90b2b19 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3801 microversion: 2.25 time: 0.058492 Oct 10 10:44:18.761779 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 835/1571] 10.222.0.16 () {60 vars in 1184 bytes} [Mon Oct 10 10:44:18 2022] GET /compute/v2.1/os-migrations => generated 3801 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:18.761779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:18.761779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.772708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.servers [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Removing options 'limit' from query {{(pid=128800) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 10:44:18.772933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:18.778507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.779012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.779471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.780178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.780630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.781050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:18.814322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:18.820551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:18.821339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:18.821776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.083514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:19.092449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8460caac-c63e-4be0-b733-25819af11add tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1382 microversion: 2.1 time: 0.385195 Oct 10 10:44:19.103031 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 737/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:18 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1382 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:19.104290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b7a0705-e512-4294-bd5d-b18b2f22694e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.336703 Oct 10 10:44:19.104290 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 836/1573] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 10:44:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:19.104988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95930f91-9296-402b-8c50-6e0285c94595 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Action: 'update_all', calling method: .version_select at 0x7f677d254d30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:19.105108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:19.105217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:19.123942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.132094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.132094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.132094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.132094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.132821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-95930f91-9296-402b-8c50-6e0285c94595 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95930f91-9296-402b-8c50-6e0285c94595 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/images/b296767d-e6b6-4823-8c44-fe00b7ef9a2c/metadata HTTP/1.1 Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 57 Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:19.132923 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: exception: Image not found. Oct 10 10:44:19.134808 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'image_id': 'b296767d-e6b6-4823-8c44-fe00b7ef9a2c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:19.136050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b296767d-e6b6-4823-8c44-fe00b7ef9a2c Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:19.137465 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b296767d-e6b6-4823-8c44-fe00b7ef9a2c could not be found. Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:19.138962 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:19.150404 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:19.152084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95930f91-9296-402b-8c50-6e0285c94595 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:19.152084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95930f91-9296-402b-8c50-6e0285c94595 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "PUT /compute/v2.1/images/b296767d-e6b6-4823-8c44-fe00b7ef9a2c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041074 Oct 10 10:44:19.152084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 738/1574] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:44:19 2022] PUT /compute/v2.1/images/b296767d-e6b6-4823-8c44-fe00b7ef9a2c/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:19.155740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: .version_select at 0x7f677f1b0a60>, body: {"removeFloatingIp": {"address": "172.25.5.155"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:19.497047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:19.503559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.504124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.504813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.506336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.507460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.507898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.525966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:19.538319 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a6653d2-2bcd-4472-b464-db2be4ceddb6 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1316 microversion: 2.1 time: 0.437046 Oct 10 10:44:19.539387 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 837/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:19 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:19.544270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70ed891c-4a6c-4b88-887d-e6bae77005d6 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'create', calling method: .version_select at 0x7f677d1189d0>, body: {"keypair": {"name": "tempest-keypair-1625067793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMFrHvMvp7JmrmTZTTIQKbUywlJpFav28tStUBb0PBf6Z3d17w6jhO7T+SoG1zrYmLEodaCJ+x94ZXiWUIYOVQmp3la1/+2hCG3pWss2ruHKJIoAKY1vyyoESHNDRZa+w=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:19.561234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-70ed891c-4a6c-4b88-887d-e6bae77005d6 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:19.566923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-70ed891c-4a6c-4b88-887d-e6bae77005d6 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:19.596425 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70ed891c-4a6c-4b88-887d-e6bae77005d6 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055729 Oct 10 10:44:19.597213 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 838/1576] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:19.608124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:19.608952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:19.621050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.621710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.622261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:19.636136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:19.636768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:19.637519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.029109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] Lazy-loading 'services' on Instance uuid be4e44d5-7d3d-419e-ba77-12ae8d96b207 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:44:20.047301 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48891175-8754-4c78-bfeb-ca7f46b2fa45 tempest-LiveAutoBlockMigrationV225Test-2107045375 tempest-LiveAutoBlockMigrationV225Test-2107045375-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1971 microversion: 2.25 time: 0.448888 Oct 10 10:44:20.048323 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 839/1577] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:19 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1971 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:20.054235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "cc4d9617-8d19-468f-ae51-56148d59eab0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:20.065683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.066532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.067161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.080741 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] Creating event network-changed:cc4d9617-8d19-468f-ae51-56148d59eab0 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:20.087245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-adb4cebe-583f-42dc-b054-417a7bd50d69 req-c3eac5e6-3132-4a3f-8bdd-b38c039df3e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037241 Oct 10 10:44:20.088514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 840/1578] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:20.094971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:20.096065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:20.115910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.116722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.117515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.118575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.120088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.121636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:44:20.122217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquired lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:44:20.122488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.503044 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19f07263-e31f-4635-b92a-c349081ed3a8 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1533 microversion: 2.1 time: 0.412561 Oct 10 10:44:20.504002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 841/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:20 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1533 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:20.510810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6cad15b7-00ba-49bf-b68d-2f1a7336e2e2 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Action: 'update', calling method: .version_select at 0x7f677cbb8040>, body: {"meta": {"os_distro": "alt"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:20.543091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6cad15b7-00ba-49bf-b68d-2f1a7336e2e2 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6cad15b7-00ba-49bf-b68d-2f1a7336e2e2 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/images/5a2e23b1-baf7-44d9-a14c-5fd038397ae2/metadata/os_distro HTTP/1.1 Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 30 Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:20.545370 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: {"meta": {"os_distro": "alt"}} Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:44:20.547026 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'image_id': '5a2e23b1-baf7-44d9-a14c-5fd038397ae2', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:20.548363 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a2e23b1-baf7-44d9-a14c-5fd038397ae2 Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:20.549772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a2e23b1-baf7-44d9-a14c-5fd038397ae2 could not be found. Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:20.551294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:20.553441 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:20.554991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6cad15b7-00ba-49bf-b68d-2f1a7336e2e2 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:20.554991 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6cad15b7-00ba-49bf-b68d-2f1a7336e2e2 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "PUT /compute/v2.1/images/5a2e23b1-baf7-44d9-a14c-5fd038397ae2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.041575 Oct 10 10:44:20.554991 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 842/1580] 10.222.0.16 () {60 vars in 1310 bytes} [Mon Oct 10 10:44:20 2022] PUT /compute/v2.1/images/5a2e23b1-baf7-44d9-a14c-5fd038397ae2/metadata/os_distro => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:20.561548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:20.567649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:20.569734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:20.576436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.577064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.577612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.578726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.579341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.579882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.697111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:20.797401 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9acedd48-7856-473f-9ddf-6efc8a07ebbc tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.238225 Oct 10 10:44:20.798316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 843/1581] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:44:20 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:20.811347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:20.812374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:20.829237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.830309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.832167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:20.833013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:20.836872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:20.837736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:21.992004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:44:22.037025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:22.048107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:22.050721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:22.053157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cedc78ff-9b51-4cb5-955d-162fa368c342 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1865 microversion: 2.42 time: 1.252794 Oct 10 10:44:22.053959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 844/1582] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:20 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1865 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:22.059450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c997ff-7455-4af1-a1c6-5d4f51c966f5", "name": "network-vif-plugged", "status": "completed", "tag": "5a634641-7011-4942-aa65-25a2b596121b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:22.073485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.074226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.074871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.095837 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] Creating event network-vif-plugged:5a634641-7011-4942-aa65-25a2b596121b for instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 on n-h2-860687-2 Oct 10 10:44:22.107230 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bbf9fc67-45f8-4d97-9187-8e5d76a4fc2c req-5cfcfbab-b971-4a28-8134-4b2ead9aadcf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049503 Oct 10 10:44:22.108907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 845/1583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:22.116145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:22.117071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:22.142695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.143557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.144782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.147348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.148144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.149033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.212629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:22.219283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:22.320575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa336df6-eb64-4794-8cbf-0de8bec9577f tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 204 len: 0 microversion: 2.25 time: 0.207593 Oct 10 10:44:22.325306 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 846/1584] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:44:22 2022] DELETE /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:44:22.334770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:22.336553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:22.343882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.344457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.344957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.346482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.347065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.347499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.687820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-06a9e852-cf6d-411b-b0b8-739dc18f8c1d tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1533 microversion: 2.1 time: 0.361072 Oct 10 10:44:22.703023 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 847/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:22 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1533 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:22.703023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e250d19-5d52-4eb1-b18f-cd5b65616fc5 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Action: 'create', calling method: .version_select at 0x7f677c08cee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:22.721418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8e250d19-5d52-4eb1-b18f-cd5b65616fc5 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] HTTP exception thrown: Image not found. Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e250d19-5d52-4eb1-b18f-cd5b65616fc5 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Request method failure captured: Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/images/28332022-8227-4a32-b56a-7652a72c5797/metadata HTTP/1.1 Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 57 Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_d6wYrA4LlrKYDsrF7nerTGCLpY_A-1HBjp6RdO_EoJy5k-yYtvqC6FdHdwlq59E6JEm3Evdf9pGQ336isXMaG_Ib6OsfE8LY7hhsDcKSkeXcwNcqxpUQebdmMSEwAkJCR-sdswmdzAbsbXU1Mian_K9EbG3kkYjHBCxtL3ruY7RYk Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:22.724544 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90274ffe6e274d7da232b718b4743ebf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90274ffe6e274d7da232b718b4743ebf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90274ffe6e274d7da232b718b4743ebf"}]}] Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 90274ffe6e274d7da232b718b4743ebf Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-320540817 Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3cc9b59367a64cc3bfdbaa19ada92f7e Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-320540817-project Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:44:22.726249 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'image_id': '28332022-8227-4a32-b56a-7652a72c5797', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:22.727432 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 28332022-8227-4a32-b56a-7652a72c5797 Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:44:22.732461 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28332022-8227-4a32-b56a-7652a72c5797 could not be found. Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:22.734016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:44:22.735526 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:22.737285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e250d19-5d52-4eb1-b18f-cd5b65616fc5 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:22.737285 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e250d19-5d52-4eb1-b18f-cd5b65616fc5 tempest-ImagesMetadataNegativeTestJSON-320540817 tempest-ImagesMetadataNegativeTestJSON-320540817-project] 10.222.0.16 "POST /compute/v2.1/images/28332022-8227-4a32-b56a-7652a72c5797/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036543 Oct 10 10:44:22.737285 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 848/1586] 10.222.0.16 () {60 vars in 1281 bytes} [Mon Oct 10 10:44:22 2022] POST /compute/v2.1/images/28332022-8227-4a32-b56a-7652a72c5797/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:22.737285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:22.737285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:22.746866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.748074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.748517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:22.749233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:22.749776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:22.750320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.195813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:23.206311 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5fcac3d3-a5d9-4056-8607-d8f4f7abd256 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1316 microversion: 2.1 time: 0.477557 Oct 10 10:44:23.207841 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 849/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:22 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:23.215174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:23.222258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:23.223146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.servers [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Removing options 'limit' from query {{(pid=128800) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 10:44:23.224835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:23.232048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.232864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.233580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.234483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.235039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.235897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.276663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:23.343715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b8f9c88-c5b8-437f-8192-4cfbf92e4672 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.133972 Oct 10 10:44:23.345424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 850/1588] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Oct 10 10:44:23 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:23.358872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ee6ce42-9e8f-4691-9c76-e210355e492b tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '.version_select at 0x7f677c08c0d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:23.368295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee6ce42-9e8f-4691-9c76-e210355e492b tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.368924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee6ce42-9e8f-4691-9c76-e210355e492b tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.369480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee6ce42-9e8f-4691-9c76-e210355e492b tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.390814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ee6ce42-9e8f-4691-9c76-e210355e492b tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3490 microversion: 2.1 time: 0.044030 Oct 10 10:44:23.405315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 851/1589] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:44:23 2022] GET /compute/v2.1/os-migrations => generated 3490 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:23.413419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "56698754-5517-4926-b856-1f98d0d5ac33"}, {"name": "network-changed", "server_uuid": "7d95e668-8ea3-411a-99c7-0a11663526e4", "tag": "154175ba-6a63-42aa-a098-001fe4c12f7e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:23.425140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.425628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.426221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.442583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Creating event network-changed:56698754-5517-4926-b856-1f98d0d5ac33 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:23.443990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] Creating event network-changed:154175ba-6a63-42aa-a098-001fe4c12f7e for instance 7d95e668-8ea3-411a-99c7-0a11663526e4 on n-h2-860687-2 Oct 10 10:44:23.455307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-af0adb4d-7acc-4a1e-8109-73388d963947 req-022bf454-82ee-4f28-a813-891bfdcf3fd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049453 Oct 10 10:44:23.456470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 852/1590] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:23.462536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:23.463503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:23.470837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.471528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.472382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.473367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.473691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.475444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.713226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Updating instance_info_cache with network_info: [{"id": "154175ba-6a63-42aa-a098-001fe4c12f7e", "address": "fa:16:3e:9b:ef:5c", "network": {"id": "cb671461-8f86-4f89-af36-d23b366da2d1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1754584266-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d567012affb746e59a1e14b6e28a36bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap154175ba-6a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:44:23.757696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Releasing lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:44:23.758596 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a70f8c67-bf7d-4487-ad5c-3c3784690b03 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 202 len: 0 microversion: 2.1 time: 4.609594 Oct 10 10:44:23.763332 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 739/1591] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:19 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 0 bytes in 4615 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:44:23.768759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:23.775730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.776512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.777142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.778147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.778805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.780067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.810797 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a2de2d4-5459-438c-abe3-a8acc2b15484 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046458 Oct 10 10:44:23.821228 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 740/1592] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 10:44:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:23.827801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:23.829080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:23.842383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.843312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.843909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:23.844967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:23.845673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:23.846255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:24.456698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.469315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.471647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.475293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19de8ab7-8765-41ac-8dc3-5a677e8dc40b tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1484 microversion: 2.25 time: 1.015844 Oct 10 10:44:24.476445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 853/1593] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:23 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1484 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:24.490394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:24.510825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.517074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:24.518965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:24.530152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:24.530711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:24.531226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:24.535077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:24.536642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:24.537825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:24.544074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.562283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.563782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:24.564968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-357718c4-bb83-4720-a591-b0a708a55ea0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1886 microversion: 2.42 time: 0.742353 Oct 10 10:44:24.566784 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 741/1594] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:23 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1886 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:24.571975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-595e891b-b9c1-4ac9-90d3-ecf08d56d679 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:24.591762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-595e891b-b9c1-4ac9-90d3-ecf08d56d679 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023563 Oct 10 10:44:24.592450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:24.592882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 742/1595] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:44:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:24.598611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b60c2af-a448-4b51-b422-eb82c65ee063 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '.version_select at 0x7f677c548550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:24.638967 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9fc686ac-2ca2-4799-88df-c5ae4119d53f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.161118 Oct 10 10:44:24.640054 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 854/1596] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:44:24 2022] GET /compute/v2.1/servers => generated 1011 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:24.645099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860687-2", "block_migration": false, "disk_over_commit": false}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:24.648673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:24.655426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:24.655748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:24.656184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:24.656887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:24.657335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:24.658401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:24.687889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lazy-loading 'flavor' on Instance uuid 00cd53e4-4cac-4c86-9aca-8acc5820e1be {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:44:24.703822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Going to try to live migrate instance to n-h1-860687-2 {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 10:44:24.890556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:26.852315 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-420ffad3-42e3-4249-8b32-1f9590e87f36 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be/action" status: 202 len: 0 microversion: 2.1 time: 2.210027 Oct 10 10:44:26.854764 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 855/1597] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:24 2022] POST /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be/action => generated 0 bytes in 2214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:26.867961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:26.870097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:26.893072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:26.904474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:26.908027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:26.909024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:26.911494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:26.912488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:26.970375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b60c2af-a448-4b51-b422-eb82c65ee063 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/673660cb-9341-42cf-aa12-0cf1734f6848" status: 202 len: 0 microversion: 2.1 time: 2.375848 Oct 10 10:44:26.971616 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 743/1598] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:44:24 2022] DELETE /compute/v2.1/os-floating-ips/673660cb-9341-42cf-aa12-0cf1734f6848 => generated 0 bytes in 2378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:26.979590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17b595a3-790a-4802-9b61-62d26def3f86 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1585393539", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:27.057305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17b595a3-790a-4802-9b61-62d26def3f86 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.082797 Oct 10 10:44:27.060409 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 744/1599] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Oct 10 10:44:26 2022] POST /compute/v2.1/flavors => generated 499 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:27.093788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.106939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.108098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:27.125713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.126535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.127347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.130448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.131990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.132959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.253543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.261056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:27.281774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d91f44e4-55dc-404a-a372-0caaf59af3c9 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1505 microversion: 2.1 time: 0.422019 Oct 10 10:44:27.303546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 856/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:26 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:27.321117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.321743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:27.334260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.334786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.335247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.335964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.341247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.341779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.348292 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-597ec4d7-b157-4131-8d4f-91dabef89912 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.284724 Oct 10 10:44:27.352616 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 745/1601] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:27.366708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.367781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:27.375083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.375981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.376655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.377599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.378283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.378932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.392537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:27.522221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.534968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.536919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.539643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f8ee5d5-aa67-498b-bb77-eb45c7088f03 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1266 microversion: 2.25 time: 0.234750 Oct 10 10:44:27.540573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 857/1602] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:27.556277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6"}, {"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "2cdf4285-725e-4f67-bc52-d7e2945c3b0b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:27.576013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.576400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.579809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.601674 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Creating event network-changed:4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:27.602101 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] Creating event network-changed:2cdf4285-725e-4f67-bc52-d7e2945c3b0b for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:27.607932 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-71e01d1e-fa77-407b-a829-a3a6ad0ae390 req-81821005-5dff-486e-888f-b5c457ffc0ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065962 Oct 10 10:44:27.609470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 858/1603] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:27.768664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.769385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:27.776690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.777198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.777641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.778361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.778823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.779283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.792333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.807782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.810581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:27.815745 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4f83f96-dfa6-4ce4-bc4f-c0dfb0d2d45b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.460914 Oct 10 10:44:27.816708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 746/1604] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:27.825135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60c1953a-a8cd-425e-95d2-ac3d3996f87d tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: .version_select at 0x7f677e729b80>, body: {"addFloatingIp": {"address": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60c1953a-a8cd-425e-95d2-ac3d3996f87d tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Request method failure captured: Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action HTTP/1.1 Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 34 Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dCY-dezhlgjneSiWcjxv5leTUReysNfTlbq5Ng8SYzNA1ONATv9u9F63gywhbO6M8V4fyhLvxXIKIrCu_KgPOOYyb-sOC-frL7EVJ_DlCt_tJltICi1E0cCTgHypDlk3oMCUfTlR-mS1AB8n5BsYre_y8X4r2-GaPIxUXlxgVdujo Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:27.830111 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d567012affb746e59a1e14b6e28a36bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d567012affb746e59a1e14b6e28a36bf"}]}] Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 25077c3099fe4defa08f24f6688e4904 Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: {"addFloatingIp": {"address": ""}} Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:27.831687 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7d95e668-8ea3-411a-99c7-0a11663526e4', 'body': {'addFloatingIp': {'address': ''}}} Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:27.832596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:44:27.836461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:44:27.839891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 10:44:27.839891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:27.841493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60c1953a-a8cd-425e-95d2-ac3d3996f87d tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:27.842597 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60c1953a-a8cd-425e-95d2-ac3d3996f87d tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 400 len: 142 microversion: 2.1 time: 0.022426 Oct 10 10:44:27.843816 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 747/1605] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:27 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:27.852450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8d1ee81-0a81-4f0d-bb89-46e5792bd55e tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.875878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8d1ee81-0a81-4f0d-bb89-46e5792bd55e tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030621 Oct 10 10:44:27.877277 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 748/1606] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:44:27.891232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:27.892309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:27.916680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.918071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.918788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:27.922008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:27.924010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:27.924767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.003710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:28.004726 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b225cc4f-4e3b-4ddb-98ce-dbf18e635cfe tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/os-instance-actions/req-738e3009-7ad3-4372-a4e5-935ec4d84c94" status: 200 len: 313 microversion: 2.1 time: 0.126202 Oct 10 10:44:28.011962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 749/1607] 10.222.0.16 () {58 vars in 1419 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/os-instance-actions/req-738e3009-7ad3-4372-a4e5-935ec4d84c94 => generated 313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:28.022391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:28.035882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:28.036867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.servers [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Removing options 'limit' from query {{(pid=128801) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 10:44:28.037531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:28.055193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.055682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.056123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.057196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.057654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.067396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.104863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-040bfcc2-e619-4db2-ab65-fd9ef242d35d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.091753 Oct 10 10:44:28.106653 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 750/1608] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 10 10:44:28 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:28.112189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:28.115354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:28.117562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:28.123319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.124262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.124903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.125807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.126433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.127051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.160578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:28.162002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:44:28.163311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquired lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:44:28.186177 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a9efdd3-8dbf-4840-b84f-96d67c8c96f6 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.575484 Oct 10 10:44:28.200329 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 859/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:27 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:28.212000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:28.229787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:28.236009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.236788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.237519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.238424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.251903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.252653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.366424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:28.373168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Releasing lock "refresh_cache-7d95e668-8ea3-411a-99c7-0a11663526e4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:44:28.373986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] HTTP exception thrown: floating IP not found Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Request method failure captured: Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action HTTP/1.1 Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 41 Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dCY-dezhlgjneSiWcjxv5leTUReysNfTlbq5Ng8SYzNA1ONATv9u9F63gywhbO6M8V4fyhLvxXIKIrCu_KgPOOYyb-sOC-frL7EVJ_DlCt_tJltICi1E0cCTgHypDlk3oMCUfTlR-mS1AB8n5BsYre_y8X4r2-GaPIxUXlxgVdujo Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:28.384612 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d567012affb746e59a1e14b6e28a36bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d567012affb746e59a1e14b6e28a36bf"}]}] Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 25077c3099fe4defa08f24f6688e4904 Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:28.386342 n-d-860687-2 devstack@n-api.service[128801]: exception: floating IP not found Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7d95e668-8ea3-411a-99c7-0a11663526e4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:28.387906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 10 10:44:28.389426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.393114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Returning 404 to user: floating IP not found {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:28.393884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28f9f44c-8f5c-4fe9-9ca1-b77a00e66b4c tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 404 len: 67 microversion: 2.1 time: 0.285999 Oct 10 10:44:28.394871 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 751/1610] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:28 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 67 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:28.408715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-333611423", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "e5284a1b-908b-4a9d-8256-5b4ba676f634"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:28.413971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4040cb23-898c-4690-b85f-3b0a61a679b4 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "POST /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/action" status: 202 len: 0 microversion: 2.1 time: 0.212031 Oct 10 10:44:28.417115 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 860/1611] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:28 2022] POST /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:28.429530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:28.451282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:28.452312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1113872731', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:28.459038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.459718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.465001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.466092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.466800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.467461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.511870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:44:28.671324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:28.754513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6df0061d-5b9c-4c92-93e5-b0b7f08385d9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1113872731" status: 200 len: 346 microversion: 2.1 time: 0.336019 Oct 10 10:44:28.765178 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 861/1612] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:44:28 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1113872731 => generated 346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:28.777900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5058980d-235a-449e-9382-d45aec22ca6a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Action: 'action', calling method: .version_select at 0x7f677f1b0a60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:28.928074 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5058980d-235a-449e-9382-d45aec22ca6a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5058980d-235a-449e-9382-d45aec22ca6a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Request method failure captured: Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action HTTP/1.1 Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 44 Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_dCY-dezhlgjneSiWcjxv5leTUReysNfTlbq5Ng8SYzNA1ONATv9u9F63gywhbO6M8V4fyhLvxXIKIrCu_KgPOOYyb-sOC-frL7EVJ_DlCt_tJltICi1E0cCTgHypDlk3oMCUfTlR-mS1AB8n5BsYre_y8X4r2-GaPIxUXlxgVdujo Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:28.935224 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d567012affb746e59a1e14b6e28a36bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d567012affb746e59a1e14b6e28a36bf"}]}] Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 25077c3099fe4defa08f24f6688e4904 Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:28.936815 n-d-860687-2 devstack@n-api.service[128800]: exception: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7d95e668-8ea3-411a-99c7-0a11663526e4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:28.937744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 10 10:44:28.939140 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:28.942272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5058980d-235a-449e-9382-d45aec22ca6a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:28.942272 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5058980d-235a-449e-9382-d45aec22ca6a tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action" status: 404 len: 88 microversion: 2.1 time: 0.167387 Oct 10 10:44:28.948359 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 862/1613] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:28 2022] POST /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4/action => generated 88 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:28.952120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:28.952863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:28.970236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.972599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.973748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:28.976500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:28.977820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:28.979080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:29.576257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:29.676604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:29.691530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-21c8c14c-d0f7-42b0-8080-63e689e96000 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1507 microversion: 2.1 time: 0.743345 Oct 10 10:44:29.694483 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 863/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:28 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:29.709372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:29.710249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:29.726113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:29.727180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:29.728208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:29.729143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:29.732211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:29.732866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:29.805698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:44:29.807063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:44:29.807515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:44:29.807931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:44:29.808412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:44:29.823714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:29.824558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:29.825168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:29.826113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:29.826849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:29.827476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:29.836762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=13 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:29.857431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:29.874158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:29.906931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:44:29.915290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:44:29.963415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:29.977720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:29.984403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:29.985679 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df762e5c-e603-4dac-b7b7-d3cd15c706ba tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1266 microversion: 2.25 time: 0.285706 Oct 10 10:44:29.986382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 864/1615] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:29 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:30.000437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:30.023729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.024240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.024673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.030613 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2ba16fd-a564-4723-b3ba-cdd689b9ac3e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.633819 Oct 10 10:44:30.035968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 752/1616] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:44:30.049454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:30.051896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:30.058908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.059869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.060478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.061355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.065715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.066427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.188498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 10:44:30.306834 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3db86ce9-0d44-467f-8e32-62498321d52f tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "POST /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30/action" status: 202 len: 0 microversion: 2.1 time: 0.319115 Oct 10 10:44:30.308005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 865/1617] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:29 2022] POST /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:30.327273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:30.328160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:30.346619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.347410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.348247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.351851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.352505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.353584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.695330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:30.851559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e994e22-166e-4bed-9778-066d8b821d6e tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 204 len: 0 microversion: 2.1 time: 0.541631 Oct 10 10:44:30.852412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 866/1618] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:44:30 2022] DELETE /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:44:30.866042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:30.870681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:30.885020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.885935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.886481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.887514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:30.888257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:30.889050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:30.953763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:30.975565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:30.978023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:30.979501 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc4b5423-38c4-49dd-824c-3dd7601956f9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.941832 Oct 10 10:44:30.982387 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 753/1619] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:30 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:30.999530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4e44d5-7d3d-419e-ba77-12ae8d96b207", "name": "network-vif-deleted", "tag": "67281e89-48cd-4bca-b831-e4fda996a728"}, {"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "cfddb5ce-0ba5-48b3-a0ea-9a684b78719d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:31.013816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.014587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.015225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.034825 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Creating event network-vif-deleted:67281e89-48cd-4bca-b831-e4fda996a728 for instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 on n-h2-860687-2 Oct 10 10:44:31.036749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] Creating event network-changed:cfddb5ce-0ba5-48b3-a0ea-9a684b78719d for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:31.048319 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-34a584dc-ad8a-4d5c-9a9a-e8948927a0aa req-7c481857-078a-4375-b5b9-56127fdcbbe7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063139 Oct 10 10:44:31.050376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 754/1620] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:31.062424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:31.063889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:31.076655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.077504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.078119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.079637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.080316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.080982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.220061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.237991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f3f08e3-36b8-44a2-bf43-f7430fed2878 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1282 microversion: 2.1 time: 0.183893 Oct 10 10:44:31.241333 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 755/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:31 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:31.251991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.259780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:31.260772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:31.270275 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81a6c64f-247f-43a7-a6ab-e565d8609d94 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.413399 Oct 10 10:44:31.270766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.271149 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 867/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:30 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:31.272430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.273823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.275018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.275665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.276322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.278216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:31.278835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:31.296241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.296645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.297091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.297811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.298271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.298696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.651735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.663652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6185f31e-2b7d-46a7-b21a-4dc46f87c0c0 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1507 microversion: 2.1 time: 0.391427 Oct 10 10:44:31.679481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 868/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:31 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:31.691622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:31.693195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:31.695774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.703697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.704920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.705735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.708556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-051e80a3-e742-4fb0-8b0b-28829431e87b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.463326 Oct 10 10:44:31.709575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.710092 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 756/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:31 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:31.710613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.711507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.720378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:31.721353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:31.740453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.741337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.744326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.749838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:31.750791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:31.751440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:31.886385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.898465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.900403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:31.901935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6a1bbe8-c78b-4d77-ac40-a63145abd6e7 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1266 microversion: 2.25 time: 0.189631 Oct 10 10:44:31.923626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 757/1625] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:31 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:32.010433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:32.011160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:32.022768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.023292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.031299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.040951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.042633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.043731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.086074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:32.094956 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec046f87-8af0-4cda-8b99-5dbef7a593c7 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1541 microversion: 2.1 time: 0.409650 Oct 10 10:44:32.101945 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 869/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:31 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1541 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:32.266790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:32.267713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:32.279393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.283122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.287173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.288218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.288899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.289574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.577322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:32.597819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:32.599930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:32.608435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89344709-4196-4b02-a716-f3638f8a9cbc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.603704 Oct 10 10:44:32.615688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 758/1627] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:32 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:32.631219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:32.631840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:32.646837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.647401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.648152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.649286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.650412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.652662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.724595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:32.735767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f10bbfb-528d-43db-870a-bf944cc94df0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1282 microversion: 2.1 time: 0.473442 Oct 10 10:44:32.737722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 870/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:32 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1282 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:32.755880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:32.756728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:32.778462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.782145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.783034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:32.784015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:32.784729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:32.786128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.266575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.279947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b01136f5-230c-440f-beae-357c5159c5c3 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1507 microversion: 2.1 time: 0.540904 Oct 10 10:44:33.280882 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 871/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:32 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:33.289623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:33.290256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:33.306304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.307236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.308048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.308993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.309637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.310267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.491363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.510460 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e306c87-013e-4a5b-a34e-5897d6c7a10e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.893667 Oct 10 10:44:33.511087 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 759/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:32 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:33.532137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:33.535039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:33.559268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.559833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.560287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.565657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.574151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.574608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.643816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.644308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.645074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.646860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lazy-loading 'fault' on Instance uuid be4e44d5-7d3d-419e-ba77-12ae8d96b207 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:44:33.720567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.722945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.734144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e40fc2f-65ba-4261-a275-37ebc83195f9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.452174 Oct 10 10:44:33.750848 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 872/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:33 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:33.751304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.751304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:33.751304 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b08fceb3-02ff-42a8-801c-29eacd87f4a9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 200 len: 1271 microversion: 2.25 time: 0.231342 Oct 10 10:44:33.753576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:33.754251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:33.762019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.762760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.763591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.764500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.765126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.765731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.771829 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 760/1632] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:33 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:33.783642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "198e4aa3-6b8a-4203-be82-10cfce441ef5"}, {"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:33.821394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.823459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.824411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.842794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Creating event network-changed:198e4aa3-6b8a-4203-be82-10cfce441ef5 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:33.844851 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] Creating event network-changed:3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:44:33.858588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f0b13dca-6c55-4fd7-8299-40b0bddf34d7 req-3a9dbc8b-ab4e-4362-8710-eb4761a0482a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085294 Oct 10 10:44:33.861239 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 761/1633] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:33.870729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:33.876032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:33.892834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.894586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.896070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:33.899777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:33.900448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:33.901052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:34.856381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25077c3099fe4defa08f24f6688e4904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567012affb746e59a1e14b6e28a36bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:34.872209 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd865a56-91ec-4a32-a6ce-644a87cc599b tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 200 len: 1541 microversion: 2.1 time: 1.135206 Oct 10 10:44:34.879457 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 873/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:33 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 1541 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:34.904792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:34.906490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:34.928496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:34.929056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:34.929507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:34.929922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:34.930395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:34.930783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:34.931265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:34.956654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:34.966729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:34.973890 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48ce2090-04e2-4e4b-80c6-ebcae50fe681 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 1.110776 Oct 10 10:44:34.976679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 762/1635] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:33 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:34.988251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:34.989681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:35.005856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.009189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.009933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.011083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.013390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.014209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.189772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:35.199801 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79e3a8a8-63d0-4067-8b2f-b40aca7341f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1336 microversion: 2.1 time: 0.318192 Oct 10 10:44:35.215227 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 874/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:34 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1336 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:35.223828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:35.224761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:35.231913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.232593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.233236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.234199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.234839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.235733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.287073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:35.616254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:35.624784 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9fef338-7b0c-45d4-a206-3b1ada64c917 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1505 microversion: 2.1 time: 0.645054 Oct 10 10:44:35.626253 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 763/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:34 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:35.688169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:35.704081 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1604154a-65b5-415c-af2d-a02f8e152982 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.485591 Oct 10 10:44:35.707824 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 875/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:35 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:35.716108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:35.716961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:35.723274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.724501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.725097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.726203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.726810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.727430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.769493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d95e668-8ea3-411a-99c7-0a11663526e4", "name": "network-vif-deleted", "tag": "154175ba-6a63-42aa-a098-001fe4c12f7e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:35.779888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.780594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.781205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.793466 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] Creating event network-vif-deleted:154175ba-6a63-42aa-a098-001fe4c12f7e for instance 7d95e668-8ea3-411a-99c7-0a11663526e4 on n-h2-860687-2 Oct 10 10:44:35.799174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-37188cc9-5d11-4900-ab69-a2dcc4c5e85a req-9ba75356-8dda-4219-b247-635241004aa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171497 Oct 10 10:44:35.800234 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 764/1639] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:35.807461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:35.808929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: be4e44d5-7d3d-419e-ba77-12ae8d96b207] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:35.815564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.816324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.816943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.818418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:35.819075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:35.819670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:35.835265 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] HTTP exception thrown: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Request method failure captured: Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 HTTP/1.1 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XruIRgmzjkNDw9YWqe8XvE4jvO9ZEa29YdXAxbLqwFM4JNvh27cn4PFtY2eNYj_vzIrYKVIzYWxO8_g0DodesbEWQxJOww7W3sCdnr-mixujt1XaMqSDnoYJHNrukKRmEvLUwtoebMPUz3iq8_HB54ty4oAYb89mi2n1BVx6en3mc Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:35.837247 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff5e9dcf466b4acd8a44bcdc0cfbdde7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}] Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 78daecbab97943d5a26534e791ae8107 Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. Oct 10 10:44:35.839535 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'be4e44d5-7d3d-419e-ba77-12ae8d96b207'} Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:35.840656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. Oct 10 10:44:35.842248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:35.844388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Returning 404 to user: Instance be4e44d5-7d3d-419e-ba77-12ae8d96b207 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:35.845517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d87040eb-348b-4cc4-b496-9651707ae9bd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207" status: 404 len: 111 microversion: 2.25 time: 0.044032 Oct 10 10:44:35.861137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 765/1640] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:35 2022] GET /compute/v2.1/servers/be4e44d5-7d3d-419e-ba77-12ae8d96b207 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:35.969416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-662102031", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8adcea62-172b-4b2d-a9dc-5bc930072e9a"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:36.122485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] validate_networks() for [('8adcea62-172b-4b2d-a9dc-5bc930072e9a', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:44:36.214779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:36.226727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e14b4b93-3c3f-4889-a718-016e6668a4e7 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.517380 Oct 10 10:44:36.241354 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 876/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:35 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:36.253182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '.version_select at 0x7f677c049940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:36.254039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:36.264039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.265015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.265639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:36.266659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.267471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.269289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:36.335826 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80d7f932-0799-476f-8af6-a88e9be4b387 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.092941 Oct 10 10:44:36.336874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 877/1642] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Oct 10 10:44:36 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5/os-instance-actions => generated 611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:36.342642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:36.343461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] [instance: 7d95e668-8ea3-411a-99c7-0a11663526e4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:36.353997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.355460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.356151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:36.357086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.357756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.358491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:36.385424 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] HTTP exception thrown: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Request method failure captured: Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 HTTP/1.1 Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_dCY-dezhlgjneSiWcjxv5leTUReysNfTlbq5Ng8SYzNA1ONATv9u9F63gywhbO6M8V4fyhLvxXIKIrCu_KgPOOYyb-sOC-frL7EVJ_DlCt_tJltICi1E0cCTgHypDlk3oMCUfTlR-mS1AB8n5BsYre_y8X4r2-GaPIxUXlxgVdujo Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:36.387724 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d567012affb746e59a1e14b6e28a36bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d567012affb746e59a1e14b6e28a36bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d567012affb746e59a1e14b6e28a36bf"}]}] Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d567012affb746e59a1e14b6e28a36bf Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 25077c3099fe4defa08f24f6688e4904 Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:44:36.389363 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7d95e668-8ea3-411a-99c7-0a11663526e4'} Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:36.390288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. Oct 10 10:44:36.392829 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:36.397067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] Returning 404 to user: Instance 7d95e668-8ea3-411a-99c7-0a11663526e4 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:36.398182 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb3e6b45-fd71-457a-aa03-82d45afe9e88 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122 tempest-FloatingIPsAssociationNegativeTestJSON-1648841122-project] 10.222.0.16 "GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4" status: 404 len: 111 microversion: 2.1 time: 0.060138 Oct 10 10:44:36.400089 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 878/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:36 2022] GET /compute/v2.1/servers/7d95e668-8ea3-411a-99c7-0a11663526e4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:44:36.422653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:36.424355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:36.440540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.443705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.444408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:36.446855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:36.448563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:36.450462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.212363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:37.229342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:37.230789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:37.238046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d32e53d9-1186-422f-8e96-5cadc376bc6b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.836692 Oct 10 10:44:37.239167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 879/1644] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:36 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:37.243895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:37.244520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:37.262731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.263177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.263617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.264321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.264774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.265195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.730212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:44:37.731198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:44:37.731641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:44:37.732251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:44:37.732853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:44:37.752801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.757450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.758252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.759283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.759759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.760193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.821297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:37.841762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for user 53f07854e54a44689b1067dbcd0ec464 and project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:37.867296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:44:37.869761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:44:37.907397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:37.918142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a7e8c77-7343-4492-9b46-03e013eb3ac0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.677835 Oct 10 10:44:37.935040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 880/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:37 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:37.941680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:37.941680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:37.959426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.960684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.962039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.964932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:37.967318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:37.967824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:37.993599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8da7203f-bb49-4b14-8315-6e462c866b61 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.130952 Oct 10 10:44:38.001430 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 766/1646] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:44:38.021250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:38.039915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:38.066399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:38.067814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:38.069581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:38.074146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:38.075041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:38.077597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:38.078503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:38.368750 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14847520-bece-43ae-903e-85a3b923d5b5 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "DELETE /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 204 len: 0 microversion: 2.1 time: 0.428234 Oct 10 10:44:38.369653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 881/1647] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:44:37 2022] DELETE /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:44:38.385957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:38.386667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:38.428471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:38.429275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:38.430642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:38.431610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:38.436981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:38.437757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:38.534665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:39.308274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:39.324947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e3f9b3d-33d8-4995-b049-06d9354d6276 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.951155 Oct 10 10:44:39.325569 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 882/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:38 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:39.370525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:39.371458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:39.393135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.393650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.394098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:39.394831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.395944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.396681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:39.572087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:39.585595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ef9f7d4-872c-464d-86a0-3319bd0df950 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 1.575588 Oct 10 10:44:39.607093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 767/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:38 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:39.617685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:39.622188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:39.638607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.651836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.652513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:39.653590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.654191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.654743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:39.758808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:39.766829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc9aceda-313b-4f92-bb73-f664cf4a38a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1259 microversion: 2.1 time: 0.424946 Oct 10 10:44:39.775200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 883/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:39 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1259 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:39.779935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:39.780558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:39.811929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.812350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.812800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:39.813528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:39.813989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:39.814421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.128498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:41.140348 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4640b3f-c6df-439b-b755-cd836bf4bbde tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1511 microversion: 2.1 time: 1.364034 Oct 10 10:44:41.143804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 884/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:39 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1511 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:41.155920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:41.160022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:41.173357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.180275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.181097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.182061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.182846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.183618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.364963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:41.388971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:41.394791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:41.397103 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42c80c76-881f-40ac-adf6-7bb8aca7cfa3 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 1.788650 Oct 10 10:44:41.404109 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 768/1652] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:39 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:41.413989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:41.418433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:41.435776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.436558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.437710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.440607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.441743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.445258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.495537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:41.917597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:41.932000 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fee89635-e2d5-4efb-868b-590264693a06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.782499 Oct 10 10:44:41.932730 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 885/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:41 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:41.940254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:41.943683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:41.966370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.967077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.967641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:41.968433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:41.968963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:41.969458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.138058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:42.146716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e73bc70-08e3-4542-803c-d3601d525d7e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.741191 Oct 10 10:44:42.147329 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 769/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:41 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:42.155205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:42.162972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:42.200633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.205643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.206457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.210741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.211628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.212304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.416854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:42.419356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:42.429675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3785b143-c44d-4da7-984f-662e518a9b93 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.495660 Oct 10 10:44:42.432506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 886/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:41 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:42.446385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:42.455893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f86814f3-4121-4b49-b337-21664764f7fa tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1265 microversion: 2.1 time: 0.302636 Oct 10 10:44:42.456998 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 770/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:42 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:42.482930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.487343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.488124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.488408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:42.489372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:42.509657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.513588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.514319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.515326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.518119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.518853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.521030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] Creating event network-changed:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:44:42.528109 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-312501eb-35b6-4264-a719-3ef6b40c255b req-e6667335-6bdc-47e8-ac10-de12304929e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094148 Oct 10 10:44:42.529424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 887/1657] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:42.537573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:42.538573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:42.546653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.547581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.548202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.549094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.549714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.550321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.701101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401b464e3de4cad875fc9b8b8dfe077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f9336c7a9248b8ba5734dc4b051663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:42.724734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f16be62-78cb-4a2d-b67e-af40cf396e2e tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 200 len: 1469 microversion: 2.1 time: 0.265727 Oct 10 10:44:42.725335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 771/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:42 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:42.954014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:42.954693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:42.967641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.968198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.968638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:42.969355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:42.974089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:42.975187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:43.557130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:43.592318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:43.615186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:43.620840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3443e8e5-7f91-4611-8c70-c819f329120b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 1.088140 Oct 10 10:44:43.625287 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 888/1659] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:42 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:43.635799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:43.637527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:43.649457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:43.650972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:43.652243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:43.654487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:43.655799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:43.656546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:43.893428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:43.911740 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1148de82-40db-4882-9b65-8e8339c986ff tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.957084 Oct 10 10:44:43.915944 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 772/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:42 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:44:43.943828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c997ff-7455-4af1-a1c6-5d4f51c966f5", "name": "network-vif-deleted", "tag": "5a634641-7011-4942-aa65-25a2b596121b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:43.959168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:43.959793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:43.960501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:43.974179 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] Creating event network-vif-deleted:5a634641-7011-4942-aa65-25a2b596121b for instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 on n-h2-860687-2 Oct 10 10:44:43.986337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-207b7e0f-f0c9-4864-aeff-0ede44944cf0 req-ec404e40-aaec-473e-b9ff-bf354cc129b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068079 Oct 10 10:44:43.989795 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 773/1661] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:44.003942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.005536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.017798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.018939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.019763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.020814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.021611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.022535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.358247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:44.376804 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b290e5d-cd09-48bf-b72b-e4c430089aed tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.743250 Oct 10 10:44:44.381795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 889/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:43 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:44.390398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.392058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.415230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.422280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.424727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.427373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.427949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.429641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.581702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:44.613483 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40193741-818e-45e8-b371-518c230026c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.617817 Oct 10 10:44:44.615023 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 774/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:43 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:44.632765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.635410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] [instance: 89c997ff-7455-4af1-a1c6-5d4f51c966f5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.660434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.662355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.663585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.668003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.675901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.677406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.698001 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] HTTP exception thrown: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Request method failure captured: Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 HTTP/1.1 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_dvin_uxq2RX5PMmCLwpvNpZBPd-ebqnpttjlMX_u0-e8gQKfX4ZH5mDslWPO1kenTPPGapLVh4w4uw3E7oaYz8j-FIkf2LyqHS970m36j24Sbl014tPoCD67Fk5IwEU2VhTOzWaZPoNg3rA1eMzIzWoQ54hEDql32U5FMJPe95e9o Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 76f9336c7a9248b8ba5734dc4b051663 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsTestJSON-1087896902 Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:44.703334 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76f9336c7a9248b8ba5734dc4b051663"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76f9336c7a9248b8ba5734dc4b051663", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76f9336c7a9248b8ba5734dc4b051663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76f9336c7a9248b8ba5734dc4b051663"}]}] Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsTestJSON-1087896902 Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 76f9336c7a9248b8ba5734dc4b051663 Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1087896902 Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsTestJSON-1087896902-project Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5401b464e3de4cad875fc9b8b8dfe077 Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsTestJSON-1087896902-project Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. Oct 10 10:44:44.705202 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '89c997ff-7455-4af1-a1c6-5d4f51c966f5'} Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:44.706202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. Oct 10 10:44:44.711926 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:44.713444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] Returning 404 to user: Instance 89c997ff-7455-4af1-a1c6-5d4f51c966f5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:44.713444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8949f90f-0281-4f3b-9eb0-b75f811e52e7 tempest-InstanceActionsTestJSON-1087896902 tempest-InstanceActionsTestJSON-1087896902-project] 10.222.0.16 "GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5" status: 404 len: 111 microversion: 2.1 time: 0.089688 Oct 10 10:44:44.713444 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 775/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:44 2022] GET /compute/v2.1/servers/89c997ff-7455-4af1-a1c6-5d4f51c966f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:44:44.721896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.722445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.737794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.738216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.739666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.740502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.741053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.741559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.786710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:44.849407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:44.857833 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94b0407b-c538-4ca0-b811-f042ea54058c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.474849 Oct 10 10:44:44.867893 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 890/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:44 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:44.874038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.874855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.883968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.884614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.885258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.886135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.893718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.897594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.923221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2fa7870-5b3f-41cc-8433-1863b9b0bd7d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 204 len: 0 microversion: 2.25 time: 0.212870 Oct 10 10:44:44.928018 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 776/1666] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:44:44 2022] DELETE /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:44:44.934733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:44.940517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:44.956432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:44.957165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.959039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.960752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:44.962748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:44.965989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:44.966564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.255647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.269302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.271988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.273906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc55b38b-953b-49fa-946b-ae1054fefeb9 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1733 microversion: 2.25 time: 0.344017 Oct 10 10:44:45.275548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 777/1667] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:44 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1733 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:45.281958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:45.282766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:45.293974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.314904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.318897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.322624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.322787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.323717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.324462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.324790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.325370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.327159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-882279ae-1078-452b-942a-a621a4fd54ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.457913 Oct 10 10:44:45.340940 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 891/1668] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:44 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:45.401018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:45.402542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:45.412061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.412787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.413406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.415467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.416112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.417010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.532121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.563928 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62e8fc12-0abf-465d-bbce-898772caedbc tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.286111 Oct 10 10:44:45.566215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 778/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:45 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:45.637567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:45.648921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:45.649524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:45.655609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.656324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.656940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.657881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.658109 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2af65809-f26d-4c4b-8256-5e614b833d60 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1522 microversion: 2.1 time: 0.258539 Oct 10 10:44:45.658676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.659318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.685339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 892/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:45 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:45.894294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:45.897030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:45.904675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.905185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.905664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:45.906378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:45.906845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:45.907303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:46.071202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:46.083781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3707601c-bf82-4b79-9706-1598edcb60bf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.439475 Oct 10 10:44:46.084926 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 779/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:45 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:46.274198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:46.282967 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c920cf11-ba0b-4f3f-ab8d-b9d94bb42180 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.393217 Oct 10 10:44:46.284071 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 893/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:45 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:44:46.299401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:46.300458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:46.307937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:46.308507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:46.309041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:46.309883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:46.310811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:46.311202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:46.358055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:46.358661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:46.387376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:46.387376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:46.387376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:46.388412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:46.390217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:46.391967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.106179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.118698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.127043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.129867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2067c3a-a2c9-442b-8123-06b90a62646a tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1733 microversion: 2.25 time: 0.833701 Oct 10 10:44:47.138726 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 780/1673] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:46 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1733 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:47.149144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:47.150199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:47.167028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.167880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.168558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.169732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.170476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.171208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.283450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.306823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.311727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.316685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0802680f-59c4-4b67-8cae-2fb1e0d9fb2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.962420 Oct 10 10:44:47.318845 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 894/1674] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:46 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:44:47.325068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:47.326044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:47.334823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.335587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.336217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.337475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.338805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.339700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.574747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.587398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a019afd-5a56-46c3-8ba7-ae4a565f4d58 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.453259 Oct 10 10:44:47.593243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 781/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:47 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:47.600710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:47.604064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:47.612797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.617459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.618202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.619497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.620211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.620909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.735485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.747462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c7ba0ef-348d-42a2-8f5a-baf291436479 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1499 microversion: 2.1 time: 0.427245 Oct 10 10:44:47.748690 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 895/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:47 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1499 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:47.774101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab5ee1d-7e41-410f-93ed-ca2621aed2a8", "tag": "168b4a45-8373-48c3-9350-c2839a488c37"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:47.804839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.805443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.806164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.806738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:47.827901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] Creating event network-changed:168b4a45-8373-48c3-9350-c2839a488c37 for instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 on n-h1-860687-2 Oct 10 10:44:47.834707 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-155f1abf-7fe8-49ed-8e95-4694c7aaf4df req-9d8a8021-f000-4d40-a663-6172a670bd2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083728 Oct 10 10:44:47.842144 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 896/1677] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:47.849190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:47.850235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:47.858201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.860584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.860841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:47.861504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.863405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:47.864804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:47.865662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:47.894323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:47.907451 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-825894c0-2848-4aaa-9e61-94f29c212bbf tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.311710 Oct 10 10:44:47.918248 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 782/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:47 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:48.189491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.203020 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5f54bb8-e28a-4c3d-bb46-3a8e59b45ad1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.359062 Oct 10 10:44:48.206586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 897/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:47 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:48.213726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:48.219431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.220620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:48.226011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:48.228298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43e9fefc-d597-463e-824f-e0ba6c9d8311 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677d212f70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgVc3C48XhBsGTTpcesa5GaFiZ8xcgT4PKAnBA3eF10pFoDESrzxodCf6GiAagI3gbFWkH/t+LGjtOtzvz/CUFgV/fwceSKkKYK1q/X9ukN2vUQxnsRKXDg2QlQACeHrw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:48.228915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.233327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.233783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43e9fefc-d597-463e-824f-e0ba6c9d8311 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 257 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:48.234088 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:48.235954 n-d-860687-2 devstack@n-api.service[128801]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgVc3C48XhBsGTTpcesa5GaFiZ8xcgT4PKAnBA3eF10pFoDESrzxodCf6GiAagI3gbFWkH/t+LGjtOtzvz/CUFgV/fwceSKkKYK1q/X9ukN2vUQxnsRKXDg2QlQACeHrw=="}} Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgVc3C48XhBsGTTpcesa5GaFiZ8xcgT4PKAnBA3eF10pFoDESrzxodCf6GiAagI3gbFWkH/t+LGjtOtzvz/CUFgV/fwceSKkKYK1q/X9ukN2vUQxnsRKXDg2QlQACeHrw=='}}} Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.236860 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:48.238442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:44:48.240410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:44:48.242620 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 10:44:48.242620 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.242804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.242912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43e9fefc-d597-463e-824f-e0ba6c9d8311 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:48.243047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.243047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.243224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43e9fefc-d597-463e-824f-e0ba6c9d8311 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.323481 Oct 10 10:44:48.243224 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 783/1680] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:47 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:48.248233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:48.248959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:48.251797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:48.263233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.263838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.264468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.265671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.266247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.266832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.299274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:48.342551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.357172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.357771 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3dbc9857-7269-41bd-98ed-c5c25753049a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.149639 Oct 10 10:44:48.359133 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 898/1681] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Oct 10 10:44:48 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:48.361708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.363205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7ebf4df-f3cf-4b2f-b409-8fdb964bf303 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1665 microversion: 2.25 time: 0.125241 Oct 10 10:44:48.365552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 784/1682] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:48 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1665 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:48.370690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f6780c500d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-181868971", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:48.390878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:48.397924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:48.398555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:48.399668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for user c864fe8a073642ab95efc184674e51dd and project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:48.422208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.422706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.423194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.428822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:48.429022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.431374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.431909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 2166 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-181868971", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:48.451332 n-d-860687-2 devstack@n-api.service[128800]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-181868971', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:48.454321 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:48.458367 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:48.460504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:48.461389 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ecade87-633e-4b47-8cb8-56040bb984de tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.095860 Oct 10 10:44:48.470683 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 899/1683] 10.222.0.16 () {60 vars in 1160 bytes} [Mon Oct 10 10:44:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:44:48.470877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:48.480460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.480967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.481531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.518352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Going to try to start instance {{(pid=128800) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 10:44:48.585659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34ce0023-e4d8-487f-b027-937ffc8439ac tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "POST /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30/action" status: 202 len: 0 microversion: 2.1 time: 0.121976 Oct 10 10:44:48.586624 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 900/1684] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:48 2022] POST /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:48.608587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-200e7a5d-a90f-4bba-894c-9696a088f4cd tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677d1e1ee0>, body: {"keypair": {"name": "tempest-keypair-928133469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIFKlH60FctXbq8lbFJ6UH38R0xyaOMmq1JJCzMuzz4PmXTR3flkj1XvXIiV3xKCu8iRHDrQCKzfTYPB6wCOGqW3uqh161dlFzycLuu/1WGQ7lyZQbL2pPzSmukAv3JPA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:48.638413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-200e7a5d-a90f-4bba-894c-9696a088f4cd tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:48.645555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-200e7a5d-a90f-4bba-894c-9696a088f4cd tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for user c864fe8a073642ab95efc184674e51dd and project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:48.674293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-200e7a5d-a90f-4bba-894c-9696a088f4cd tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086001 Oct 10 10:44:48.675226 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 901/1685] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:48.680771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:48.681643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:48.688391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.689034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.689610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.690511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.691211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.692430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.697154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.709886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.711767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:48.713195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ef698da-2ee2-48ae-98ed-c63475bf1a05 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.346550 Oct 10 10:44:48.714572 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 785/1686] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:48 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:48.720123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:48.721274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:48.729891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.731428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.732243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.733296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:48.733917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:48.734493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:48.760224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:49.153671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:49.173893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1e27fcd-cf6e-4fb8-8a39-33176d2ea3f3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.457545 Oct 10 10:44:49.185470 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 786/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:48 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:49.185470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677c3e61f0>, body: {"keypair": {"name": "tempest-keypair-928133469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWh3HCmCFrYTlBm1SiHFrIAnOfd3gcpipvbKqAUZEljJQvIb3O2Qr2MW1+HfDSfSYdyJVwua7dXUT128CvWOLsEO3W5QCjmB60+kJZD2ZwgvwgXW7ElX4zENnp1wxwFgw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:49.219578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:49.242759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for user c864fe8a073642ab95efc184674e51dd and project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:49.246399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:49.267812 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e4a968d-f8eb-4733-b9a0-ded5fa6e19c0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1508 microversion: 2.1 time: 0.589309 Oct 10 10:44:49.271270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 902/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:48 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:49.290827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:49.291602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:49.308457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:49.309731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:49.310474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:49.313724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:49.315728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:49.316379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:49.349732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] HTTP exception thrown: Key pair 'tempest-keypair-928133469' already exists. Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 272 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: {"keypair": {"name": "tempest-keypair-928133469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWh3HCmCFrYTlBm1SiHFrIAnOfd3gcpipvbKqAUZEljJQvIb3O2Qr2MW1+HfDSfSYdyJVwua7dXUT128CvWOLsEO3W5QCjmB60+kJZD2ZwgvwgXW7ElX4zENnp1wxwFgw=="}} Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: exception: Key pair 'tempest-keypair-928133469' already exists. Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-928133469', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWh3HCmCFrYTlBm1SiHFrIAnOfd3gcpipvbKqAUZEljJQvIb3O2Qr2MW1+HfDSfSYdyJVwua7dXUT128CvWOLsEO3W5QCjmB60+kJZD2ZwgvwgXW7ElX4zENnp1wxwFgw=='}}} Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c864fe8a073642ab95efc184674e51dd-tempest-keypair-928133469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 10:44:49.361607 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 10:44:49.371744 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c864fe8a073642ab95efc184674e51dd-tempest-keypair-928133469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 10, 44, 49, 336738), 'updated_at': None, 'name': 'tempest-keypair-928133469', 'user_id': 'c864fe8a073642ab95efc184674e51dd', 'fingerprint': '54:f2:92:03:55:f2:7d:22:49:46:78:1c:f4:a8:7c:83', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWh3HCmCFrYTlBm1SiHFrIAnOfd3gcpipvbKqAUZEljJQvIb3O2Qr2MW1+HfDSfSYdyJVwua7dXUT128CvWOLsEO3W5QCjmB60+kJZD2ZwgvwgXW7ElX4zENnp1wxwFgw==', 'type': 'ssh'}] Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair.create() Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._create() Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-928133469' already exists. Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 10 10:44:49.393329 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-928133469' already exists. Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-928133469' already exists. Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 409 to user: Key pair 'tempest-keypair-928133469' already exists. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0944a9ae-6bc3-4639-9594-da014bfa5c56 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.187538 Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 787/1689] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:49 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:49.403874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:49.416877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:49.418200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:49.422799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:49.425366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:49.427565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:49.431687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:49.889365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:49.902622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9caae260-f22a-4e64-a80d-1a5385b4980e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.629074 Oct 10 10:44:49.915101 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 903/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:49 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:49.915101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a114575-439c-43b3-bd67-bb595834aba1 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Calling method '.version_select at 0x7f6780e289d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:49.964948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a114575-439c-43b3-bd67-bb595834aba1 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928133469" status: 202 len: 0 microversion: 2.1 time: 0.056372 Oct 10 10:44:49.966708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 904/1691] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928133469 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:49.983257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:49.995838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:49.997325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:49.998294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1569e90-a2ee-4e08-9943-b1d4de5decc1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.625549 Oct 10 10:44:49.999116 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 788/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:49 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:50.009772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:50.014506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.015792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:50.017502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.018965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.022497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.023610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.023954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.031404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.031914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.032357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.033441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.034090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.035356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.136438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.140196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.141656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.142815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lazy-loading 'fault' on Instance uuid 51420738-36ad-471f-a7d1-2e6dc887b20e {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:44:50.569408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.584410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.585960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.588429 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70c089c9-e5a4-4397-a708-e30bf4e50947 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 200 len: 1376 microversion: 2.25 time: 0.610592 Oct 10 10:44:50.589345 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 905/1693] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:49 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 1376 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:50.602708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51420738-36ad-471f-a7d1-2e6dc887b20e", "name": "network-vif-deleted", "tag": "7dd7adfc-4758-4c40-823e-c2d917648a6e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:50.639219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.640563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.641257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.663996 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] Creating event network-vif-deleted:7dd7adfc-4758-4c40-823e-c2d917648a6e for instance 51420738-36ad-471f-a7d1-2e6dc887b20e on n-h1-860687-2 Oct 10 10:44:50.667138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.673965 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-283d92ca-df10-4eeb-81a5-468bdbaed556 req-b6d5e5b4-43c1-4863-aadc-fa7b495dd0bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082001 Oct 10 10:44:50.674899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 906/1694] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:50.685174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.685685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19486539-df9e-4136-8828-80c266dea0ea tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677cd33c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlzNxrCeapwvap4jFuQ5VAi70/42SohYRoxVKaIhwpKRlJ1nBneX4rjOsQijirEzqASPpEfc8t70Q+54t7guzGCR7jlmakcYzyP0vUdIPib0L7ZclVFMYZqBPtAPNiM+Q=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:50.687747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.690072 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19858f5d-03b0-4ad2-98b5-95c7224d4c79 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.689183 Oct 10 10:44:50.692111 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 789/1695] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:49 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19486539-df9e-4136-8828-80c266dea0ea tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 247 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlzNxrCeapwvap4jFuQ5VAi70/42SohYRoxVKaIhwpKRlJ1nBneX4rjOsQijirEzqASPpEfc8t70Q+54t7guzGCR7jlmakcYzyP0vUdIPib0L7ZclVFMYZqBPtAPNiM+Q=="}} Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlzNxrCeapwvap4jFuQ5VAi70/42SohYRoxVKaIhwpKRlJ1nBneX4rjOsQijirEzqASPpEfc8t70Q+54t7guzGCR7jlmakcYzyP0vUdIPib0L7ZclVFMYZqBPtAPNiM+Q=='}}} Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi '' Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:44:50.696349 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19486539-df9e-4136-8828-80c266dea0ea tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:50.701339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19486539-df9e-4136-8828-80c266dea0ea tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.022614 Oct 10 10:44:50.702564 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 907/1696] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:50 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:50.713262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:50.714896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:50.718545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:50.719171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:50.723255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.724493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.725445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.727367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.728358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.728976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.736537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.737063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.737893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.738461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.739161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.739808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.966754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.970060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:50.976756 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cd1496a-ed34-47f2-83dc-d836f4d36d6f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.283062 Oct 10 10:44:50.977709 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 790/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:50 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:50.982553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-plugged", "status": "completed", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:50.984554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d0e74af-74c0-4e96-9cff-9fb8b611e5c5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1508 microversion: 2.1 time: 0.273161 Oct 10 10:44:50.993042 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 908/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:50 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:50.997795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:50.998249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:50.998684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:50.999591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f6780d3d550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-170253978", "public_key": " "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:51.016309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] Creating event network-vif-plugged:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:44:51.024897 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-af12300f-d034-45f0-80eb-d405aec8f20e req-ad8f0a05-f929-429d-a281-ee8830177312 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045568 Oct 10 10:44:51.027051 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 791/1699] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:51.034859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:51.047983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for user c864fe8a073642ab95efc184674e51dd and project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:51.058506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.059287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:51.073725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.074698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.075375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.076723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.078430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.079128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.100666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 94 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-170253978", "public_key": " "}} Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-170253978', 'public_key': ' '}}} Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.103285 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.108435 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.113060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:51.114807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b114322-ce5e-4ad7-b854-271e89562c4b tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.120464 Oct 10 10:44:51.119792 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 909/1700] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Oct 10 10:44:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:44:51.138171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.138800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:51.150392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.150879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.151498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.153294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.153775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.154271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.501000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:51.504813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:51.511347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a8113e7-ed8e-446b-aff5-2ba292928d4f tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.483012 Oct 10 10:44:51.512588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 792/1701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:51 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:51.517695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f33e596-c23a-4db8-9ed7-0cb2383f4294 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677c3aea60>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY0cECqty5FQBhV+vwvbAPlRvFvVOn04hbc/j8L8Dt5H3mGK5SELnkU77oocs+c16Docjdf9Lv0hBYRLCSYlQuvsuC9d2Da8LsK/62AefnxlCkQ8Dq0w2BGC6JdZnsKBA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f33e596-c23a-4db8-9ed7-0cb2383f4294 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 507 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY0cECqty5FQBhV+vwvbAPlRvFvVOn04hbc/j8L8Dt5H3mGK5SELnkU77oocs+c16Docjdf9Lv0hBYRLCSYlQuvsuC9d2Da8LsK/62AefnxlCkQ8Dq0w2BGC6JdZnsKBA=="}} Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY0cECqty5FQBhV+vwvbAPlRvFvVOn04hbc/j8L8Dt5H3mGK5SELnkU77oocs+c16Docjdf9Lv0hBYRLCSYlQuvsuC9d2Da8LsK/62AefnxlCkQ8Dq0w2BGC6JdZnsKBA=='}}} Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 10:44:51.526093 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f33e596-c23a-4db8-9ed7-0cb2383f4294 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f33e596-c23a-4db8-9ed7-0cb2383f4294 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011256 Oct 10 10:44:51.530849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 793/1702] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:51 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:51.533270 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-783bf059-fbb4-4ba0-af1d-f7dbde94ea1b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.400083 Oct 10 10:44:51.533270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 910/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:51 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:51.545689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Action: 'create', calling method: .version_select at 0x7f677c3c5a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1595759392", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:51.563143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:44:51.570936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Getting quotas for user c864fe8a073642ab95efc184674e51dd and project ae20a978ac1042d982174b66c7cdbad8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:44:51.590723 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 118 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1595759392", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1595759392', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 10:44:51.594011 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f1fcf21-0d15-4329-9d0c-c112df08fa26 tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.055006 Oct 10 10:44:51.600656 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 794/1704] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:44:51 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 10:44:51.608176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f71c8e52-cd63-4f25-9c3e-35ced16b6e9d tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Calling method '.version_select at 0x7f6780dc0b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.621406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.622033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 51420738-36ad-471f-a7d1-2e6dc887b20e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:51.628907 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f71c8e52-cd63-4f25-9c3e-35ced16b6e9d tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.629168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.629641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.630186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.631016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.631555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.631988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f71c8e52-cd63-4f25-9c3e-35ced16b6e9d tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Request method failure captured: Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2054375931 HTTP/1.1 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_efKXpd_8S_ZipBKynXRfpNwi2nKLEGBwkZVhjocUwvj_LjjMVBOfqInwEq8hOE2J-XQK53H6al315IEJJydXMU2BiZn4B2WUb6JcDKv820NTu8x40FuEI1mHPL2GKmd9ZjUQU--we26p8a1aM8hVVgvjRzxfRDFZ7xP9_3jdGRSKM Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae20a978ac1042d982174b66c7cdbad8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae20a978ac1042d982174b66c7cdbad8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae20a978ac1042d982174b66c7cdbad8"}]}] Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ae20a978ac1042d982174b66c7cdbad8 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1475420584 Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1475420584-project Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: exception: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'tempest-keypair-non-existent-2054375931'} Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.632869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f71c8e52-cd63-4f25-9c3e-35ced16b6e9d tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2054375931 not found for user c864fe8a073642ab95efc184674e51dd {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:51.639028 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f71c8e52-cd63-4f25-9c3e-35ced16b6e9d tempest-KeyPairsNegativeTestJSON-1475420584 tempest-KeyPairsNegativeTestJSON-1475420584-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2054375931" status: 404 len: 145 microversion: 2.1 time: 0.032648 Oct 10 10:44:51.645106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 911/1705] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:44:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2054375931 => generated 145 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:44:51.655392 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] HTTP exception thrown: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Request method failure captured: Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e HTTP/1.1 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XruIRgmzjkNDw9YWqe8XvE4jvO9ZEa29YdXAxbLqwFM4JNvh27cn4PFtY2eNYj_vzIrYKVIzYWxO8_g0DodesbEWQxJOww7W3sCdnr-mixujt1XaMqSDnoYJHNrukKRmEvLUwtoebMPUz3iq8_HB54ty4oAYb89mi2n1BVx6en3mc Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff5e9dcf466b4acd8a44bcdc0cfbdde7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}] Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 78daecbab97943d5a26534e791ae8107 Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '51420738-36ad-471f-a7d1-2e6dc887b20e'} Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. Oct 10 10:44:51.657261 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Returning 404 to user: Instance 51420738-36ad-471f-a7d1-2e6dc887b20e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28e6a914-61e9-4b6f-8426-33feaad2669e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e" status: 404 len: 111 microversion: 2.25 time: 0.044954 Oct 10 10:44:51.663492 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 795/1706] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:51 2022] GET /compute/v2.1/servers/51420738-36ad-471f-a7d1-2e6dc887b20e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:51.673707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e85584b5-81b8-4c5b-8d18-7b1391e3f45c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '.version_select at 0x7f677d1f1dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.692643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e85584b5-81b8-4c5b-8d18-7b1391e3f45c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128519253" status: 204 len: 0 microversion: 2.25 time: 0.026939 Oct 10 10:44:51.693786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 912/1707] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:44:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128519253 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:44:51.731931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:51.732505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:51.741351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.742264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.743706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:51.744791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:51.745741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:51.746403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.002948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.005484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.014501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.015032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.018605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.020303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.020783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.022220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.116447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.131979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.136041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.138288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7424e8b-f3e7-481b-927a-3b9c6eb2211b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.411339 Oct 10 10:44:52.142307 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 796/1708] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:51 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:52.153334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.156681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.170069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.172617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.174609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.175698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.177687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.179730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.281307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.289875 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b248c205-8f34-47ec-96a7-6230754d62e7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1378 microversion: 2.1 time: 0.291671 Oct 10 10:44:52.291010 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 913/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:51 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1378 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:44:52.421027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.431610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bedd0eb6-6de9-42e2-830d-ca1323fffa1d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1512 microversion: 2.1 time: 0.287870 Oct 10 10:44:52.433225 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 797/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:52.458884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.464570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.465243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.servers [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Removing options 'limit' from query {{(pid=128800) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 10:44:52.466216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:52.467629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.468108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.468747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.469697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.470410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.470799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.472423 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-769afcfe-9ff4-4ddd-838a-1b4ffee49941 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018101 Oct 10 10:44:52.474316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 914/1711] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:44:52.489795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.490594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.497434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.498021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.498496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.499235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.499690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.500115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.542730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.543376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.556189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.556682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.557115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.568066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.568554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.569183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.762902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.774902 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3957fbf4-663a-4319-b8dd-842a6579247e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1512 microversion: 2.1 time: 0.289994 Oct 10 10:44:52.775540 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 798/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:52.784262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.785125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.802245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.803185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.803880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.804868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.805590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.806210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.853527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:52.858032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:52.868208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e0bbea4-f5fa-4ad0-a429-b67b4293f39a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.329867 Oct 10 10:44:52.887137 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 915/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:44:52.900566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:52.901331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:52.910527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.911047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.911543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:52.912394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:52.912974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:52.913476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.135441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.154578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21a7d4ac-091e-4e41-894f-347e17956825 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.374872 Oct 10 10:44:53.157190 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 799/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:53.171596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd53e4-4cac-4c86-9aca-8acc5820e1be", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe1c66e-14d9-40fb-b811-38af75c26b97"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:53.177536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.201233 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e28a5e7a-e028-4cdb-a1ee-e6fdeac86954 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1513 microversion: 2.1 time: 0.304553 Oct 10 10:44:53.205871 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 916/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:52 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:53.216773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.217252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.217681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.220743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:53.221197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:53.240591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.241095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.241530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.251419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.251419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.251419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.252837 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] Creating event network-vif-unplugged:4fe1c66e-14d9-40fb-b811-38af75c26b97 for instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be on n-h2-860687-2 Oct 10 10:44:53.275252 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-954e308c-eca5-4dfd-a619-3987958d9373 req-595cfaba-6f81-471c-9e8f-528138d6f6db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107569 Oct 10 10:44:53.276244 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 800/1716] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:53.290668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:53.292643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:53.310276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.310770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.315802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.317176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.317852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.318477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.654780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.682511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.687139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.703621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.704064 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf88860b-1952-4b22-a22e-b75d12a52ac1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1511 microversion: 2.1 time: 0.424884 Oct 10 10:44:53.706699 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 801/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:53 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:53.710013 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aefc70be-5110-4f74-b30e-24631b2b690c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.500671 Oct 10 10:44:53.711460 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 917/1718] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:53 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:53.722744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:53.724046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:53.726148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:53.728224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:53.742909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.745017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.746638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.747177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.747613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.748109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.749567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.750212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.752047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.753285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:53.755629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:53.757237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:53.802812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:53.934617 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac9be188-9631-4486-ad34-29cf4e0ce110 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 204 len: 0 microversion: 2.25 time: 0.219766 Oct 10 10:44:53.936840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 918/1719] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:44:53 2022] DELETE /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:44:53.953878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:53.966380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.968965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:53.971220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:53.998291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88fa1dad-dca2-4a3e-9e33-c5913a57f292 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1527 microversion: 2.1 time: 0.288822 Oct 10 10:44:54.018578 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 802/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:53 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1527 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:54.029858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.030748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.038590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.038590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.039134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.040149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.041062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.042040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.116443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.117347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.118195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.119513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.120312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.121070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.238720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:54.247640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.260583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e9b7a00-9b49-416f-a535-daf9066a3529 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.240549 Oct 10 10:44:54.262102 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 803/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:54.266838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.268291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.276221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.276718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.277159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.277910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.278677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.279523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.307370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90992882-e338-4160-b1f7-0db8765daf54 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.368458 Oct 10 10:44:54.307967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 919/1722] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Oct 10 10:44:53 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:54.313947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.314933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.321761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.322259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.322704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.323583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.324037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.324546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.525040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.534792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.538319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.539561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5224f630-e095-4a34-994f-8e42fd53ec9d tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1548 microversion: 2.25 time: 0.276446 Oct 10 10:44:54.540231 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 804/1723] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1548 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:54.550600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.552191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.568247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.571300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.571802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.574331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.576465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.576608 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c9950f9-0040-4e7e-8870-dc6860a28020 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1527 microversion: 2.1 time: 0.267164 Oct 10 10:44:54.577062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.577795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.592480 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 920/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1527 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:54.604806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.605433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.621168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.622230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.622898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.623924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.624782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.625455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.782538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.790861 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f31f5f8c-9c23-4fa8-8fee-9e658ee5b20a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.249698 Oct 10 10:44:54.803205 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 805/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:54.803205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f223e7fd-cfe6-4c33-9d24-43bae72891d6 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.844800 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f223e7fd-cfe6-4c33-9d24-43bae72891d6 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/e5284a1b-908b-4a9d-8256-5b4ba676f634" status: 202 len: 0 microversion: 2.1 time: 0.049975 Oct 10 10:44:54.845131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 806/1726] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:44:54 2022] DELETE /compute/v2.1/flavors/e5284a1b-908b-4a9d-8256-5b4ba676f634 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:54.851163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:54.853067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:54.861371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.861954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.862473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.863851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:54.864677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:54.865347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:54.890779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:54.900572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2eb6b16-4a2b-4381-b918-b4a3cea624fd tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1512 microversion: 2.1 time: 0.306857 Oct 10 10:44:54.901469 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 921/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:55.117579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.121704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Calling method '.version_select at 0x7f677d1e1af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.129867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.131856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.134203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e716113-59fa-4a5d-8360-25cc7ea64567 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.287385 Oct 10 10:44:55.152122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.153198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.153804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.154704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.155363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.155978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.159235 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 807/1728] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:55.164926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-829364e4-7a64-48b8-a23e-6d9d02b32ede tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.192204 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-829364e4-7a64-48b8-a23e-6d9d02b32ede tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030775 Oct 10 10:44:55.193373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 808/1729] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:44:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:55.206933 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da02bff7-cd61-46e5-adbe-5cc7d03ccd08 tempest-AbsoluteLimitsTestJSON-456060173 tempest-AbsoluteLimitsTestJSON-456060173-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.303684 Oct 10 10:44:55.210898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.211501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 922/1730] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Oct 10 10:44:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:55.213640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:55.223567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:55.229534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.230800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.231035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:55.231874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.234533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.235304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.237805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.251390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.255508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.256968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.261758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.264002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.264806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.321500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.329192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Old instance type tempest-test_resize_flavor_-1585393539, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 10:44:55.337485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:44:55.337944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:44:55.338423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:44:55.338834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:44:55.339750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:44:55.460593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-786887aa-96df-4de2-b8b9-f2a69044e11e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411/action" status: 202 len: 0 microversion: 2.1 time: 0.247732 Oct 10 10:44:55.461546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 923/1731] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:44:55 2022] POST /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:44:55.468641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.470795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:55.482358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.483265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.483984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.485106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.485727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.486561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.517417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.530934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e744d5e9-f5de-4209-9af0-0f7cadf26454 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1513 microversion: 2.1 time: 0.336267 Oct 10 10:44:55.532522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 809/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:55 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:55.539877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cd53e4-4cac-4c86-9aca-8acc5820e1be", "tag": "4fe1c66e-14d9-40fb-b811-38af75c26b97"}, {"server_uuid": "caa7ac3b-acd8-472b-a082-8e435744e011", "name": "network-vif-deleted", "tag": "9fff3ba3-54aa-4917-b308-c59cff22c210"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:55.555108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.555833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.556413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.579651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:55.588048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Creating event network-changed:4fe1c66e-14d9-40fb-b811-38af75c26b97 for instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be on n-h2-860687-2 Oct 10 10:44:55.591266 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] Creating event network-vif-deleted:9fff3ba3-54aa-4917-b308-c59cff22c210 for instance caa7ac3b-acd8-472b-a082-8e435744e011 on n-h1-860687-2 Oct 10 10:44:55.612615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-24a528c8-3206-4c82-9538-1b1a68dd9512 req-07b744ae-3934-4b43-9c40-f353c874ae6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077217 Oct 10 10:44:55.615376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 810/1733] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:55.630675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.632585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:55.645460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.646051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.646388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.647122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.650708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.652091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.778708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:55.787582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bdc8adac-28c5-431c-a7be-b94c2ebb4407 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.324506 Oct 10 10:44:55.795237 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 924/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:55 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:55.804442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:55.805076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:55.813890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.814383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.814837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:55.815579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:55.816039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:55.817083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.025445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:56.033449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17c1625d-5c9f-45bf-89bf-0bbcd9df73d3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1536 microversion: 2.1 time: 0.416690 Oct 10 10:44:56.033963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 811/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:55 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1536 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:56.038907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:56.039845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:56.048489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.049240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.049867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.051304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.051996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.052723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.096421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.096921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.097374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.098149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lazy-loading 'fault' on Instance uuid caa7ac3b-acd8-472b-a082-8e435744e011 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:44:56.216502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:56.225283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:56.232412 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0e949c7-2052-4bca-83dc-09af08db7892 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1511 microversion: 2.1 time: 0.439747 Oct 10 10:44:56.233395 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 925/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:55 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:56.238622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:56.250927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:56.258295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.258793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.259270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.259981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.260434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.261069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.261625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:56.264556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:56.266696 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3b3ef39-a90f-461d-9ba9-a3cdbc85696e tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 200 len: 1351 microversion: 2.25 time: 0.231493 Oct 10 10:44:56.281092 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 812/1737] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:56 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 1351 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:56.305420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:56.307891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:56.317650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.318384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.319071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:56.320012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:56.320709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:56.321338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.045763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.060037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa19e88c-e633-43c6-b101-c13a2397d9c4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.820935 Oct 10 10:44:57.060898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 926/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:56 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:57.071213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:57.076282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.084148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:57.101723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.102688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.103178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.103979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.104444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.104906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.166918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:57.244854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.272157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:57.282256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.283116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.283855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.284471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.300214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.303037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.313338 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-171ec5cb-96fd-4764-81f7-1b8207dd257c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 1.018707 Oct 10 10:44:57.315686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 813/1739] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:56 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:57.334179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab5ee1d-7e41-410f-93ed-ca2621aed2a8", "name": "network-vif-plugged", "status": "completed", "tag": "168b4a45-8373-48c3-9350-c2839a488c37"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:44:57.371137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.372826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.384020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.415989 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] Creating event network-vif-plugged:168b4a45-8373-48c3-9350-c2839a488c37 for instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 on n-h1-860687-2 Oct 10 10:44:57.423352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a94a95c9-5d36-4354-b602-50fb882967e2 req-64c24b45-04f9-4dfc-a228-b16fba0f0c38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103060 Oct 10 10:44:57.424745 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 814/1740] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:44:57.452243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:57.453343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:57.469153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.470452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.471274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.472314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.473528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.474670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:57.969262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-919f66ed-3005-41fe-b675-270b5ea3ceeb tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.907035 Oct 10 10:44:57.982358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 927/1741] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:44:57 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:57.988200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:57.989007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:57.994428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:57.998388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:57.998951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:57.999469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.000176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.000637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.001112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.002635 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0e27081-19c9-4ec8-b646-5bd7ad57caaa tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.575924 Oct 10 10:44:58.003247 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 815/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:57 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:58.010971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:58.018210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: caa7ac3b-acd8-472b-a082-8e435744e011] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:58.045313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.051729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.053487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.054480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.057795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.058549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.099740 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] HTTP exception thrown: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Request method failure captured: Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 HTTP/1.1 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_XruIRgmzjkNDw9YWqe8XvE4jvO9ZEa29YdXAxbLqwFM4JNvh27cn4PFtY2eNYj_vzIrYKVIzYWxO8_g0DodesbEWQxJOww7W3sCdnr-mixujt1XaMqSDnoYJHNrukKRmEvLUwtoebMPUz3iq8_HB54ty4oAYb89mi2n1BVx6en3mc Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff5e9dcf466b4acd8a44bcdc0cfbdde7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}] Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 78daecbab97943d5a26534e791ae8107 Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'caa7ac3b-acd8-472b-a082-8e435744e011'} Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. Oct 10 10:44:58.107954 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. Oct 10 10:44:58.112554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:44:58.115466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Returning 404 to user: Instance caa7ac3b-acd8-472b-a082-8e435744e011 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:44:58.116694 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9811890-9c35-4307-8209-fce1c7ce6206 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011" status: 404 len: 111 microversion: 2.25 time: 0.111398 Oct 10 10:44:58.120779 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 816/1743] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:58 2022] GET /compute/v2.1/servers/caa7ac3b-acd8-472b-a082-8e435744e011 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:44:58.126331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:58.132191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:58.133386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:58.464559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.465196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.465480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.471618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.474533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.477262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.653224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:58.668176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:58.677402 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0d14e66-cee2-4d62-8e18-8f1c2f6e2c90 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1536 microversion: 2.1 time: 0.706110 Oct 10 10:44:58.687324 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 928/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:57 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1536 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:58.701603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:58.702411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:58.734052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.734866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.736116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.770521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.772289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.772899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.793251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:58.866378 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d736860e-4e45-47f4-80e1-9153df51b72e tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.743607 Oct 10 10:44:58.867781 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 817/1745] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Oct 10 10:44:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:58.882440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:58.884322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:58.901482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.902222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.903162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.904151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:58.904802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:58.905541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:58.952657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:44:59.149199 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78fbe877-7ada-408a-aa41-575800d4a9c8 tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 204 len: 0 microversion: 2.25 time: 0.279212 Oct 10 10:44:59.158390 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 818/1746] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:44:58 2022] DELETE /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:44:59.174573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:59.175367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:59.184717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.186938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.187903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.188924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.189585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.190185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.209551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:59.218881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c48af111-71a1-41f0-bdae-c4df702cc3c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1307 microversion: 2.1 time: 0.529821 Oct 10 10:44:59.220266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 929/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:58 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:59.226848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:59.233954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:59.235016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:44:59.243980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.244861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.245608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.246677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.247410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.248094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.384924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:44:59.509715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0deb7ad-d54a-4578-a33e-6b3df9596c9d tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.288037 Oct 10 10:44:59.511219 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 930/1748] 10.222.0.16 () {58 vars in 1212 bytes} [Mon Oct 10 10:44:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:44:59.516732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:59.517595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:59.527550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.528550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.529155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.530052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.530736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.531382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.869580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:59.886676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:59.891065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:44:59.895535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-123f62aa-7e00-42dd-8320-00fc378cffe0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.737817 Oct 10 10:44:59.897128 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 819/1749] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:59 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:44:59.901727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:44:59.902329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:44:59.917560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:44:59.932838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.932838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.932838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.936864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:44:59.937414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:44:59.937999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:44:59.981257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:00.002325 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a7b954d-3c9d-48e3-9860-5d32fd344a30 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.484981 Oct 10 10:45:00.003363 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 931/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:44:59 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:00.025587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:00.033246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:00.033935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:45:00.039823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.041676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.042389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:00.043461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.044081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.044764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:00.314360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:45:00.387915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:00.409412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:00.413831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78daecbab97943d5a26534e791ae8107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5e9dcf466b4acd8a44bcdc0cfbdde7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:00.420817 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb3acd70-dd2c-41fe-8d30-733150eee8cd tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 200 len: 1561 microversion: 2.25 time: 0.521895 Oct 10 10:45:00.422711 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 820/1751] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:44:59 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 1561 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:00.437725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:00.437933 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b7411a8-bcf7-4c66-9ef2-be10b4d5cbb5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.429484 Oct 10 10:45:00.438729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:00.440494 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 932/1752] 10.222.0.16 () {58 vars in 1196 bytes} [Mon Oct 10 10:45:00 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:00.455378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:00.456287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:00.469079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.469400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.471315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.471477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.471597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:00.471935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:00.472051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.472188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:00.472292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.472292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:00.472647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:00.473393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.046497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.056875 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aaac6f77-b173-442d-bc54-e0ed78ee4867 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1487 microversion: 2.1 time: 0.613300 Oct 10 10:45:01.062684 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 933/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:00 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1487 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:01.081246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:01.109207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.110013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': '1113872731', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:45:01.132308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.132823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.135702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.136698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.137529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.150086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.324981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.333912 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71e06e29-47ab-4f4a-baef-1c8462e45470 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.909224 Oct 10 10:45:01.338123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 821/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:00 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:01.349826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60be6671-ce50-4bb3-b544-bb72150d7486", "name": "network-vif-deleted", "tag": "ea4a8da1-fc9a-4946-96aa-444543b59f2e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:01.353869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:45:01.374109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.374893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.375523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.391740 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] Creating event network-vif-deleted:ea4a8da1-fc9a-4946-96aa-444543b59f2e for instance 60be6671-ce50-4bb3-b544-bb72150d7486 on n-h1-860687-2 Oct 10 10:45:01.408241 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d914b472-d593-495e-a518-66418736960d req-b0bf9112-efb6-4f3c-a1bf-434784d4b670 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068704 Oct 10 10:45:01.409137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 822/1755] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:01.418763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:01.423852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:01.431383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d64bff9-a867-4540-bf47-709e45c34a1a tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=1113872731" status: 200 len: 346 microversion: 2.1 time: 0.366575 Oct 10 10:45:01.432793 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 934/1756] 10.222.0.16 () {58 vars in 1156 bytes} [Mon Oct 10 10:45:01 2022] GET /compute/v2.1/servers?name=1113872731 => generated 346 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:01.436944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.440969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:01.443550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:01.444691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.445150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.446083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.446743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.447367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.452494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.453066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.453696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.455219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:01.455865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:01.456573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:01.578024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:01.968576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.973552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.978156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22efc8e2-45eb-4756-826a-9f2d2ba6a74e tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.543877 Oct 10 10:45:01.983919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.986315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:01.987776 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2ac728e-5300-4785-932b-ea3890e29bb5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.577147 Oct 10 10:45:02.003125 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 935/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:01 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:02.004362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 823/1758] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:01 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:02.005530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:02.006244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:02.014381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:02.020662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:02.025444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:45:02.029900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.030692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.032723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.033708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.036921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.037629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.041935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.042890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.043662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.045168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.045875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.046564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.154723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10f58032-7a8b-471c-a6d0-48228cbd239e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8/action" status: 202 len: 0 microversion: 2.1 time: 0.155496 Oct 10 10:45:02.155514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 936/1759] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:45:01 2022] POST /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:45:02.168386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:02.172359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] [instance: 60be6671-ce50-4bb3-b544-bb72150d7486] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:02.188005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.188523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.190693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.194384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.195422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.196468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.208564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:45:02.236454 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] HTTP exception thrown: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Request method failure captured: Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 HTTP/1.1 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_XruIRgmzjkNDw9YWqe8XvE4jvO9ZEa29YdXAxbLqwFM4JNvh27cn4PFtY2eNYj_vzIrYKVIzYWxO8_g0DodesbEWQxJOww7W3sCdnr-mixujt1XaMqSDnoYJHNrukKRmEvLUwtoebMPUz3iq8_HB54ty4oAYb89mi2n1BVx6en3mc Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff5e9dcf466b4acd8a44bcdc0cfbdde7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff5e9dcf466b4acd8a44bcdc0cfbdde7"}]}] Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: ff5e9dcf466b4acd8a44bcdc0cfbdde7 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 78daecbab97943d5a26534e791ae8107 Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1467264789-project Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '60be6671-ce50-4bb3-b544-bb72150d7486'} Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. Oct 10 10:45:02.240252 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:02.245336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] Returning 404 to user: Instance 60be6671-ce50-4bb3-b544-bb72150d7486 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:02.250570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-531b5047-eedd-4369-810f-08f44ccaba5c tempest-LiveAutoBlockMigrationV225Test-1467264789 tempest-LiveAutoBlockMigrationV225Test-1467264789-project] 10.222.0.16 "GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486" status: 404 len: 111 microversion: 2.25 time: 0.091615 Oct 10 10:45:02.251588 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 937/1760] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:02 2022] GET /compute/v2.1/servers/60be6671-ce50-4bb3-b544-bb72150d7486 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:45:02.257300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:02.263699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:02.280429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.280926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.281370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.282088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.282551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.282979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.600218 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88c71149-5983-4c9a-9de0-ae0601545d12 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.594289 Oct 10 10:45:02.611437 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 824/1761] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Oct 10 10:45:02 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:02.618322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:02.619226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:02.631498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.632738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.633434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.634549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.635561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.636165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.808486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:02.829444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-25a9933e-46a6-4b08-afd8-4af5264a789e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1492 microversion: 2.1 time: 0.576590 Oct 10 10:45:02.830806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 938/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:02 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1492 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:02.838075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:02.846106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:02.847210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-111387273', 'deleted': False, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:45:02.854303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.855107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.856433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:02.857447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:02.858208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:02.859433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.001905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:45:03.084612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ec4cfa5-c3b3-41ef-b9ce-3c41ebb6dde3 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111387273" status: 200 len: 346 microversion: 2.1 time: 0.252291 Oct 10 10:45:03.093176 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 939/1763] 10.222.0.16 () {58 vars in 1228 bytes} [Mon Oct 10 10:45:02 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-111387273 => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:03.094611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:03.094611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:03.102544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.103062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.103677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.104399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.104863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.105291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.187948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:03.204558 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-defc97d9-2fd0-4aeb-be01-ed4f929964c1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.591606 Oct 10 10:45:03.209171 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 825/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:02 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:03.232305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:03.232584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:03.250305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.250598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.258423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.259331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.259888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.260409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.610224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:03.623204 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26a283bb-3227-4e05-95e6-9a4a1d36a050 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.536537 Oct 10 10:45:03.642318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 940/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:03 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:03.651263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:03.652168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:03.668646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.671444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.672741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.674911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.676229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.677635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.731345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:03.740500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:03.744797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:03.788404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:03.789973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:03.799792 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf87a075-774f-4c96-8d8d-2eb1be4a4990 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.574349 Oct 10 10:45:03.824317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 826/1766] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:03 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:03.863750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:03.864918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:03.896580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.897445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.897963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.898723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.904076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.904860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.960397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab0edab8-7f16-44a5-bbea-a0edc547956b tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "DELETE /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 204 len: 0 microversion: 2.1 time: 0.315352 Oct 10 10:45:03.961966 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 941/1767] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:03 2022] DELETE /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:03.973020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:03.974336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:03.992484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.993387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.994054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:03.995286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:03.996004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:03.997203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.043972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:04.444177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:04.454158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9486174f-2e2e-4fdc-9d6c-c4a23b8d8ba6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 200 len: 1472 microversion: 2.1 time: 0.600307 Oct 10 10:45:04.455360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 827/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:03 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 1472 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:04.462236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:04.469501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:04.475926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:04.490775 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8963abc3-f99d-4201-a86b-4081fb5f5236 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1517 microversion: 2.1 time: 0.523853 Oct 10 10:45:04.491675 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 942/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:03 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1517 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:04.500684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.504354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.505635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.506927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-4328351"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:04.510811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:04.511374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.512048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.512661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.534582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.538146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.541487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.543379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.545895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.551179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.904234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:04.914524 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f83403df-9850-4957-bd67-684bfb9a8a6a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.457954 Oct 10 10:45:04.920022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 828/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:04 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:04.931558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:04.932465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:04.950368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.953117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.955886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:04.957509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:04.962851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:04.963211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:05.205540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b136603d-7c82-45e7-963d-d578fe1718b6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8/action" status: 202 len: 0 microversion: 2.1 time: 0.710579 Oct 10 10:45:05.208463 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 943/1771] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:45:04 2022] POST /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:45:05.223065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:05.226904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:05.241822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:05.244686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:05.245329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:05.259576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:05.260203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:05.260666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:05.745836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:05.770168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:05.773537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:05.778364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:05.778738 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0f33700-b7fa-4f60-9f3a-72c34af8dc33 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.566834 Oct 10 10:45:05.781975 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 944/1772] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:05 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:05.788848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38d36aaf-127a-4a49-8646-590f0a1759ca tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1392 microversion: 2.1 time: 0.867170 Oct 10 10:45:05.790083 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 829/1773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:04 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1392 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:05.828249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d2500af-ee55-4f0d-940e-13e3f2ff88cf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c4044c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:05.936634 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d2500af-ee55-4f0d-940e-13e3f2ff88cf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.144410 Oct 10 10:45:05.938041 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 830/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:05 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:05.951262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:05.952304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:05.970609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:05.971655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:05.972779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:05.974713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:05.975538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:05.979205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:06.163579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1349227905", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:06.273444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] validate_networks() for [('7322f94b-43e8-474e-bb83-471997eb7185', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:45:06.960571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:06.983254 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11551386-26cb-41b6-954c-721a935dd3a6 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 200 len: 1517 microversion: 2.1 time: 1.043977 Oct 10 10:45:06.985794 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 831/1775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:05 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 1517 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:06.999914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:07.000990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:07.024021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.026808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.027378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.029091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.032588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.033160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.234501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=16 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:07.499903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:07.509370 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e0aa84e-9622-4122-9d64-9eba34975dfe tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.522171 Oct 10 10:45:07.514895 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 832/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:06 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:07.526062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:07.527021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:07.544979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.546060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.548739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.549711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.556163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.557052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.864812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:45:07.865411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:45:07.865708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:45:07.866123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:45:07.866543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:45:07.902566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.903144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.904834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.907550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:07.908048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:07.910585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:07.959611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Getting quotas for project 06e24de049584a28b4474ed9b2754907. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:45:07.971372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Getting quotas for user ea45a76755df41a6aa98e54b742af225 and project 06e24de049584a28b4474ed9b2754907. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:45:08.012153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:45:08.017498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:45:08.119708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:08.147923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:08.150544 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4a581d3-e5ef-4665-9e4a-df3c71890803 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.367187 Oct 10 10:45:08.154767 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 945/1777] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:45:08.155376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:08.157282 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfa2641f-c660-483e-8128-b5b5eac0d5f8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.640934 Oct 10 10:45:08.163649 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 833/1778] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:07 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:08.182406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.183897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:08.187520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bd25b8-7ba9-4106-9767-c44c3a1b3164", "name": "network-vif-deleted", "tag": "774306d9-559c-446f-8718-c106af7ef6a8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:08.231230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.235082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.237457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.242160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.242859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.247162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.255140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.257050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.258961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.297623 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] Creating event network-vif-deleted:774306d9-559c-446f-8718-c106af7ef6a8 for instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 on n-h1-860687-2 Oct 10 10:45:08.308917 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a6ac458e-ca42-4025-9a77-67ac775209c0 req-a4e0c3ce-1508-472f-8767-e14f743a952b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141407 Oct 10 10:45:08.313355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 834/1779] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:08.329596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac199eb0-66fc-4f46-9972-88b8ab31cf49 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3e6700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.447508 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac199eb0-66fc-4f46-9972-88b8ab31cf49 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.131916 Oct 10 10:45:08.451804 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 835/1780] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:08 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:08.468020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.471955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 25bd25b8-7ba9-4106-9767-c44c3a1b3164] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:08.504010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.504709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.509885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.512770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.514204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.516043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.557420 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] HTTP exception thrown: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Request method failure captured: Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 HTTP/1.1 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_c_70Mx_FjNMzd4uxuRLMP-aXvdytIDyfmJiE7gaCihWNPHz6T7ATRpbnom1qv63Hfq8en91WldKAwd0n7PwQW6PZ1u3Tgxr2PO_Yn90b7NzWcmhAVyWFupsLQz6YAmzURe9E4D3iwqrfiGJQtsi2Cg7im4T7c1k-74e-sTWAZfrh4 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0ad8494e92d40e2839b25f7bcb318e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0ad8494e92d40e2839b25f7bcb318e3"}]}] Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4a03479b6c834827b95ea1aa84741578 Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '25bd25b8-7ba9-4106-9767-c44c3a1b3164'} Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:08.567303 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Returning 404 to user: Instance 25bd25b8-7ba9-4106-9767-c44c3a1b3164 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:08.572996 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32f18b82-7c43-4d08-893d-c6237a7c7693 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164" status: 404 len: 111 microversion: 2.1 time: 0.116594 Oct 10 10:45:08.573854 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 836/1781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:08 2022] GET /compute/v2.1/servers/25bd25b8-7ba9-4106-9767-c44c3a1b3164 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:08.584825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11b43b14-eac5-49d1-b20e-b12da05cff83 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.588692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11b43b14-eac5-49d1-b20e-b12da05cff83 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:08.854852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11b43b14-eac5-49d1-b20e-b12da05cff83 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:08.868597 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11b43b14-eac5-49d1-b20e-b12da05cff83 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1224 microversion: 2.1 time: 0.293261 Oct 10 10:45:08.871186 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 837/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:08 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1224 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:08.887203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.887900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:08.898630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.905483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.906689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.909597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:08.911266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:08.913215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:08.940233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:08.957516 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed640460-3ff7-4dd6-a782-f30eff39082a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1382 microversion: 2.1 time: 0.796763 Oct 10 10:45:08.975620 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 946/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:08 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1382 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:08.990362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:08.992860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:09.010874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.013895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.017197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.018225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.020767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.025532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.105101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:09.352361 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ba77157-9901-4556-9d86-22d5495617c8 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 204 len: 0 microversion: 2.1 time: 0.387612 Oct 10 10:45:09.353525 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 947/1784] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:08 2022] DELETE /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:09.368528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23af5898-6220-497c-a566-53c006d06c91 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '.version_select at 0x7f677ca483a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:09.383049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23af5898-6220-497c-a566-53c006d06c91 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.385666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23af5898-6220-497c-a566-53c006d06c91 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.389874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23af5898-6220-497c-a566-53c006d06c91 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.437121 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23af5898-6220-497c-a566-53c006d06c91 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2731 microversion: 2.1 time: 0.081746 Oct 10 10:45:09.437974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 948/1785] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 10:45:09 2022] GET /compute/v2.1/os-migrations => generated 2731 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:09.452888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:09.453735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:09.478660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.479195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.479634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.480342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.480795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.481220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.619984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:09.632195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f27f2fc-eca8-474b-a69f-e8cc5a74cb67 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.759865 Oct 10 10:45:09.635405 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 838/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:08 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:09.647404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:09.650664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:09.668734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.669266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.669941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:09.671220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:09.672358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:09.673906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.151298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:10.161417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:10.162854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:10.164065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfc98453-8884-4421-8639-93837f2cf8ab tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.725324 Oct 10 10:45:10.184319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 949/1787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:09 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:10.199684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:10.200481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:10.237492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.239951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.242548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.244364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.245117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.246062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.525942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:10.583840 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4da6702b-09de-4c0a-baad-b0019d2cbabe tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1519 microversion: 2.1 time: 0.944258 Oct 10 10:45:10.585002 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 839/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:09 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1519 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:10.594887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21350b5c-dc52-410c-961e-586b1d58f613 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677cfb9e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:10.693775 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21350b5c-dc52-410c-961e-586b1d58f613 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.107439 Oct 10 10:45:10.697068 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 840/1789] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:10 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:10.707604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:10.718927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:10.738392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.746567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.750851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.754950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.756855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.759988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.813106 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b58eac6f-0fdf-43bb-a70e-cdb34f85fce5 tempest-LiveMigrationTest-1636858412 tempest-LiveMigrationTest-1636858412-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1533 microversion: 2.1 time: 0.627536 Oct 10 10:45:10.825006 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 950/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:10 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1533 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:10.831363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:10.833972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:10.858959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.862261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.864000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:10.866348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:10.867596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:10.869330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:11.425870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:11.444887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d83f3206-0660-415a-b3c2-d97ee0e9becc tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1228 microversion: 2.1 time: 0.746504 Oct 10 10:45:11.449843 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 841/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:10 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1228 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:11.484025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:11.485931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:11.516014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:11.518037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:11.518656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:11.522326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:11.524658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:11.525704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:11.661799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:12.017316 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98c99bf2-609c-4f20-8c8b-2657aca05206 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 204 len: 0 microversion: 2.1 time: 0.564463 Oct 10 10:45:12.029960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:12.030877 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 842/1792] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:11 2022] DELETE /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:12.040009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:12.041342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:12.043459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee32c055-312b-4a94-b400-9c7c538f27cf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 1.224231 Oct 10 10:45:12.048722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 951/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:10 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:12.067272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:12.068221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:12.069005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:12.069999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:12.095029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:12.096211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:12.098976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:12.099553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:12.101361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:12.105127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:12.106115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:12.106814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:12.107834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:12.108534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:12.109330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:12.960271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:12.991354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:12.995690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:12.999198 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6c227cf-6344-4c74-b0ff-a4b410c5d6ad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.966600 Oct 10 10:45:13.004400 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 843/1794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:12 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:13.009531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4ca28ac-0aed-444a-9926-ac036deb0f11 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3ae310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:13.050891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:13.081278 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-650b617e-93a5-45f6-8aae-1f9d084879a1 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1519 microversion: 2.1 time: 1.000953 Oct 10 10:45:13.082891 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4ca28ac-0aed-444a-9926-ac036deb0f11 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.076981 Oct 10 10:45:13.114472 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 844/1795] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:13 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:13.124066 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 952/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:12 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1519 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:13.149745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:13.152352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:13.186160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.187919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.189201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:13.191207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.200519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.203946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:13.288073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc80d0f7-f627-49fd-8a7d-21732e37b796 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Action: 'create', calling method: .version_select at 0x7f677c42c670>, body: {"keypair": {"name": "tempest-keypair-169460523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGNs8jXnrPYh5ziqLQgJrCia0Eh7qhVG0yK9c7qA3opIv/80QOvl+lBs/c7ytnLfysOIimE3SzFedQmG1rZNELibqDTQDuvzNYveWuFQeXNEexP+zT2l/fIBOn9wf2awQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:13.329053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cc80d0f7-f627-49fd-8a7d-21732e37b796 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for project 842cf83a29be46cca41020e234da2339. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:45:13.340045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cc80d0f7-f627-49fd-8a7d-21732e37b796 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for user 9033c0d378a545c487d7e90558a3d89d and project 842cf83a29be46cca41020e234da2339. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:45:13.414491 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc80d0f7-f627-49fd-8a7d-21732e37b796 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.298577 Oct 10 10:45:13.416026 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 845/1797] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:45:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:13.421920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:13.424976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:13.453159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.454333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.455211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:13.458249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.460869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.462733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:13.724902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:13.738383 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d233cc7f-de5e-4f0c-a62f-b7b04c2df845 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1284 microversion: 2.1 time: 0.319992 Oct 10 10:45:13.743649 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 846/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:13 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:13.748814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:13.754933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:13.775117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.776109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.778444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:13.779482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:13.780389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:13.782659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:14.042881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:14.057624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eed4a829-0311-41e7-886d-1e346219ed2b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1388 microversion: 2.1 time: 0.932233 Oct 10 10:45:14.058914 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 953/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:13 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1388 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:14.079619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:14.080969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:14.099483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:14.107682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:14.108212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:14.109952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:14.111506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:14.119666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:15.279689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:15.294969 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6f28682-0adc-43b4-b661-be122ad40ac7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 1.549845 Oct 10 10:45:15.303480 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 847/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:13 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:15.323459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f0f89e1-9789-479f-8013-1d0e48661ccb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c4ef5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:15.423576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f0f89e1-9789-479f-8013-1d0e48661ccb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.110633 Oct 10 10:45:15.425931 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 848/1801] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:15 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:15.444441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:15.445697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:15.472005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:15.474874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:15.475583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:15.476523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:15.479019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:15.479691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:15.883136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:15.897525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:15.901195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:15.909179 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83cd19ab-2b82-4569-822d-ca857af3347b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 1.844810 Oct 10 10:45:15.911980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 954/1802] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:14 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:15.925164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:15.931603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cd53e4-4cac-4c86-9aca-8acc5820e1be", "name": "network-vif-deleted", "tag": "4fe1c66e-14d9-40fb-b811-38af75c26b97"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:15.941671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9d3ba84-635c-4908-82d1-1756187715f4 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1477 microversion: 2.1 time: 0.507881 Oct 10 10:45:15.942589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 849/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:15 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:15.967524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:15.970314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:15.976257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:15.986563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:15.987314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.007936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.013589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.014222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.015034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.025147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.025612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.027998 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] Creating event network-vif-deleted:4fe1c66e-14d9-40fb-b811-38af75c26b97 for instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be on n-h1-860687-2 Oct 10 10:45:16.030298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:16.039402 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0225e562-e86a-4302-b346-ffa19508f89d req-d34e2b27-4bd1-4a35-b29c-f9f6a25ceee0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125809 Oct 10 10:45:16.040032 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 955/1804] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:16.062893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:16.065211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:16.086506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.087346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.089974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.091519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.092999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.093855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.358640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:16.370600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c295b718-f6c1-418d-94ad-4a008f9858d8 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.325966 Oct 10 10:45:16.371222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 956/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:16 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:16.401346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d", "name": "network-vif-deleted", "tag": "bb3e6d7d-70ed-473e-9e63-ff45599f86a0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:16.445740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.446220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.446841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.482594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] Creating event network-vif-deleted:bb3e6d7d-70ed-473e-9e63-ff45599f86a0 for instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d on n-h2-860687-2 Oct 10 10:45:16.492442 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f995eeac-4ee0-41f6-9307-1cbe3c352f2d req-28807b6b-b29f-4f70-a57d-82bebf1f91fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120001 Oct 10 10:45:16.493442 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 957/1806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:16.500777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:16.501758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:16.511655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.512470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.513154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.515171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.515908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.517006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.689821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:16.699563 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f2f787f-1ec5-46ce-8812-23362ad6861d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.753576 Oct 10 10:45:16.726014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 850/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:15 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:16.731062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-808c0a4a-ba5a-4bb3-bd03-45ba20f73521 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ce154c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:16.841785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-808c0a4a-ba5a-4bb3-bd03-45ba20f73521 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.114500 Oct 10 10:45:16.856245 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 851/1808] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:16 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:16.920697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:16.924688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:16.939827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:16.941731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:16.948586 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-919f93fa-14ea-44a8-a55c-02f77d7885a7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1541 microversion: 2.1 time: 0.448526 Oct 10 10:45:16.952806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 958/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:16 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1541 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:16.954543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.955385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.956019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.962404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:16.963204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:16.963951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:16.982759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:16.984521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:17.011858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.012363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.012806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.013524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.013983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.014412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.238258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:17.259319 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c812b21d-0aaf-462d-9d27-74aec5d03968 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1306 microversion: 2.1 time: 0.296025 Oct 10 10:45:17.262792 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 959/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:16 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1306 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:17.297079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:17.308311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:17.310178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:17.311659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4300ad71-bdd2-4cd7-89e9-e5753d2aa417 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.375716 Oct 10 10:45:17.312762 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 852/1811] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:16 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:45:17.395268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:17.396265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:17.412558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.413358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.414513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.415826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.421560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.423318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.604858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:17.617567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f7fd1fcf-5673-43af-bddf-dbd323033e60 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.227486 Oct 10 10:45:17.621585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 960/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:17 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:17.735444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:17.736069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:17.746595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.748529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.749572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.751669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:17.754356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:17.755158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:17.862655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2cf3d9c5-c58d-4766-9571-c2c483dc7833 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca50160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:17.944628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=18 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:17.988929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2cf3d9c5-c58d-4766-9571-c2c483dc7833 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.128444 Oct 10 10:45:17.999963 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 961/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:17 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:18.025245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:18.026026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:18.032925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:18.057690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.061111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.061801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.063861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.068774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.069828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.345530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:18.369063 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5bfa8e7-4ce5-4fac-9961-6d20c7cadf9d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.639145 Oct 10 10:45:18.391186 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 853/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:17 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:18.406941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:18.414251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:18.432922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.435530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.437509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.438362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.440043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.442356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.515961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.516854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.517546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.518257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lazy-loading 'fault' on Instance uuid 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:45:18.681758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:18.692251 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45a1a77d-b8ef-48fa-9631-67ad0e431f27 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1540 microversion: 2.1 time: 0.690096 Oct 10 10:45:18.695712 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 962/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:17 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1540 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:18.703374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:18.711152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e96d64f-b7a0-44c6-a4be-dd1312fddac0 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 200 len: 1311 microversion: 2.1 time: 0.315005 Oct 10 10:45:18.727591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 854/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:18 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 1311 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:18.742329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:18.748350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:18.748765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:18.749424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:18.759716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.761084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.766917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.767553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.768167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.768522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.769547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.770474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:18.770606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.771393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.771765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:18.772241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:18.977206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:18.989693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f2be33d-67a8-49fc-9b96-effd58fcf1e7 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.252414 Oct 10 10:45:18.991808 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 855/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:18 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:19.006579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63327981-1e71-40f0-87c7-ca49e33cc47d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3ae280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:19.090980 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63327981-1e71-40f0-87c7-ca49e33cc47d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.089077 Oct 10 10:45:19.091719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 856/1818] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:19 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:19.182314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:19.203579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:19.217387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:19.230291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c29bbc5a-98fa-4073-b4d9-cafe902b785a tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.526924 Oct 10 10:45:19.240136 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 963/1819] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:18 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:19.440558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:19.442275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:19.458309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:19.458871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:19.461034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:19.463772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:19.464623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:19.466180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:19.723384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:19.724515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:19.737452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:19.741484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:19.742225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:19.743202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:19.746058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:19.750762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.141676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:20.156148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cf1657d0-73d1-4f4d-a7a9-208455b690ce tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1540 microversion: 2.1 time: 0.436191 Oct 10 10:45:20.160084 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 964/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:19 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1540 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:20.186407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.188454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:20.210053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.213746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.215486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.216464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.223976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.224749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.288769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] HTTP exception thrown: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Request method failure captured: Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d HTTP/1.1 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_c_70Mx_FjNMzd4uxuRLMP-aXvdytIDyfmJiE7gaCihWNPHz6T7ATRpbnom1qv63Hfq8en91WldKAwd0n7PwQW6PZ1u3Tgxr2PO_Yn90b7NzWcmhAVyWFupsLQz6YAmzURe9E4D3iwqrfiGJQtsi2Cg7im4T7c1k-74e-sTWAZfrh4 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0ad8494e92d40e2839b25f7bcb318e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0ad8494e92d40e2839b25f7bcb318e3"}]}] Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4a03479b6c834827b95ea1aa84741578 Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d'} Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:20.298117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. Oct 10 10:45:20.304040 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:20.305039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Returning 404 to user: Instance 2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:20.308320 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d29b9f7-98f0-4229-8130-1c10be62edf5 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d" status: 404 len: 111 microversion: 2.1 time: 0.146529 Oct 10 10:45:20.310292 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 965/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:20 2022] GET /compute/v2.1/servers/2e317622-e9fd-42e7-bcbb-ccdd01bf8c9d => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:20.326754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.327805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:20.337637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:20.346403 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-582042c5-e95d-4542-876d-6230b825ba87 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.945927 Oct 10 10:45:20.351780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:20.357875 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 857/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:19 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:20.366481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.368387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.369680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.372644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aad8cb29-4769-4389-b3eb-b49a03461bb4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3e6e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.373391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.382964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.382964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.474787 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aad8cb29-4769-4389-b3eb-b49a03461bb4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.114841 Oct 10 10:45:20.478962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 858/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:20 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:20.486599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.487250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:20.498147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.498929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.499675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.500581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.501687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.502322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.548387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:20.558369 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c57ff30e-1705-4b61-8b71-53de35dee2e3 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.246726 Oct 10 10:45:20.562242 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 966/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:20 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:20.573399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.575242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:20.590002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.590815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.591456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.594233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.595038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.600181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.660447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:20.887744 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-929a2c3b-9291-44e8-9353-94a721ed8160 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 204 len: 0 microversion: 2.1 time: 0.322529 Oct 10 10:45:20.888343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 967/1825] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:20 2022] DELETE /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:20.917366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:20.918032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:20.929488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.929986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.930421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.948278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:20.948278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:20.949237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:20.999554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.019273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.021387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.024668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f2e5f74-a588-4bdc-891a-a9a7e2b41c7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.544648 Oct 10 10:45:21.028244 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 859/1826] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:20 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:21.182919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:21.183762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:21.195450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.195960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.201735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.202523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.203035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.203475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.312148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.322614 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1b6bf42-155c-4a53-ba89-35ba5f98c456 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1518 microversion: 2.1 time: 0.425159 Oct 10 10:45:21.323228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 968/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:20 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:21.386862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:21.387367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:21.402711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.403257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.403708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.404458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.404903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.405328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.567955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.583593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-654a9ab7-e4b7-47d8-b027-22076f33a130 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1472 microversion: 2.1 time: 0.402214 Oct 10 10:45:21.585803 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 860/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:21 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:21.598740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d31eb8c-be34-4335-ab2c-c6bf01e6ad7c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3aeb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:21.698942 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d31eb8c-be34-4335-ab2c-c6bf01e6ad7c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.110467 Oct 10 10:45:21.699862 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 861/1829] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:21 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:21.707736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:21.709237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:21.718150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.719245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.719917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.720860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:21.721528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:21.722777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:21.799422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.810935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0343ed5d-ebc7-4264-8062-57513a561896 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.437346 Oct 10 10:45:21.811838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 969/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:21 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:21.849168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:21.858670 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03417c1c-1188-47fc-8198-0ba23d266b9c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.155303 Oct 10 10:45:21.872566 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 862/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:21 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:22.057605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:22.058228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:22.076364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.077285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.079726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.080981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.083743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.085765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.276308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d497ffe5-1800-4b8c-ad61-55bff0d5603e", "tag": "5bec660f-d47f-4bcd-9819-53766d2780c1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:22.294339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.295207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.295349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.348203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] Creating event network-changed:5bec660f-d47f-4bcd-9819-53766d2780c1 for instance d497ffe5-1800-4b8c-ad61-55bff0d5603e on n-h2-860687-2 Oct 10 10:45:22.372543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9e89f4db-0ac5-4753-96fb-21ea3fc111a5 req-27447d10-7d38-4c8f-9902-44492a846802 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099812 Oct 10 10:45:22.384102 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 863/1832] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:22.399730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-unplugged", "status": "completed", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:22.420959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.423361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.423826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.454195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Creating event network-vif-unplugged:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:45:22.475022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] Instance 83dbabda-3c39-4421-9cde-644452122411 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:45:22.489913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7f60910a-286f-4c06-afcc-49a1139c44c1 req-8e9e957d-b932-412f-afad-e7ed282caa7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103310 Oct 10 10:45:22.492301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 864/1833] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:22.506935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:22.507815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:22.523832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.524374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.524832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.528645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.529284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.529585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.615864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:22.629050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:22.644708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:22.657546 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6e93ceb-4e68-49f1-aad6-69ae647ced91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.592923 Oct 10 10:45:22.658483 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 970/1834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:22 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:22.676056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:22.681367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:22.699814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.700313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.700745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:22.703128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:22.707654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:22.708948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.169317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:23.186048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f2956ba-42e2-4c28-b5d8-7a1b45f66e03 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1518 microversion: 2.1 time: 0.692422 Oct 10 10:45:23.194207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:23.202932 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 865/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:22 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1518 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:23.217755 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bb6ab13-7c3c-4223-bf92-ec1d9d838d0b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1472 microversion: 2.1 time: 0.544574 Oct 10 10:45:23.218677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 971/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:22 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:23.251894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34ecd571-1443-4938-a441-cd1d9053455a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677cfb9af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:23.263531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:23.265805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:23.287945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.296462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.297108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.298022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.298644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.299351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.390909 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34ecd571-1443-4938-a441-cd1d9053455a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1411 microversion: 2.1 time: 0.176900 Oct 10 10:45:23.395180 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 866/1837] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:23 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:23.414459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:23.418053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:23.433274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:23.471305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.483649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.485803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.488321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.493998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.497299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.667665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:23.694874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e48fa0b5-8e9e-4605-a865-cd1abc77b27f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.453549 Oct 10 10:45:23.695842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 972/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:23 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:23.715052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:23.729757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:23.763105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.763924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.765636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.766542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:23.775166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:23.776878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:23.808357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:23.826933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc155ea2-3ba5-49ed-b16c-c17bfbb44cd2 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.428111 Oct 10 10:45:23.832318 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 867/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:23 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:24.229955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:24.230823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:24.252534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.261225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.261880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.262654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.263158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.263593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.322965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:24.335888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:24.337719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:24.339579 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34896039-b856-4ca4-a3c7-0bc8a8f8ed82 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.642128 Oct 10 10:45:24.340709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 973/1840] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:23 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:24.349918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:24.353340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:24.362790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.364088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.364767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.365729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.366413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.367091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.838186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:24.848611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:24.855157 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d4d4a0f-a2c9-4229-b1df-2916093c1375 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1518 microversion: 2.1 time: 0.630238 Oct 10 10:45:24.860529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f50cc85c-a34d-4a46-a408-9f499af93e3d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1469 microversion: 2.1 time: 0.518548 Oct 10 10:45:24.869630 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 974/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:24 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:24.872412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 868/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:24 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1518 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:24.874914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c12160a6-622f-488d-ae2d-257ee805e55d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c9a84c0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:24.900335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:24.920649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.921493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.922100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.948018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] Creating event network-vif-plugged:4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:24.961189 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1f40340c-839c-40ed-8779-fdc0e08431ca req-89e124ea-f6c7-4973-b820-84b25693b75d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085755 Oct 10 10:45:24.962022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 869/1843] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:24.968291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:24.969257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:24.975849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:24.977849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.978515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.979209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:24.980173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:24.980969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:24.981714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.244072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:25.256454 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8b0eb7d-792f-4cba-8893-c1ee92b46f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.292993 Oct 10 10:45:25.257126 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 870/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:24 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:25.264174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:25.264802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:25.284289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.285982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.286424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.289335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.289811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.290247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.410395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:25.421343 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f830542-1b96-43c2-958b-0371902e4a19 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 200 len: 1183 microversion: 2.1 time: 0.163111 Oct 10 10:45:25.429506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 871/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:25 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 1183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:25.434811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:25.435670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:25.453106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.459711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.460405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.461304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.463288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.464215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.546692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.550958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.553294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.554353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.555721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.556999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.587611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:25.628522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:45:25.641859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:45:25.868621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39b4d1da-6eba-4df5-91c2-c802141b15c5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411/action" status: 202 len: 0 microversion: 2.1 time: 0.436341 Oct 10 10:45:25.871472 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 872/1846] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:45:25 2022] POST /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:45:25.888779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:25.891329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:25.907953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.910910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.911586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:25.914796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:25.915715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:25.916325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:26.720186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:26.756224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:26.759951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:26.761470 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c401ad1-d9ab-46a6-8237-ef6f7e809904 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.887111 Oct 10 10:45:26.765512 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 873/1847] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:25 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:26.774952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:26.776012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:26.806244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:26.808003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:26.809231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:26.810691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:26.812580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:26.813833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:27.426712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:27.438366 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae54a095-6371-4ed5-8396-3ebae1f22dab tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1468 microversion: 2.1 time: 0.669885 Oct 10 10:45:27.457266 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 874/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:26 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1468 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:27.463365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:27.463915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:27.472378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:27.472861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:27.473313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:27.474059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:27.474520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:27.474953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:27.686543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:27.708660 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b838947a-dd4b-43b3-966f-1b9e68a0b006 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1476 microversion: 2.1 time: 0.249309 Oct 10 10:45:27.712517 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 875/1849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:27 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:27.726495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:27.727212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:27.745004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:27.745521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:27.745972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:27.751864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:27.752526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:27.752989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:28.236036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:28.247091 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45aae204-3daf-408d-a8bc-14cb66199526 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.532764 Oct 10 10:45:28.248118 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 876/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:27 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:28.253026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:28.254619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 00cd53e4-4cac-4c86-9aca-8acc5820e1be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:28.261571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:28.262659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:28.263331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:28.264266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:28.265313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:28.265941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:28.282703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] HTTP exception thrown: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Request method failure captured: Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be HTTP/1.1 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZN4VxkqVBav369FfV8ihSPmOnRTlYNwv06Vvk7YbDEV9zr_OtTo0XXjwXmlgwfXpR8b_gOg7-SXtB6pefW2z08IkDhmpECHdN1tNv_Od2boEKvDarWJab8EvQuGkp_pm4s0Tqow0JfhqWJ1e9deEWHiilYKvhCfhIMCwYkDaSIyI8 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_37e58734bc744586bda489a8e2edd009", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/37e58734bc744586bda489a8e2edd009"}]}] Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationTest-141284162 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: d2bfae2396ee410c964701fd5d77615e Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '00cd53e4-4cac-4c86-9aca-8acc5820e1be'} Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:28.284664 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. Oct 10 10:45:28.290872 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:28.292766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Returning 404 to user: Instance 00cd53e4-4cac-4c86-9aca-8acc5820e1be could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:28.294002 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58f1bf7d-d5d9-450a-94fa-df1349d26736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be" status: 404 len: 111 microversion: 2.1 time: 0.044686 Oct 10 10:45:28.295116 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 877/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:28 2022] GET /compute/v2.1/servers/00cd53e4-4cac-4c86-9aca-8acc5820e1be => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:28.304192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "cfddb5ce-0ba5-48b3-a0ea-9a684b78719d"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "198e4aa3-6b8a-4203-be82-10cfce441ef5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:28.327282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:28.327792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:28.328234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:28.352431 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Creating event network-vif-plugged:cfddb5ce-0ba5-48b3-a0ea-9a684b78719d for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:28.362423 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] Creating event network-vif-plugged:198e4aa3-6b8a-4203-be82-10cfce441ef5 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:28.387849 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fc5f7e51-8835-4e22-a835-0d98c5ddc081 req-f17e9b77-f924-4933-8ad2-a176319d1078 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091122 Oct 10 10:45:28.388759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 878/1852] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:28.395489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:28.396223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:28.405055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:28.405559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:28.406092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:28.409202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:28.409202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:28.409202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:29.225487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:29.243615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:29.245076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:29.246277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed7be4ad-148b-4c87-95ab-f0308de8df7e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.856381 Oct 10 10:45:29.246837 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 879/1853] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:28 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:29.265916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b3d558-6604-4c5a-8af6-ea2203902c30", "name": "network-vif-deleted", "tag": "2f131ca8-23ae-454e-83fc-7352119c5f66"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:29.322225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:29.328650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:29.329134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:29.372569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] Creating event network-vif-deleted:2f131ca8-23ae-454e-83fc-7352119c5f66 for instance 60b3d558-6604-4c5a-8af6-ea2203902c30 on n-h2-860687-2 Oct 10 10:45:29.394622 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-580cfd21-7bd4-41eb-aecd-b98a8345ae1d req-6eb1a48f-8535-4a53-9b23-cabf9a774121 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137647 Oct 10 10:45:29.403805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 880/1854] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:29.416523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:29.417659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:29.476205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:29.476891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:29.477345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:29.478077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:29.478547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:29.478977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:30.085522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:30.093656 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e44bc4df-4d98-4b10-9608-b190fc5ce0fd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1468 microversion: 2.1 time: 0.681254 Oct 10 10:45:30.094241 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 881/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:29 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1468 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:30.108010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:30.108917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:30.129153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:30.129659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:30.130106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:30.130830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:30.131329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:30.131747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:30.198573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:30.203943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:30.204782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:30.205467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lazy-loading 'fault' on Instance uuid 60b3d558-6604-4c5a-8af6-ea2203902c30 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:45:30.325845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a03479b6c834827b95ea1aa84741578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ad8494e92d40e2839b25f7bcb318e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:30.363239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fae5dd9-2c29-43de-b805-a39afb8643d2 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 200 len: 1311 microversion: 2.1 time: 0.258850 Oct 10 10:45:30.397123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 882/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:30 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:30.422018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:30.423870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:30.450911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:30.474627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:30.475374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:30.481660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:30.482577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:30.483516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:31.062593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:31.077550 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ba64f75-aed3-4dbf-8622-a9be4ceb61a9 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.677197 Oct 10 10:45:31.083348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 883/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:30 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:31.088756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:31.098937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:31.117718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:31.118472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:31.119432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:31.120471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:31.122184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:31.123557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:31.811455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:31.825132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:31.831453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:31.835376 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-415f2610-7d2a-4a6f-9c39-f7b2490e0e0d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 0.750647 Oct 10 10:45:31.852914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 884/1858] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:31 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:31.873054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "2cdf4285-725e-4f67-bc52-d7e2945c3b0b"}, {"server_uuid": "7ab5ee1d-7e41-410f-93ed-ca2621aed2a8", "name": "network-vif-plugged", "status": "completed", "tag": "168b4a45-8373-48c3-9350-c2839a488c37"}, {"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-plugged", "status": "completed", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "56698754-5517-4926-b856-1f98d0d5ac33"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-plugged", "status": "completed", "tag": "cc4d9617-8d19-468f-ae51-56148d59eab0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:31.901605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:31.906612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:31.907512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:31.952278 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:31.955606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:2cdf4285-725e-4f67-bc52-d7e2945c3b0b for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:31.956625 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:168b4a45-8373-48c3-9350-c2839a488c37 for instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 on n-h1-860687-2 Oct 10 10:45:31.957386 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:45:31.960100 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:56698754-5517-4926-b856-1f98d0d5ac33 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:31.961508 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Creating event network-vif-plugged:cc4d9617-8d19-468f-ae51-56148d59eab0 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:31.973412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] Instance 83dbabda-3c39-4421-9cde-644452122411 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:45:31.996633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-53558b98-f7f1-4c58-8e93-6ced57f0cccd req-dcf8e670-22c8-439f-be34-9a3a7d716ff4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.139858 Oct 10 10:45:31.997364 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 885/1859] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:32.008416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:32.016023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:32.037193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.039935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.040732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:32.041717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.042633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.043329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:32.466540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:32.486278 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d211fa8-1b11-43e6-a81b-a27e608a089b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1534 microversion: 2.1 time: 0.485720 Oct 10 10:45:32.500918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 886/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:31 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1534 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:32.525022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:32.537243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] [instance: 60b3d558-6604-4c5a-8af6-ea2203902c30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:32.553354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.555584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.556209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:32.557360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.559043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.564212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:32.601513 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] HTTP exception thrown: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Request method failure captured: Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 HTTP/1.1 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_c_70Mx_FjNMzd4uxuRLMP-aXvdytIDyfmJiE7gaCihWNPHz6T7ATRpbnom1qv63Hfq8en91WldKAwd0n7PwQW6PZ1u3Tgxr2PO_Yn90b7NzWcmhAVyWFupsLQz6YAmzURe9E4D3iwqrfiGJQtsi2Cg7im4T7c1k-74e-sTWAZfrh4 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d0ad8494e92d40e2839b25f7bcb318e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d0ad8494e92d40e2839b25f7bcb318e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d0ad8494e92d40e2839b25f7bcb318e3"}]}] Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d0ad8494e92d40e2839b25f7bcb318e3 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1440503567 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4a03479b6c834827b95ea1aa84741578 Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServerFiltersTestJSON-1440503567-project Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '60b3d558-6604-4c5a-8af6-ea2203902c30'} Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:32.605735 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] Returning 404 to user: Instance 60b3d558-6604-4c5a-8af6-ea2203902c30 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:32.610382 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0655a481-9099-48ef-ac0b-e04a8f5859a9 tempest-ListServerFiltersTestJSON-1440503567 tempest-ListServerFiltersTestJSON-1440503567-project] 10.222.0.16 "GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30" status: 404 len: 111 microversion: 2.1 time: 0.103253 Oct 10 10:45:32.611051 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 887/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:32 2022] GET /compute/v2.1/servers/60b3d558-6604-4c5a-8af6-ea2203902c30 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:32.628577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:32.629345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:32.640511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.641287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.641923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:32.642991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:32.643815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:32.644631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:33.479112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:33.490615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ea43e45-4b52-403c-8dea-d9776f8864b7 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.875453 Oct 10 10:45:33.520469 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 888/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:32 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:33.537432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:33.538439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:33.557901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:33.558771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:33.559495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:33.564936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:33.566437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:33.567441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:33.678281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:34.364149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:34.854982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:35.598565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:35.618976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:35.633799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:35.638729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:35.643671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6604a730-fbf5-40ab-b8bd-4d80239988f0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1874 microversion: 2.42 time: 2.118767 Oct 10 10:45:35.644597 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 889/1863] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:33 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1874 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:35.656987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:35.657929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:35.672245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:35.673034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:35.681061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:35.682142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:35.682799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:35.683625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:36.596234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:36.611064 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a726017-34c5-4843-bfe9-de065298b7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1534 microversion: 2.1 time: 0.965131 Oct 10 10:45:36.611844 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 890/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:35 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1534 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:36.662888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:36.666226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:36.705737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:36.707510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:36.708161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:36.709086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:36.714070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:36.715026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.104947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:37.114667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b85c864-99de-4ae2-8d63-01332a57e658 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.474144 Oct 10 10:45:37.115992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 891/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:36 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:37.121467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-unplugged", "status": "completed", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:37.134072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:37.134798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:37.135459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.168498 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] Creating event network-vif-unplugged:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:45:37.182411 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0add6f3b-4268-41a1-86af-573908db9baa req-1cba8026-4412-4bed-bda2-59b0a2814fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064864 Oct 10 10:45:37.186213 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 892/1866] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:37.208446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:37.209975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:37.227467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:37.228864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:37.229904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.232272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:37.232966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:37.234849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.302436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:37.479158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c83575f4-aaf0-4650-b537-62cd60abcf89 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 204 len: 0 microversion: 2.1 time: 0.288523 Oct 10 10:45:37.479988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 893/1867] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:37 2022] DELETE /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:37.493231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:37.500372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:37.514322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:37.515083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:37.515693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.517553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:37.518193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:37.519466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:37.968453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:37.992828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:37.998774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:38.001019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d33cb4cc-0a05-4d6b-a7e5-95719c3b8adf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2831 microversion: 2.42 time: 0.519719 Oct 10 10:45:38.009876 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 894/1868] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:45:37 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2831 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:38.023713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:38.030488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:38.054607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:38.055373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:38.056450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:38.057196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:38.060825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:38.061325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:38.564735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:38.573876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eaf88508-5b0a-446b-8e56-f71c2b26cef1 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1668 microversion: 2.1 time: 0.558384 Oct 10 10:45:38.574464 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 895/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:38 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1668 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:38.612120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:38.612871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:38.642468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:38.645709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:38.646366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:38.647346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:38.649547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:38.650192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:39.120940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:39.136066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66339e74-3716-43bc-a615-b95303146503 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1527 microversion: 2.1 time: 0.547906 Oct 10 10:45:39.142611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 896/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:38 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1527 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:39.167356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:39.171657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:39.209802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:39.212205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:39.213070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:39.217484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:39.220318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:39.222093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:39.422547 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a1fef41-29a2-4660-a866-c59f1c10f439 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.273755 Oct 10 10:45:39.423166 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 897/1871] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:45:39 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83/os-interface => generated 1831 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:45:39.430397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:39.432646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:39.448894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:39.451971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:39.452648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:39.454459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:39.456305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:39.457103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.164276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:40.179887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f3b1e8a-2e19-4506-9a9a-9ef87f09d57e tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.750220 Oct 10 10:45:40.181619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 898/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:39 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:40.208310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:40.209133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:40.215925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:40.216555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:40.217131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.217941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:40.218521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:40.219089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.619345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:40.633620 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92ff198f-4c87-4495-a9ad-fa5adebec3ec tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1527 microversion: 2.1 time: 0.438434 Oct 10 10:45:40.634210 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 899/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:40 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1527 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:40.642751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d497ffe5-1800-4b8c-ad61-55bff0d5603e", "name": "network-vif-plugged", "status": "completed", "tag": "5bec660f-d47f-4bcd-9819-53766d2780c1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:40.666642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:40.667238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:40.667673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.691316 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] Creating event network-vif-plugged:5bec660f-d47f-4bcd-9819-53766d2780c1 for instance d497ffe5-1800-4b8c-ad61-55bff0d5603e on n-h2-860687-2 Oct 10 10:45:40.697452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-03ceade7-6509-4480-9ea4-4c96eb3c322c req-48894b41-c8c1-4a91-9507-b26b5d462099 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061853 Oct 10 10:45:40.705286 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 900/1874] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:40.712077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:40.715657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:40.726609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:40.727433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:40.728059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.728942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:40.731586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:40.732244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:40.977184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:40.985535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcb0f8ec-6607-40b3-8f98-8ce5cc32d3a9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1600 microversion: 2.1 time: 0.277606 Oct 10 10:45:40.988686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 901/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:40 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1600 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:40.997845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d65b63-8c69-4211-a576-6a8f3a7a986c tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:41.010329 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-84d65b63-8c69-4211-a576-6a8f3a7a986c tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] HTTP exception thrown: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d65b63-8c69-4211-a576-6a8f3a7a986c tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Request method failure captured: Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/flavors/e5284a1b-908b-4a9d-8256-5b4ba676f634 HTTP/1.1 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_beQOI_qgDItj_yXdVXyPxFQKIlYSirtgyZFHj8JpV4fdfDyyB24LQBK4Zxu0TVU0FRZ_yto4CJ0Z1DHeuhsWIPZyErmkHXAIksDviwPLGpWP7PPR4k7VVrIE4j51b23qlV81yezAfeyKd1N4f9j3-k3ViA8FAOAqbR-iYOcKXroJU Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5bf9a92754354aa2babcf44a3a8a904f Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MigrationsAdminTest-429406492 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf9a92754354aa2babcf44a3a8a904f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5bf9a92754354aa2babcf44a3a8a904f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5bf9a92754354aa2babcf44a3a8a904f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5bf9a92754354aa2babcf44a3a8a904f"}]}] Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MigrationsAdminTest-429406492 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5bf9a92754354aa2babcf44a3a8a904f Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MigrationsAdminTest-429406492 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MigrationsAdminTest-429406492-project-admin Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 2b5ebe7f2d1146e6adaee015b62d9af6 Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MigrationsAdminTest-429406492-project-admin Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: exception: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e5284a1b-908b-4a9d-8256-5b4ba676f634'} Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:41.023225 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. Oct 10 10:45:41.029059 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:41.030799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84d65b63-8c69-4211-a576-6a8f3a7a986c tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Returning 404 to user: Flavor e5284a1b-908b-4a9d-8256-5b4ba676f634 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:41.031941 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84d65b63-8c69-4211-a576-6a8f3a7a986c tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/e5284a1b-908b-4a9d-8256-5b4ba676f634" status: 404 len: 109 microversion: 2.1 time: 0.041984 Oct 10 10:45:41.042401 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 902/1876] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:40 2022] DELETE /compute/v2.1/flavors/e5284a1b-908b-4a9d-8256-5b4ba676f634 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:41.209424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:41.211130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:41.219313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:41.220165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:41.224572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:41.225595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:41.231548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:41.232038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:41.454636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:41.460091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c12160a6-622f-488d-ae2d-257ee805e55d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1420 microversion: 2.1 time: 16.589064 Oct 10 10:45:41.471084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-524f81d9-9ac4-4f50-9802-3c4c5f65404a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1324 microversion: 2.1 time: 0.260805 Oct 10 10:45:41.471084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 903/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:41 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:41.474634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 975/1878] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:24 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1420 bytes in 16604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:41.480866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f410919-45ac-41e4-af22-ad33855b2a72 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c856820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:41.483950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-815746016", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:41.564411 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f410919-45ac-41e4-af22-ad33855b2a72 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 200 len: 1420 microversion: 2.1 time: 0.088361 Oct 10 10:45:41.574440 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 976/1879] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:45:41 2022] GET /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:41.574813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:45:41.584224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98f4f671-c1c2-4e69-9d3f-a47556fa80c5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c7d9040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:42.384218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:45:42.384771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:45:42.385128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:45:42.385549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:45:42.386229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:45:42.411838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.412346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.418150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.425929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.426484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.426945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.498225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:45:42.516188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Getting quotas for user 6bd4da9b853c4eb08ca095c726a3e397 and project f72eed82348240eaba9c14006269bafe. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:45:42.544118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:42.548627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:45:42.551511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:45:42.669014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e440e8ee-16bd-4b32-9d5c-beb90aca8e12 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203134 Oct 10 10:45:42.680783 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 904/1880] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:45:42.686669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "tag": "cc4d9617-8d19-468f-ae51-56148d59eab0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:42.699019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.699879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.700571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.720099 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] Creating event network-changed:cc4d9617-8d19-468f-ae51-56148d59eab0 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:45:42.726639 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b12664a6-528e-410e-bae5-b502a607bcef req-81829a83-3804-485f-b84f-32d0c46dacfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044097 Oct 10 10:45:42.727777 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 905/1881] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:42.736109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf671f2-4bd1-442c-b731-773d451d449d", "name": "network-vif-deleted", "tag": "ee55bb2b-257c-4047-8dce-8ace7b7053bb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:42.747804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.748552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.749288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.764711 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] Creating event network-vif-deleted:ee55bb2b-257c-4047-8dce-8ace7b7053bb for instance 4bf671f2-4bd1-442c-b731-773d451d449d on n-h1-860687-2 Oct 10 10:45:42.776829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-451403ef-5364-4a7c-9fb5-a8a127602586 req-ca926e0f-5231-4380-abeb-8501bbd9af11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047203 Oct 10 10:45:42.782458 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 906/1882] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:42.793491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:42.794496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:42.804735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.805687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.806623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.809997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.810675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.812105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.822580 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98f4f671-c1c2-4e69-9d3f-a47556fa80c5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 204 len: 0 microversion: 2.1 time: 1.244817 Oct 10 10:45:42.823630 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 977/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:41 2022] DELETE /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:45:42.830767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:42.831901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:42.849192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.853016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.853528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.854438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.855132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.855971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.920482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:42.925302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:42.926100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:42.926799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lazy-loading 'fault' on Instance uuid 4bf671f2-4bd1-442c-b731-773d451d449d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:45:43.016339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:43.029913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f42b27ac-8649-4f41-b3bd-6db628cd091a tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 200 len: 1324 microversion: 2.1 time: 0.244574 Oct 10 10:45:43.032347 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 907/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:42 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:43.042497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11000e07-ee3d-410b-8c52-a75cc9eeb3a0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:43.045188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11000e07-ee3d-410b-8c52-a75cc9eeb3a0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:43.101338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:43.113021 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ab307df-6fbb-419a-a2b3-fb3deb97af61 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1519 microversion: 2.1 time: 0.286891 Oct 10 10:45:43.114168 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 978/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:42 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:43.134136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-plugged", "status": "completed", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.183364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:43.185512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:43.186206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:43.237576 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] Creating event network-vif-plugged:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:45:43.244867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11000e07-ee3d-410b-8c52-a75cc9eeb3a0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:43.247420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bf3b9012-f9f0-4429-9b6b-f1bc93436721 req-9adcfec1-8cc4-4029-ac70-32c188929f9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131753 Oct 10 10:45:43.249312 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 979/1886] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:43.260774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11000e07-ee3d-410b-8c52-a75cc9eeb3a0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1212 microversion: 2.1 time: 0.226698 Oct 10 10:45:43.262385 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 908/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:43 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1212 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:43.264643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:43.265466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:43.284578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:43.288118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:43.289255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:43.290117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:43.290682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:43.291237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:43.329533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:43.400453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0952e443-13d6-46c2-b4c0-5b09d6176a06 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-51559332", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0952e443-13d6-46c2-b4c0-5b09d6176a06 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 241 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-51559332", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-51559332', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7322f94b-43e8-474e-bb83-471997eb7185'}]}}} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:45:43.411940 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.417177 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.420983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0952e443-13d6-46c2-b4c0-5b09d6176a06 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.422646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0952e443-13d6-46c2-b4c0-5b09d6176a06 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026703 Oct 10 10:45:43.423578 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 909/1888] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:45:43.443913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:43.444861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: 332cbb2b-2bbd-45de-a1da-bb7b299de6dd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:43.460094 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] HTTP exception thrown: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/332cbb2b-2bbd-45de-a1da-bb7b299de6dd/metadata HTTP/1.1 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '332cbb2b-2bbd-45de-a1da-bb7b299de6dd'} Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.470254 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.477344 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:43.477344 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:43.477344 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. Oct 10 10:45:43.477344 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.480408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 404 to user: Instance 332cbb2b-2bbd-45de-a1da-bb7b299de6dd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.482184 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e805d5df-6ccd-4bee-a3cb-2c1e7aaf9e4b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/332cbb2b-2bbd-45de-a1da-bb7b299de6dd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.048943 Oct 10 10:45:43.483066 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 910/1889] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:45:43 2022] GET /compute/v2.1/servers/332cbb2b-2bbd-45de-a1da-bb7b299de6dd/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:45:43.507102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e540c2d8-86f4-49e2-a435-08b7f6d8a160 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 204 len: 0 microversion: 2.1 time: 0.256268 Oct 10 10:45:43.508080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 980/1890] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:43 2022] DELETE /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:43.576018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a401b690-281d-4c22-b543-365495cc9810 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-935449969", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a401b690-281d-4c22-b543-365495cc9810 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 498 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-935449969", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-935449969', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7322f94b-43e8-474e-bb83-471997eb7185'}]}}} Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:45:43.580547 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.585206 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.593067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a401b690-281d-4c22-b543-365495cc9810 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.594302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a401b690-281d-4c22-b543-365495cc9810 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022872 Oct 10 10:45:43.595117 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 911/1891] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:45:43.693459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a874133-513d-4307-bde4-bf91727de00c tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1881575578", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a874133-513d-4307-bde4-bf91727de00c tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 500 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1881575578", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1881575578', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7322f94b-43e8-474e-bb83-471997eb7185'}]}}} Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:45:43.703772 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.707679 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.712399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a874133-513d-4307-bde4-bf91727de00c tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.713648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a874133-513d-4307-bde4-bf91727de00c tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025530 Oct 10 10:45:43.715560 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 981/1892] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 689 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:45:43.754935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1682272337", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8adcea62-172b-4b2d-a9dc-5bc930072e9a"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.798774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb7d1bd6-6842-483f-8b98-d0988c1ec7d2 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-858240563", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb7d1bd6-6842-483f-8b98-d0988c1ec7d2 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 753 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-858240563", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-858240563', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7322f94b-43e8-474e-bb83-471997eb7185'}]}}} Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:45:43.804151 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:45:43.807069 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:45:43.809696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.809696 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.819852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb7d1bd6-6842-483f-8b98-d0988c1ec7d2 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.821007 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb7d1bd6-6842-483f-8b98-d0988c1ec7d2 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026581 Oct 10 10:45:43.822419 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 982/1893] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 10 10:45:43.878767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] validate_networks() for [('8adcea62-172b-4b2d-a9dc-5bc930072e9a', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:45:43.902084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-49c93b4a-a9ff-4c90-ab67-ad5022c8155d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1196480036", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-49c93b4a-a9ff-4c90-ab67-ad5022c8155d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 1266 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1196480036", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7322f94b-43e8-474e-bb83-471997eb7185"}]}} Oct 10 10:45:43.911441 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1196480036', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7322f94b-43e8-474e-bb83-471997eb7185'}]}}} Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.913858 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:45:43.915113 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:45:43.917086 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:45:43.917086 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.919238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-49c93b4a-a9ff-4c90-ab67-ad5022c8155d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.920403 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-49c93b4a-a9ff-4c90-ab67-ad5022c8155d tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022731 Oct 10 10:45:43.923134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 983/1894] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 2221 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 10 10:45:43.935561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:43.936571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d21bd548-58c0-49f8-b856-3c82d6eee962] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:43.957668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] HTTP exception thrown: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d21bd548-58c0-49f8-b856-3c82d6eee962/metadata/test2 HTTP/1.1 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'd21bd548-58c0-49f8-b856-3c82d6eee962', 'id': 'test2'} Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:43.959893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:43.964410 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:43.964410 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:43.964410 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. Oct 10 10:45:43.964410 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:43.967530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 404 to user: Instance d21bd548-58c0-49f8-b856-3c82d6eee962 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:43.969196 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c660e775-e0b4-433a-aea7-42583e28a5e4 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d21bd548-58c0-49f8-b856-3c82d6eee962/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041342 Oct 10 10:45:43.970264 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 984/1895] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 10:45:43 2022] GET /compute/v2.1/servers/d21bd548-58c0-49f8-b856-3c82d6eee962/metadata/test2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:45:43.988897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:43.989705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:44.001937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.004101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.004773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.005708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.006367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.006993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.082000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:44.321105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59578c92-c47a-4ebc-a4af-3d7ae5dec97a tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 204 len: 0 microversion: 2.1 time: 0.336514 Oct 10 10:45:44.321928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 985/1896] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:43 2022] DELETE /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:45:44.329934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:44.333332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 4bf671f2-4bd1-442c-b731-773d451d449d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:44.359943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.361537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.362989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.366416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.367648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.368527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.393114 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] HTTP exception thrown: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Request method failure captured: Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d HTTP/1.1 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ZN4VxkqVBav369FfV8ihSPmOnRTlYNwv06Vvk7YbDEV9zr_OtTo0XXjwXmlgwfXpR8b_gOg7-SXtB6pefW2z08IkDhmpECHdN1tNv_Od2boEKvDarWJab8EvQuGkp_pm4s0Tqow0JfhqWJ1e9deEWHiilYKvhCfhIMCwYkDaSIyI8 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_37e58734bc744586bda489a8e2edd009", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/37e58734bc744586bda489a8e2edd009"}]}] Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-LiveMigrationTest-141284162 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: d2bfae2396ee410c964701fd5d77615e Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4bf671f2-4bd1-442c-b731-773d451d449d'} Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:44.397606 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Returning 404 to user: Instance 4bf671f2-4bd1-442c-b731-773d451d449d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10775f4e-f046-408f-9c74-8334286e732b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d" status: 404 len: 111 microversion: 2.1 time: 0.077821 Oct 10 10:45:44.403530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 986/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:44 2022] GET /compute/v2.1/servers/4bf671f2-4bd1-442c-b731-773d451d449d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:44.414152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:44.416518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:44.428976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.431435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.432121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.432907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.433402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.433812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.663182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:44.668907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:45:44.669533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:45:44.670165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:45:44.670591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:45:44.671029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:45:44.678290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69e70842-87f5-443c-870b-3af0508ca304 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1216 microversion: 2.1 time: 0.272553 Oct 10 10:45:44.694987 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 987/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:44 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1216 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:44.695623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.695741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:44.695741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:44.695955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.695955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.695955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.695955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.695955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.710017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.711770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.713570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.714441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:44.715939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:44.716970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:44.740841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:45:44.756632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for user 53f07854e54a44689b1067dbcd0ec464 and project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:45:44.785070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:45:44.787566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:45:44.843865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bd64ec7-2d80-459b-bbc5-ceca13014f9b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094099 Oct 10 10:45:44.847191 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 912/1899] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:45:44.854606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba40feaa-a576-41ea-8262-24397b979cac tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '.version_select at 0x7f677cd950d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:44.900427 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba40feaa-a576-41ea-8262-24397b979cac tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489638281" status: 202 len: 0 microversion: 2.1 time: 0.054378 Oct 10 10:45:44.905539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 913/1900] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489638281 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:45:44.923497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd972104-6b56-4da1-a1b6-2f1a49fe7f93 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:44.925842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd972104-6b56-4da1-a1b6-2f1a49fe7f93 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:45.251041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd972104-6b56-4da1-a1b6-2f1a49fe7f93 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:45.270908 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd972104-6b56-4da1-a1b6-2f1a49fe7f93 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1208 microversion: 2.1 time: 0.355530 Oct 10 10:45:45.276057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 914/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:44 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1208 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:45.485599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:45.495956 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5818a807-00fa-4a8f-8120-e22b53810f0f tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1525 microversion: 2.1 time: 0.813532 Oct 10 10:45:45.506122 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 988/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:44 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1525 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:45.703424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:45.704230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:45.729852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:45.730524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:45.730978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:45.750248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:45.752752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:45.757483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:45.850820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:45.966721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:45.977901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85f3ae54-7c54-419c-bf1b-d4d0d3c9d2f9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1264 microversion: 2.1 time: 0.279756 Oct 10 10:45:45.985394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 915/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:45 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:46.199120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab5ee1d-7e41-410f-93ed-ca2621aed2a8", "name": "network-vif-unplugged", "status": "completed", "tag": "168b4a45-8373-48c3-9350-c2839a488c37"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:46.246046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:46.247886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:46.249987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:46.296776 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] Creating event network-vif-unplugged:168b4a45-8373-48c3-9350-c2839a488c37 for instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 on n-h1-860687-2 Oct 10 10:45:46.306840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:46.307782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:46.318965 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5a2c86ce-5042-4984-970b-d9f6b2cef5f3 req-87bc0774-965f-44cf-8f7e-0a29e6633a8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125891 Oct 10 10:45:46.324065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:46.325261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:46.325521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:46.327863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:46.328331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:46.328768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:46.349953 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 989/1904] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:46.535432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:46.537680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:46.555446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:46.556247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:46.558537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:46.560222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:46.566267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:46.567431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:46.785364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:46.794288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4e3a877-50b7-4067-b52d-3d3019f38c8c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1204 microversion: 2.1 time: 0.491231 Oct 10 10:45:46.799164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 916/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:46 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1204 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:47.004591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:47.005374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:47.016016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:47.023513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:47.024300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:47.025369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:47.026073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:47.026739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:47.500643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:47.520942 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b3bf2db-73e2-4232-8e53-d055228a562e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1270 microversion: 2.1 time: 0.521138 Oct 10 10:45:47.545214 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 917/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:46 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1270 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:47.826398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:47.827090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:47.843191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:47.843692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:47.844141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:47.844862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:47.845330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:47.845762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:47.865965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:47.874782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb1329e4-23c8-4df1-8da5-18714261a98b tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1525 microversion: 2.1 time: 1.347521 Oct 10 10:45:47.883860 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 990/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:46 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1525 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:48.156504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab5ee1d-7e41-410f-93ed-ca2621aed2a8", "name": "network-vif-deleted", "tag": "168b4a45-8373-48c3-9350-c2839a488c37"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:48.178039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:48.178908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:48.179660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:48.223895 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] Creating event network-vif-deleted:168b4a45-8373-48c3-9350-c2839a488c37 for instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 on n-h1-860687-2 Oct 10 10:45:48.241539 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4ec9f91c-1e8c-450e-842f-0ef920e491f7 req-307f69d6-d7ab-4516-ad68-41baf723c89f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087192 Oct 10 10:45:48.245548 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 991/1908] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:48.473027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:48.486305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a0f40f9-4331-4771-aedd-5fdc66d73ed0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1278 microversion: 2.1 time: 0.665132 Oct 10 10:45:48.488333 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 918/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:47 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1278 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:48.549045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:48.550331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:48.562877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:48.563617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:48.565047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:48.568753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:48.569456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:48.582722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:48.914576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:48.915455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:48.933531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:48.934027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:48.952676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:48.953755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:48.955569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:48.956944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:48.965894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:48.991351 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e6d4d69-3c6c-460c-9691-9a0e1009a717 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1270 microversion: 2.1 time: 0.446878 Oct 10 10:45:48.992367 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 992/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:48 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1270 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:49.426698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea45a76755df41a6aa98e54b742af225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e24de049584a28b4474ed9b2754907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:49.444616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-144848fc-30df-4d79-8e8a-2c4a572fdea3 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 200 len: 1309 microversion: 2.1 time: 0.537696 Oct 10 10:45:49.446152 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 919/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:48 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 1309 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:49.515787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:49.516676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:49.530142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:49.530974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:49.532724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:49.535254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:49.537359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:49.538592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:49.823574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:49.836643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2418ce2-5534-4ce0-ad3d-23f8062aca0a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1266 microversion: 2.1 time: 0.325382 Oct 10 10:45:49.837230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 993/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:49 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:49.915018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:49.915519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:49.942408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:49.942914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:49.943381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:49.944104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:49.944558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:49.944983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.009222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:50.021882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:50.021882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:50.033228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.035725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.036853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.037981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.038689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.039528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.163954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:50.187685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8427ea4e-c6f8-4159-bb81-258a3164c75c tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1270 microversion: 2.1 time: 0.174337 Oct 10 10:45:50.189832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 994/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:50 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:50.195432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97a663d7-3510-475f-b2bf-5f0827a1a8ed tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 204 len: 0 microversion: 2.1 time: 0.284016 Oct 10 10:45:50.203403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 920/1914] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:49 2022] DELETE /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:50.209722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:50.210803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:50.219549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.220421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.221197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.222853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.223583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.224443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.442423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d497ffe5-1800-4b8c-ad61-55bff0d5603e", "name": "network-vif-deleted", "tag": "5bec660f-d47f-4bcd-9819-53766d2780c1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:50.483479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.484196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.485332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.522655 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] Creating event network-vif-deleted:5bec660f-d47f-4bcd-9819-53766d2780c1 for instance d497ffe5-1800-4b8c-ad61-55bff0d5603e on n-h2-860687-2 Oct 10 10:45:50.536948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-15a4359e-0a8e-4b34-b82c-a4f77b185b45 req-6c91224a-2f8b-41c9-beae-d0de42c6ec68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099466 Oct 10 10:45:50.540062 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 921/1915] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:50.553070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:50.553800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] [instance: d497ffe5-1800-4b8c-ad61-55bff0d5603e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:50.568354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.569090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.569736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.571090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.571731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.572337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.591706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] HTTP exception thrown: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Request method failure captured: Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e HTTP/1.1 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ewIybQkkSXKsE_ECIhMspFxDqFdRtz7a73F7_oDcplSHo9asCmoyDx6V8hZ3iXidzIHWWoSbQIRNOfqbGHO9nGPXcYHs8mMacc0AHRXJsUvnJFg_swzCaD3XOueRWaKf6R58visHG1vFrdCf299OmQ0C1cLjiRwn_CO8KwiHgbgUI Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_06e24de049584a28b4474ed9b2754907", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/06e24de049584a28b4474ed9b2754907"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/06e24de049584a28b4474ed9b2754907"}]}] Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 06e24de049584a28b4474ed9b2754907 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-265401972 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ea45a76755df41a6aa98e54b742af225 Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-265401972-project Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd497ffe5-1800-4b8c-ad61-55bff0d5603e'} Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:50.595469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] Returning 404 to user: Instance d497ffe5-1800-4b8c-ad61-55bff0d5603e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3faa443-9d4f-48a7-9744-8ba8fa6bc239 tempest-ServerMetadataNegativeTestJSON-265401972 tempest-ServerMetadataNegativeTestJSON-265401972-project] 10.222.0.16 "GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e" status: 404 len: 111 microversion: 2.1 time: 0.056550 Oct 10 10:45:50.650798 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 922/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:50 2022] GET /compute/v2.1/servers/d497ffe5-1800-4b8c-ad61-55bff0d5603e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:50.802924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:50.812131 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6f54348-5993-4e36-99c0-da94bfecf591 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1483 microversion: 2.1 time: 0.608791 Oct 10 10:45:50.833318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 995/1917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:50 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1483 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:50.863962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:50.864725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:50.879698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.880183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.885055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:50.886195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:50.886807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:50.887386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:51.035754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:51.046958 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6d597df-cbfa-4262-b346-5aee197c383b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1266 microversion: 2.1 time: 0.188610 Oct 10 10:45:51.053676 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 923/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:50 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:51.218290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:51.219555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:51.230309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:51.236801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:51.239129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:51.241395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:51.242653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:51.244132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:51.476428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:51.520007 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-afdf4252-7aa2-47a4-96f8-85c9eb54bdc9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1270 microversion: 2.1 time: 0.307108 Oct 10 10:45:51.523132 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 996/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:51 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:51.842343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:51.843293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:51.856425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:51.857317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:51.859777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:51.860930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:51.862738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:51.867864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:52.070416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:52.071314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:52.091386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:52.092322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:52.092966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:52.093895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:52.094643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:52.095299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:52.842759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:52.864587 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ae75afc-6a8e-4a9b-8c2e-d6f626b57ff9 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1483 microversion: 2.1 time: 1.028412 Oct 10 10:45:52.872326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 924/1920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:51 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1483 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:52.914093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:52.915501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:52.925844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:52.927094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:52.927849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:52.929857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:52.931259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:52.932037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:53.571631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:53.580314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:53.589184 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1e0efeb-8b07-4394-8045-81aff8ca6ff2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 1.522636 Oct 10 10:45:53.590868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 997/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:52 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:53.612690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9218b2cb-2af2-4d68-86b1-d7cbba73bcd8", "name": "network-vif-deleted", "tag": "bcc7a67d-b86c-4a02-9596-f10432b8292b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:53.651948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:53.652835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:53.653553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:53.671683 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] Creating event network-vif-deleted:bcc7a67d-b86c-4a02-9596-f10432b8292b for instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 on n-h1-860687-2 Oct 10 10:45:53.678118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-967db861-a46e-40a0-a0cf-cfac2e4e099a req-b4e6b689-9fe4-4482-9c4b-37d3ac90fb7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084122 Oct 10 10:45:53.679818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 998/1922] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:53.899322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:53.900043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:53.910103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:53.914213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:53.918931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:53.919926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:53.921540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:53.923579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:54.011274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:54.011706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:54.012146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:54.019093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lazy-loading 'fault' on Instance uuid 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:45:54.044653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:54.061612 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d81e5609-227d-4d08-9acd-e44b45b050f5 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 1.166299 Oct 10 10:45:54.069101 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 925/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:52 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:54.140949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:54.151970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ec135a3-8954-44eb-8fe2-80998469c72c tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 200 len: 1299 microversion: 2.1 time: 0.257097 Oct 10 10:45:54.153571 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 999/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:53 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:54.621549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:54.622364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:54.643723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:54.644868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:54.645573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:54.646873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:54.647825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:54.653999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:54.717778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:54.873900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823962d3-3b20-49d9-aa15-d65509912a74", "tag": "d18f3d40-6b15-4336-91ea-66ed9f2cae50"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:54.904403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:54.906905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:54.908079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:54.943252 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] Creating event network-changed:d18f3d40-6b15-4336-91ea-66ed9f2cae50 for instance 823962d3-3b20-49d9-aa15-d65509912a74 on n-h1-860687-2 Oct 10 10:45:54.957992 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8fa2607d-561d-4de1-968a-e2f720322656 req-12ab6556-f84a-497c-8632-31a3ba3244b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086413 Oct 10 10:45:54.967543 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1000/1925] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:55.107561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:55.109006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:55.135263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.136432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.137853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.141915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.144151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.151967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.257772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:55.547499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:55.566834 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-837cc3e0-8e16-4fed-9da6-131ca1432ef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 0.951084 Oct 10 10:45:55.567521 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 926/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:54 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:55.586557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:55.587604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:55.601237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.603680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.604271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.607985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.608661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.609318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.641362 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] HTTP exception thrown: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Request method failure captured: Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 HTTP/1.1 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZN4VxkqVBav369FfV8ihSPmOnRTlYNwv06Vvk7YbDEV9zr_OtTo0XXjwXmlgwfXpR8b_gOg7-SXtB6pefW2z08IkDhmpECHdN1tNv_Od2boEKvDarWJab8EvQuGkp_pm4s0Tqow0JfhqWJ1e9deEWHiilYKvhCfhIMCwYkDaSIyI8 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_37e58734bc744586bda489a8e2edd009", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/37e58734bc744586bda489a8e2edd009"}]}] Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationTest-141284162 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: d2bfae2396ee410c964701fd5d77615e Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationTest-141284162-project Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9218b2cb-2af2-4d68-86b1-d7cbba73bcd8'} Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:45:55.646174 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:45:55.649244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Returning 404 to user: Instance 9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:45:55.649834 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8149396e-f80a-433d-821a-57b4c5dc1dab tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8" status: 404 len: 111 microversion: 2.1 time: 0.080929 Oct 10 10:45:55.656222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 927/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:55 2022] GET /compute/v2.1/servers/9218b2cb-2af2-4d68-86b1-d7cbba73bcd8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:45:55.667671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:55.668399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:55.679605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.682366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.682819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.687515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.687618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.692950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.744460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:45:55.773437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:55.781482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccf2fe48-f11e-4159-acfc-0e6db3fbdf9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.685291 Oct 10 10:45:55.787380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1001/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:55 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:55.927282 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8af7520b-8a6c-4ecf-b064-ecb30fc40d5b tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 204 len: 0 microversion: 2.1 time: 0.269572 Oct 10 10:45:55.928304 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 928/1929] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:45:55 2022] DELETE /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:45:55.936847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:55.938042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:55.950731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.951190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.952770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:55.954824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:55.956627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:55.957229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:56.266797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:56.291548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44ca4ca5-a33d-4357-bb01-d170e28d6736 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1501 microversion: 2.1 time: 0.358253 Oct 10 10:45:56.295531 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1002/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:55 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:56.592534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:56.593257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:56.611564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:56.614803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:56.621095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:56.624765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:56.625738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:56.626402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:56.809004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:56.810549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:56.826293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:56.829158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:56.829958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:56.833746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:56.834346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:56.837816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:57.129212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:57.139982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdae0e5b-68fc-418d-9c57-c8f1453629a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 0.553849 Oct 10 10:45:57.141588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 929/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:56 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:57.147730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:45:57.164034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:57.164882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:57.167921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:57.218738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] Creating event network-changed:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:45:57.233395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-821ce61b-1191-45cf-ac36-9b81fe113bdb req-2c5bd6c5-abaa-4420-a0da-af9451b8a6a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085585 Oct 10 10:45:57.234647 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 930/1932] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:45:57.276295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:57.287397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ceb320c9-c85e-42bd-8f6b-c8e8005eabb3 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.484496 Oct 10 10:45:57.288745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1003/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:56 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:45:57.320734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:57.321514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:57.335762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:57.341558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:57.342523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:57.343177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:57.343921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:57.344505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:57.407832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:45:58.165962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:58.168392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:58.181413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:58.182917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:58.185718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:58.187114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:58.191962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:58.210508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:58.403303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:58.422207 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5a3d106-78c9-4b1a-9642-acf9709272c0 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1501 microversion: 2.1 time: 1.098564 Oct 10 10:45:58.424007 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 931/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:57 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1501 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:58.439292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:58.440868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:58.454132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:58.457207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:58.459819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:58.460988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:58.464376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:58.467325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:59.238235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:59.247163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5bf8605-f7bb-4ba3-9a7a-fd78897083a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 1.085238 Oct 10 10:45:59.251701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1004/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:58 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:59.287255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:45:59.308935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbeae3ec-342b-4eb2-b137-7708c87f9ddb tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.877594 Oct 10 10:45:59.309974 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 932/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:58 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:45:59.452504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:45:59.453286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:45:59.465353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:59.465972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:59.466483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:59.468385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:45:59.468928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:45:59.470962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:45:59.925383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-677732907", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c3ef0b82-2efe-4d87-9cad-d5f5f2d9d7ec"}], "security_groups": [{"name": "tempest-securitygroup--242733296"}], "key_name": "tempest-keypair-169460523", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "77798c8f-5611-48d2-8691-9505d9e20e5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:00.512388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] validate_networks() for [('c3ef0b82-2efe-4d87-9cad-d5f5f2d9d7ec', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:46:00.974042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2bfae2396ee410c964701fd5d77615e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e58734bc744586bda489a8e2edd009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:00.996894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb4c3544-8504-4772-bb20-51de8f7d5661 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 200 len: 1501 microversion: 2.1 time: 1.547485 Oct 10 10:46:00.998243 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1005/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:45:59 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 1501 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:01.005420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:01.006421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:01.015727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:01.016498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:01.018811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:01.021486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:01.022319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:01.023266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:01.881484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:01.892052 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b362c31b-8ea7-4e04-b2da-12629af47712 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 0.891895 Oct 10 10:46:01.894202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1006/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:00 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:01.903918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:01.907871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:01.922150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:01.922971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:01.923658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:01.926024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:01.926670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:01.930368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:02.540668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:02.562493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da63b9ee-258a-40c6-87f5-f8141931b32b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.664242 Oct 10 10:46:02.564228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1007/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:01 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:02.631234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for project 842cf83a29be46cca41020e234da2339. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:02.644838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for user 9033c0d378a545c487d7e90558a3d89d and project 842cf83a29be46cca41020e234da2339. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:02.650845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:02.672733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:46:02.673417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:46:02.674273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:46:02.675177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:46:02.675749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:46:02.689156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:02.690548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:02.699108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:02.701851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:02.703076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:02.704450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:02.745677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for project 842cf83a29be46cca41020e234da2339. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:02.753703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Getting quotas for user 9033c0d378a545c487d7e90558a3d89d and project 842cf83a29be46cca41020e234da2339. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:02.909185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:46:02.916481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77798c8f-5611-48d2-8691-9505d9e20e5b',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:46:03.027977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1215438032", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "0cc25303-00af-4a4d-852e-7117f3e12056"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:03.141996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] validate_networks() for [('0cc25303-00af-4a4d-852e-7117f3e12056', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:46:03.254426 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ace2a587-40f0-4528-8730-c48b08fb1c79 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.333969 Oct 10 10:46:03.255872 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 933/1940] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:45:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:46:03.262773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f143b145-e939-4d70-8b2f-a820bb1da065", "name": "network-vif-deleted", "tag": "5feb11b1-c915-412f-b614-78efefef6f98"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:03.279739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:03.280698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:03.281337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:03.300565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] Creating event network-vif-deleted:5feb11b1-c915-412f-b614-78efefef6f98 for instance f143b145-e939-4d70-8b2f-a820bb1da065 on n-h1-860687-2 Oct 10 10:46:03.311992 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5907b6a0-dda4-48be-b4ea-bee97fe64a43 req-133eaa79-4e18-4841-9854-2f532124b5eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054652 Oct 10 10:46:03.313588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 934/1941] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:03.320590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:03.322203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] [instance: f143b145-e939-4d70-8b2f-a820bb1da065] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:03.330136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:03.333897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:03.334608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:03.336635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:03.337324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:03.338715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:03.356826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] HTTP exception thrown: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Request method failure captured: Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 HTTP/1.1 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ZN4VxkqVBav369FfV8ihSPmOnRTlYNwv06Vvk7YbDEV9zr_OtTo0XXjwXmlgwfXpR8b_gOg7-SXtB6pefW2z08IkDhmpECHdN1tNv_Od2boEKvDarWJab8EvQuGkp_pm4s0Tqow0JfhqWJ1e9deEWHiilYKvhCfhIMCwYkDaSIyI8 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_37e58734bc744586bda489a8e2edd009", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/37e58734bc744586bda489a8e2edd009"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/37e58734bc744586bda489a8e2edd009"}]}] Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationTest-141284162 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 37e58734bc744586bda489a8e2edd009 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationTest-141284162 Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationTest-141284162-project Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: d2bfae2396ee410c964701fd5d77615e Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationTest-141284162-project Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f143b145-e939-4d70-8b2f-a820bb1da065'} Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:03.359142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. Oct 10 10:46:03.363340 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:03.365497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] Returning 404 to user: Instance f143b145-e939-4d70-8b2f-a820bb1da065 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:46:03.366579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8be975fa-3069-4a71-8b6f-13d203b65356 tempest-LiveMigrationTest-141284162 tempest-LiveMigrationTest-141284162-project] 10.222.0.16 "GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065" status: 404 len: 111 microversion: 2.1 time: 0.051732 Oct 10 10:46:03.372769 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 935/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:03 2022] GET /compute/v2.1/servers/f143b145-e939-4d70-8b2f-a820bb1da065 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:46:03.383234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:03.385543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:03.396522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:03.397318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:03.398929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:03.399871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:03.400506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:03.402158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:04.886367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:04.898696 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc4cfe21-e223-4038-8b03-0064c497f9da tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 1.523347 Oct 10 10:46:04.902485 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 936/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:03 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:04.916442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823962d3-3b20-49d9-aa15-d65509912a74", "name": "network-vif-plugged", "status": "completed", "tag": "d18f3d40-6b15-4336-91ea-66ed9f2cae50"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:04.945919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:04.946720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:04.947407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:04.992601 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] Creating event network-vif-plugged:d18f3d40-6b15-4336-91ea-66ed9f2cae50 for instance 823962d3-3b20-49d9-aa15-d65509912a74 on n-h1-860687-2 Oct 10 10:46:05.006250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-14cd3427-bf15-4b1e-8898-fdf88229a164 req-19e08057-0702-437f-b9a7-7c6582e44bcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099020 Oct 10 10:46:05.007105 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 937/1944] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:05.028371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:05.031450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:05.048131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:05.049803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:05.050257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:05.052657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:05.054741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:05.055649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:05.802699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:05.814292 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-951166ca-443d-42bd-a859-b00e4538110a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1218 microversion: 2.1 time: 0.805229 Oct 10 10:46:05.817307 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 938/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:05 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1218 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:05.831446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:05.833524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:05.856740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:05.860302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:05.860910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:05.865009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:05.867497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:05.868190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:06.916581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:46:06.917095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:46:06.917523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:46:06.917940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:46:06.918410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:46:06.937196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:06.957451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:06.959362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:06.960378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:06.973599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:06.973681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:06.974178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:07.047437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Getting quotas for project 83a47e60ed744ccb8f284ed8eaee44a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:07.060354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Getting quotas for user 86b28b82141749ab837167304f511393 and project 83a47e60ed744ccb8f284ed8eaee44a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:07.093495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:46:07.102166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:46:07.240919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b303819-8368-4bee-9ecf-cf925e6996fc tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.670724 Oct 10 10:46:07.244124 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1008/1946] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:46:07.255090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:07.258783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:07.298611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:07.307446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:07.311089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:07.314594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:07.317248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:07.337376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:07.417284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:07.438726 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc57e2d7-775a-4b4f-83d2-b8ed94b49122 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 1.616693 Oct 10 10:46:07.442059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 939/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:05 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:07.465010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:07.466233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:07.506820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:07.510189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:07.515881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:07.516676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:07.517158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:07.521797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:07.892114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:07.918404 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f237f5f1-9b4f-4bde-8d33-d7454df69f44 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1236 microversion: 2.1 time: 0.472477 Oct 10 10:46:07.920818 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 940/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:07 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1236 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:07.930788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60e8ec7d-758d-4193-aba5-21ce46cbe83e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:07.937022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60e8ec7d-758d-4193-aba5-21ce46cbe83e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:08.119945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60e8ec7d-758d-4193-aba5-21ce46cbe83e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:08.130820 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60e8ec7d-758d-4193-aba5-21ce46cbe83e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1225 microversion: 2.1 time: 0.208481 Oct 10 10:46:08.131603 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 941/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:07 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:08.234993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:08.260247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-964149cc-5e75-43c1-b9d0-c96e65ae9145 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1308 microversion: 2.1 time: 1.014699 Oct 10 10:46:08.261104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1009/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:07 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1308 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:08.470020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:08.470581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:08.496237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:08.503179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:08.504037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:08.504897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:08.505874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:08.506534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:08.949559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:08.950343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:08.976778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:08.977303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:08.977750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:08.980986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:08.980986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:08.992670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:09.019599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:09.054338 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23f7d2fb-f163-4e0e-86a3-a57497d8a234 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.582875 Oct 10 10:46:09.083267 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 942/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:08 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:09.171450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:09.172085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:09.216544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:09.217139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:09.221276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:09.227870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:09.234487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:09.235375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:09.486695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:09.496724 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01df107e-9516-4c60-8204-b84f8299cf9e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1277 microversion: 2.1 time: 0.342829 Oct 10 10:46:09.507043 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 943/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:09 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1277 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:09.524989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:09.525866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:09.545978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:09.547915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:09.548579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:09.552182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:09.552966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:09.554095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:09.951492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:09.959948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b9a9df1-5352-4003-ab83-0fcb058ea7ee tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1303 microversion: 2.1 time: 1.016004 Oct 10 10:46:09.966663 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1010/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:08 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1303 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:09.972942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-plugged", "status": "completed", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:10.030421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:10.047315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:10.047940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:10.090491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] Creating event network-vif-plugged:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:46:10.114975 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a28dd5ba-ee5c-429b-a277-345978196763 req-36f2e49d-6386-4d86-a81b-f48149db3d81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146824 Oct 10 10:46:10.126068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1011/1954] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:10.142404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:10.151220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:10.165755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:10.170944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:10.171998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:10.172956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:10.175935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:10.177404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:10.635536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:10.651121 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a960aa57-ccf2-4b31-83e7-b193f59c6366 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1489 microversion: 2.1 time: 1.140836 Oct 10 10:46:10.663140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 944/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:09 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1489 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:10.679183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:10.680232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:10.687971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:10.688867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:10.689557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:10.691366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:10.692045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:10.692691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:10.953477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:10.977700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:10.980543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57810fda-b179-41ab-a8c3-b55857233c19 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1283 microversion: 2.1 time: 0.313533 Oct 10 10:46:10.989046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-efac61fe-49df-491b-9d0b-98d4ea0991b7 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 0.861539 Oct 10 10:46:10.993290 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1012/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:10 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:11.005061 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 945/1957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:10 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:11.008671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:11.014552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:11.019961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:11.027726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.028225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.031836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.033208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.033972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.035612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.037930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.039284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.039882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.087227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 10:46:11.159113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69f31b5b-49b5-42d6-93ee-1e20267ac6f2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74/action" status: 202 len: 0 microversion: 2.1 time: 0.164020 Oct 10 10:46:11.161196 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1013/1958] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:46:10 2022] POST /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:46:11.175173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:11.177564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:11.193997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.195395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.196625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.198336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.200781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.201423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.699872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:11.715126 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16f9de25-b8b6-41d3-9bed-3405f8ac1343 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.546963 Oct 10 10:46:11.722661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1014/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:11 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:11.813971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:11.825603 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9871fbfe-0762-4a0d-a18c-9b28f3503a91 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1303 microversion: 2.1 time: 0.817138 Oct 10 10:46:11.826207 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 946/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:11 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1303 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:11.842749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee74691-9b0a-41a7-b38a-1b6122e6471f", "tag": "ab2705fa-277c-4a40-9ba2-ae565c330328"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:11.881730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:11.882223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:11.882663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:11.899357 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] Creating event network-changed:ab2705fa-277c-4a40-9ba2-ae565c330328 for instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f on n-h2-860687-2 Oct 10 10:46:11.905768 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bee70540-b205-4575-99ab-754bfff2990b req-a8fe258f-aafc-4064-b0ff-51aee480f6a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067924 Oct 10 10:46:11.906908 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1015/1961] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:46:12.009990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:12.010901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:12.021667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:12.024517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:12.030066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.031649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.032692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:12.034639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.035288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.036068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:12.041610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.042245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.042870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:12.044191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.044795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.045488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:12.074989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:12.692258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:12.702123 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7695525-b68b-4138-94bf-a4b567b8841c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1283 microversion: 2.1 time: 0.696091 Oct 10 10:46:12.723523 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 947/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:12 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1283 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:12.745935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:12.746954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:12.749222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:12.764445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.765318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.766094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:12.767079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:12.768384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:12.776385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:13.151377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:13.167902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48a13228-9a04-4777-84d7-ecd246643571 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1312 microversion: 2.1 time: 1.154153 Oct 10 10:46:13.168832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1016/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:12 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1312 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:13.173742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:13.174719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:13.181128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:13.181853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:13.182431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:13.183357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:13.183962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:13.184538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:13.451960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:13.467249 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a34a4f94-dd94-482e-ab3f-c8896b3677f7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.724638 Oct 10 10:46:13.468477 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 948/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:12 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:13.731717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:13.732331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:13.746130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:13.746637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:13.747157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:13.748098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:13.748701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:13.749329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:13.787297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:13.804650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-979dbc05-a9c0-4894-bbe3-643666425662 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1303 microversion: 2.1 time: 0.634571 Oct 10 10:46:13.818842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1017/1965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:13 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1303 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:14.051874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:14.068448 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4123320a-53a4-4cec-ad42-9a27d193a25e tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1283 microversion: 2.1 time: 0.340454 Oct 10 10:46:14.069609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 949/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:13 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1283 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:14.194436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:14.195652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:14.210958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:14.211752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:14.212534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:14.213616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:14.214272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:14.215956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:14.492415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:14.495313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:14.506458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:14.508983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:14.509656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:14.510586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:14.512768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:14.513441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.070476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:15.079032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e447e55-14c1-4312-8354-acba573bf918 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.590863 Oct 10 10:46:15.079686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 950/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:14 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:15.095353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:15.096940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:15.107314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.112442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.113742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.115272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.121607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.123025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.394762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:15.403749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f82a844-ae2b-4d6b-8f31-337c2b5359de tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1461 microversion: 2.1 time: 1.213956 Oct 10 10:46:15.404980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1018/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:14 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1461 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:15.410640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:15.415943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:15.434933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.435867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.436597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.437702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.438448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.439239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.762763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:15.766395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:15.788582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fb10411-6037-482a-b4c1-7b14169bcbf4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1303 microversion: 2.1 time: 0.704991 Oct 10 10:46:15.790016 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 951/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:15 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1303 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:15.817962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:15.818792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:15.830226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.831710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.832397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:15.833334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:15.834109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:15.834726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:16.074144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:16.097619 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b31e4fb-1fed-4d9b-b0a6-be2c2da5ca63 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.691065 Oct 10 10:46:16.099233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1019/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:15 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:16.125915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:16.126746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:16.164640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:16.165626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:16.167911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:16.168932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:16.172447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:16.173241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:17.009221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:17.079583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:17.185472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31f2eae7-fc8c-469e-9454-dcb084f8a267 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1612 microversion: 2.1 time: 1.392755 Oct 10 10:46:17.203607 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 952/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:15 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1612 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:17.213142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:17.214167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:17.222428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:17.223230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:17.225641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:17.226565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:17.227221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:17.228604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:17.238827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:17.249953 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a67fa6f-1388-4bfa-b4b1-ca9876479b6b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 1.138234 Oct 10 10:46:17.251852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1020/1972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:16 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:17.265397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:17.266377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:17.282148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:17.282832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:17.285372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:17.286334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:17.290385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:17.290965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.079875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:18.089133 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1c345ad-855b-4abb-89f5-3e4b98cadf80 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.835845 Oct 10 10:46:18.090345 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1021/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:17 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:18.113383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:18.114734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:18.123150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.124314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.125232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:18.127152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.128644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.129369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.129995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.154277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:18.167115 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0584b03e-d520-4703-871b-a6bc2348b520 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1291 microversion: 2.1 time: 0.962133 Oct 10 10:46:18.177166 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 953/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:17 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1291 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:18.250429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2b5ebe7f2d1146e6adaee015b62d9af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bf9a92754354aa2babcf44a3a8a904f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:18.251312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] flavor_id is None. Assuming migration. {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 10:46:18.251883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 10:46:18.284360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:18.285131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:18.292283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.292999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.294137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.294848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.295318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.295736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.708925 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e7a74ee-56ff-4e3f-a4fa-e4fcc4252993 tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0/action" status: 202 len: 0 microversion: 2.1 time: 0.605047 Oct 10 10:46:18.711668 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1022/1975] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:46:18 2022] POST /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:46:18.726623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:18.728226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:18.750728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.751249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.751683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.752513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:18.752955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:18.753557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:18.961811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:18.982671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42ee1479-7965-4e71-8d2b-87250c8e123f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.706206 Oct 10 10:46:18.985800 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 954/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:18 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:19.122769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:19.123607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:19.136919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:19.137729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:19.138857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:19.140530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:19.142537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:19.144044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:19.450212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:19.464105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-77b55179-b67f-4296-bf46-676bf56436c4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1470 microversion: 2.1 time: 0.748053 Oct 10 10:46:19.465956 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1023/1977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:18 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1470 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:19.476687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:19.477612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:19.488990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:19.490563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:19.490858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:19.491730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:19.493747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:19.494444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:19.494947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:19.500595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83147b25-3f0d-4e5a-bb6a-fdda5066676c tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.387999 Oct 10 10:46:19.511496 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 955/1978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:19 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:20.013205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:20.014218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:20.028062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:20.032778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:20.033848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:20.034988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:20.035845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:20.037657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:20.803550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:20.813312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:20.824719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0658ca6-d2d3-4051-8983-50a2030fae8b tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1291 microversion: 2.1 time: 1.353983 Oct 10 10:46:20.827244 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1024/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:19 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1291 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:20.828302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae3f8dcb-f81e-4c98-ab69-abf2ff9d8eb3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.819415 Oct 10 10:46:20.844413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 956/1980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:20 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:20.857541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d0aeae-9ea5-40fd-8749-d8b71c6ffd91", "tag": "303c0b0e-b391-41a1-91a5-f96c8fac9646"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:20.940436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:20.942936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:20.943783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:20.979989 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] Creating event network-changed:303c0b0e-b391-41a1-91a5-f96c8fac9646 for instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 on n-h2-860687-2 Oct 10 10:46:20.996397 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b12526a6-2990-42ae-8c88-eb19811963d3 req-2a744831-4d5d-42a0-8490-8ebdbdfe507d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150499 Oct 10 10:46:20.998400 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 957/1981] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:21.010164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:21.011187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:21.018680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:21.019781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:21.020409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:21.021318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:21.022335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:21.023727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:21.137003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1058648973", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:21.243355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] validate_networks() for [('b6f1748c-0611-4e4d-8f82-a369e996a4d7', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:46:21.720525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:21.736871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-955ef6de-945b-4025-a248-dbe97c136d57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1470 microversion: 2.1 time: 0.732253 Oct 10 10:46:21.737619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 958/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:20 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1470 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:21.764826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:21.765465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:21.784304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:21.787619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:21.788271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:21.790233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:21.792833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:21.793525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:22.387148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:22.405115 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50bd5c6c-62c2-40f9-9c4c-2e363e688a88 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.665750 Oct 10 10:46:22.431788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 959/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:21 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:22.441159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:22.442048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:22.453193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:22.454150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:22.454798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:22.456165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:22.456843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:22.457621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.506126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:23.519709 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d53cc78-dc7e-4075-9650-96cfefc0ac02 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 1.086524 Oct 10 10:46:23.520957 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 960/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:22 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:23.526812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:23.527709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:23.543120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.543905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.544495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.545368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.547200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.547806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.805430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:46:23.805934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:46:23.806631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:46:23.808626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:46:23.809229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:46:23.829464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:23.833962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.834977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.837362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.840984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.841607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.842710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.846857 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-549e1f64-a5f1-4a8d-8362-86ceb2d3b678 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1291 microversion: 2.1 time: 0.321738 Oct 10 10:46:23.847618 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 961/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:23 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1291 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:23.852350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:23.859523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:23.866534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.879820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.880515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.881456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:23.882075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:23.882656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:23.936287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Getting quotas for project 70a7c36ef3094851bb1d2f1a2f71f598. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:23.946449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Getting quotas for user b1aaea68afd24511bf9787b7722c7a2f and project 70a7c36ef3094851bb1d2f1a2f71f598. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:23.969655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:46:23.974165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:46:24.072370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1a72fa0-308d-46ce-9381-8ecd9535101f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.243829 Oct 10 10:46:24.079795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1025/1986] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:46:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:46:24.086986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:24.088017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:24.112373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.114423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.115060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:24.128142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.129210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.130496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:24.269693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:24.281914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-125a0598-3b35-4fe1-9ae2-546ad6a15ae2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1470 microversion: 2.1 time: 0.433026 Oct 10 10:46:24.284039 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 962/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:23 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1470 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:24.301686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c3e3d4e-d6ab-4ce2-8638-911dcd3cede3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:24.302395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c3e3d4e-d6ab-4ce2-8638-911dcd3cede3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:24.474511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c3e3d4e-d6ab-4ce2-8638-911dcd3cede3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:24.487719 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c3e3d4e-d6ab-4ce2-8638-911dcd3cede3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1223 microversion: 2.1 time: 0.200808 Oct 10 10:46:24.504403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 963/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:24 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1223 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:24.543830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:24.544573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:24.557573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.559296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.562929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:24.563865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.564541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.565532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:24.773865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:24.784495 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-673e4dae-b913-4386-83e2-d68bf83323ff tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.701863 Oct 10 10:46:24.808317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1026/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:24 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:24.869709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:24.870825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:24.882351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.883234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.883927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:24.884892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:24.885566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:24.889250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.105419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:25.136194 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06e711ae-c104-43a2-8410-b5d30275863b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.596380 Oct 10 10:46:25.155556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 964/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:24 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:25.310030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:25.310719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:25.317561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.318485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.319111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.320170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.320773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.321457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.324802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:25.333252 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4c4aee7-b269-4a41-8c62-154af086c9cb tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1291 microversion: 2.1 time: 0.467280 Oct 10 10:46:25.339173 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1027/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:24 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1291 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:25.515841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:25.516478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:25.530502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.531291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.531900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.532787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.534009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.535640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.672725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:25.681664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:25.688564 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cf14a2a6-09b4-4abb-9024-2ddbd1dc2acc tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1275 microversion: 2.1 time: 0.177334 Oct 10 10:46:25.690412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1028/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:25 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:25.710818 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08f3814f-615c-408d-a366-21d85a4ecb06 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.404535 Oct 10 10:46:25.714343 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 965/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:25 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:25.831254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:25.833336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:25.844290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.845159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.847208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:25.849827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:25.850515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:25.851503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.161931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:26.162698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:26.174835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.176584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.177234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.178123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.182808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.183485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.554432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:26.563921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c17d304d-3ff7-42a5-aecf-4433f625e3ab tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.741879 Oct 10 10:46:26.581696 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1029/1994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:25 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:26.581696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:26.581696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:26.593982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.594492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.595018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.595758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.596681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.596681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.813576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:26.830979 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55514c1e-fb2c-4cec-897f-04265ba0334e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.673203 Oct 10 10:46:26.840269 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 966/1995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:26 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:26.854257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee74691-9b0a-41a7-b38a-1b6122e6471f", "name": "network-vif-plugged", "status": "completed", "tag": "ab2705fa-277c-4a40-9ba2-ae565c330328"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:26.882977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.886807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.887494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.928092 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] Creating event network-vif-plugged:ab2705fa-277c-4a40-9ba2-ae565c330328 for instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f on n-h2-860687-2 Oct 10 10:46:26.947999 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a69005b3-a768-47a7-a456-fc33d2971ecc req-6385e2f0-ec66-4e8e-a2c0-3d1ad69bf48c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101068 Oct 10 10:46:26.949202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 967/1996] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:26.957137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:26.958190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:26.966467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.967316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.967948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.969005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:26.969645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:26.970256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:26.976592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:26.994536 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ce7e051-d2ba-4a70-9c3d-9b549803bce6 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1291 microversion: 2.1 time: 0.424815 Oct 10 10:46:27.014865 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1030/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:26 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1291 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:27.020352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:27.028065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:27.050717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.051682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.052351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.053404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.054163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.054809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.177111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:27.185950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3dfd980-96b1-46ba-b41b-552d0b5de306 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1281 microversion: 2.1 time: 0.235261 Oct 10 10:46:27.186573 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 968/1998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:26 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:27.479548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:27.492059 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b82f0e5-08b9-4356-af1f-e6fea3135e57 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.475917 Oct 10 10:46:27.493250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1031/1999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:27 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:27.593015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:27.593882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:27.607686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.608188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.613764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.615691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.618625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.619302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.869938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:27.871967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:27.882194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.883105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.883711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.884670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:27.885640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:27.886220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:27.892137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:28.485658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:28.499372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:28.505867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0e321d3-03ee-49d4-a833-a6ec3580eb4d tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.914519 Oct 10 10:46:28.508393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 969/2000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:27 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:28.512916 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af2d1d51-5b57-45b9-b255-5a3d82489cf6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.647611 Oct 10 10:46:28.517532 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1032/2001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:27 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:28.536879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:28.542297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:28.543231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:28.545711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:28.555941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:28.560597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:28.560810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:28.561144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:28.561470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:28.561595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:28.562299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:28.562768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:28.563254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:28.563388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:28.564003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:28.572088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.094399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:29.095244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:29.100132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:29.109747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab59d110-04bb-404f-a37b-fbfcfe5c3d5b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.590851 Oct 10 10:46:29.109902 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97ad2853-5206-4e77-a1a5-a23ebe5336f2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1482 microversion: 2.1 time: 0.600125 Oct 10 10:46:29.110790 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1033/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:28 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:29.124447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:29.125441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:29.128715 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 970/2003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:28 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1482 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:29.132697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.133199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.133639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.137622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.140272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.140455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d0aeae-9ea5-40fd-8749-d8b71c6ffd91", "name": "network-vif-plugged", "status": "completed", "tag": "303c0b0e-b391-41a1-91a5-f96c8fac9646"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:29.147407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.156101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.156514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.156957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.169459 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] Creating event network-vif-plugged:303c0b0e-b391-41a1-91a5-f96c8fac9646 for instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 on n-h2-860687-2 Oct 10 10:46:29.176517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ecf28358-b641-4a3d-8b10-cc4e5a58a251 req-66fc789b-3db4-4afb-8c6c-e4ec93cfe8ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045811 Oct 10 10:46:29.180033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 971/2004] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:29.187672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:29.188326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:29.196334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.196839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.197273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.198677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.199179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.199605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.452512 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39b2cd03-533b-4b5f-b310-e573dacb1236 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270993 Oct 10 10:46:29.463993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 972/2005] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:46:29 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f/os-interface => generated 284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:29.532333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:29.535169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:29.540498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:29.542473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.548608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.549848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.551171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.551819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.552543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.644679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:29.662273 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7fba32f3-f0fe-4c58-ba5e-2c5ce80bd58b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.548908 Oct 10 10:46:29.663177 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1034/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:29 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:29.679523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:29.686455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:29.701909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.702655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.703360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.704347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:29.705650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:29.706293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:29.977158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:29.993891 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baa5c163-1cb5-44d8-8d84-d51d66ea01cf tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1325 microversion: 2.1 time: 0.460198 Oct 10 10:46:30.011660 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 973/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:29 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:30.119169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:30.128802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-88fdf795-224d-4472-92d1-57548d2067e1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.464363 Oct 10 10:46:30.145788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:30.146873 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1035/2008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:29 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:30.148558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:30.168621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:30.169103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:30.169595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:30.170240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:30.170693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:30.171162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:30.524843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:30.534686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce3e55f0-879b-477f-8337-36fc3a1a46bd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.399601 Oct 10 10:46:30.553866 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 974/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:30 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:30.698431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:30.699217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:30.718664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:30.721920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:30.723908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:30.726253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:30.730255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:30.730779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:30.746164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:30.779486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:30.787299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:30.790087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:30.812019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] Creating event network-changed:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:46:30.818642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d6e59b66-1ad8-4ae2-b527-3983a2740ac8 req-1d995392-ec2b-411f-b142-2af8fe6f86e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076529 Oct 10 10:46:30.820154 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 975/2010] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:31.018214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:31.018944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:31.032578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.035669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.036126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.036865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.037328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.037760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.065510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:31.073813 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a875312e-a7b0-4ec8-a05d-f7f963365559 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.391950 Oct 10 10:46:31.077825 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1036/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:30 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:31.154269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:31.154894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:31.162296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.162795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.166436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.167776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.168268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.168720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.582924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:31.593634 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f290910-21d0-48f4-8cb5-5d46f18d1738 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.443385 Oct 10 10:46:31.594231 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1037/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:31 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:31.635334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:31.636270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:31.651873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.654171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.654992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.657699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.659258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.659762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.667029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:31.691503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb3dbd3d-aa19-4784-b369-6fced806c452 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1521 microversion: 2.1 time: 0.667168 Oct 10 10:46:31.692557 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 976/2013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:31 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:31.699267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee74691-9b0a-41a7-b38a-1b6122e6471f", "tag": "ab2705fa-277c-4a40-9ba2-ae565c330328"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:31.727812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.729978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.730781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.757942 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] Creating event network-changed:ab2705fa-277c-4a40-9ba2-ae565c330328 for instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f on n-h2-860687-2 Oct 10 10:46:31.765467 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-70a586c6-b4fd-4b21-982c-324885876e89 req-8ed59e7e-f490-4404-b720-51a883c8db64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069531 Oct 10 10:46:31.774554 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 977/2014] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:31.781069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:31.782623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:31.791526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.792652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.793552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:31.794894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:31.795881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:31.796757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.654946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:32.665516 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-52f4a5e7-78cb-4d11-86fa-8d5ce57ddb4e tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1482 microversion: 2.1 time: 1.069355 Oct 10 10:46:32.666102 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1038/2015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:31 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1482 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:32.680162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:32.681053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:32.689064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:32.689855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.690551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.691619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.692891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.693738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.694415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.708352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c573491-bbb1-467d-80d7-d8a3b198ca40 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.931896 Oct 10 10:46:32.708858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 978/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:31 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:32.732288 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] HTTP exception thrown: Instance is not a member of specified network Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Request method failure captured: Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91/ips/invalid HTTP/1.1 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_foHdZLOO0mkanlQRr3AZvzqaypxdPIXcz_3wmjEzHGO4IRDP2eJ2f6DLFgkfrzxb7ix97jbIat1Oukne9Ly0M4aorv-Co2aFDTxS5fvezeMP0sPtpwBr39587oyiygzNjj5BQAghhK7wJ2aItPwRr_IdH1nSoPYlMiIynzRyIw49Y Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83a47e60ed744ccb8f284ed8eaee44a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83a47e60ed744ccb8f284ed8eaee44a6"}]}] Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 86b28b82141749ab837167304f511393 Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance is not a member of specified network Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': '37d0aeae-9ea5-40fd-8749-d8b71c6ffd91', 'id': 'invalid'} Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 10 10:46:32.737911 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:32.740970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:46:32.740970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cfbabbc5-4ed0-4cee-bd86-30a51d478560 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.072392 Oct 10 10:46:32.740970 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1039/2017] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:46:32 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91/ips/invalid => generated 91 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:46:32.748799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:32.749881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:32.756976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.757474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.757992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.758993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.759475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.759900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.858252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:32.862245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.862807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.863392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.864605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.865130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.865621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.890755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01ced085-d1ac-41e0-87ee-bf94346e8afe tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.180873 Oct 10 10:46:32.891417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 979/2018] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:46:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:32.897507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:32.898429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:32.904829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.905308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.905733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:32.906421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:32.906873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:32.907322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.203701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:33.212764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc1c3618-ee75-49be-9e35-7c91f2116633 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.467853 Oct 10 10:46:33.213989 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1040/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:32 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:33.222840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.223482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:33.231107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.231602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.232042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.232752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.233210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.233643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.360341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:33.370411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:33.372153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:33.373632 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2e56e99-0924-44ac-bb51-bead114d1019 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2949 microversion: 2.42 time: 0.480102 Oct 10 10:46:33.392292 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 980/2020] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:46:32 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2949 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:46:33.402434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.406432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Failed to fetch instance by id 999 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:46:33.407128 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] HTTP exception thrown: Instance 999 could not be found. Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Request method failure captured: Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_foHdZLOO0mkanlQRr3AZvzqaypxdPIXcz_3wmjEzHGO4IRDP2eJ2f6DLFgkfrzxb7ix97jbIat1Oukne9Ly0M4aorv-Co2aFDTxS5fvezeMP0sPtpwBr39587oyiygzNjj5BQAghhK7wJ2aItPwRr_IdH1nSoPYlMiIynzRyIw49Y Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83a47e60ed744ccb8f284ed8eaee44a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83a47e60ed744ccb8f284ed8eaee44a6"}]}] Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 86b28b82141749ab837167304f511393 Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 999 could not be found. Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '999'} Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 10:46:33.409088 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:46:33.413335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:46:33.414337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f55109e6-9b18-41bf-889a-4e588258eb90 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020397 Oct 10 10:46:33.415472 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 981/2021] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:46:33.421328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.425842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.426536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.427216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.428711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.429282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.429999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.461472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88b56785-df3e-444e-8425-d37fb582a4b6 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.044474 Oct 10 10:46:33.462704 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 982/2022] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:33.475045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.475779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:33.481765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.485367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.485367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.485367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.485367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.485367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.518458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:33.527526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87136006-ed78-49dc-9f5c-fd5f3bc27dfc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.312257 Oct 10 10:46:33.545322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1041/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:33.551495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.552001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:33.572242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.573273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.573883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.574497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.575199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.575949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.603560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:46:33.624965 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf9bd123-063a-415d-86c5-2dc44cf69aeb tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.160892 Oct 10 10:46:33.626572 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 983/2024] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83/os-interface => generated 1831 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:46:33.634585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.639951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.640447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.640905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.641705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.642191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.642947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.670739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b265203a-ff11-4500-b23c-d3508e056359 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041659 Oct 10 10:46:33.679494 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 984/2025] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/os-services => generated 944 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:33.685223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.691655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.692935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.693675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.694720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.695354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.696118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.739898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:33.755350 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1d2f0478-a883-4989-b6bd-413a47dc8680 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 204 len: 0 microversion: 2.1 time: 0.208010 Oct 10 10:46:33.757780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-200bd16b-c3c8-4137-8c4d-80c2df1c5369 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-860687-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.075875 Oct 10 10:46:33.759162 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1042/2026] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:46:33 2022] DELETE /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:46:33.764623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.765592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:33.766833 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 985/2027] 10.222.0.16 () {58 vars in 1194 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/os-services?host=n-d-860687-2&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:46:33.773667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:33.774294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:33.776799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.777462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.778047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.779557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.780162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.780773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.783670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.784174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.784618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.785333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:33.785966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:33.786821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:33.913320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:33.958735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:34.107434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:34.115398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:34.116969 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f4f633b-09cc-45fc-b28e-98e968852c07 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1527 microversion: 2.1 time: 0.348361 Oct 10 10:46:34.131404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4fde45b-3c35-43ef-aa7b-627e746ca344 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.362535 Oct 10 10:46:34.131404 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1043/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:34.131404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:34.132176 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 986/2029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:33 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:34.132349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.137580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.137580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.137580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.137580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.137580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.162487 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb0222b3-7476-4b23-ab32-adc4986806b3 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037630 Oct 10 10:46:34.163116 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1044/2030] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:46:34 2022] GET /compute/v2.1/os-services => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:34.176909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:34.181840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.182338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.182927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.183785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.184867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.185284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.215302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7bc03784-920f-4411-8839-ff8b9b761f91 tempest-ServicesAdminNegativeTestJSON-147830253 tempest-ServicesAdminNegativeTestJSON-147830253-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.043128 Oct 10 10:46:34.223188 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 987/2031] 10.222.0.16 () {58 vars in 1198 bytes} [Mon Oct 10 10:46:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:46:34.241654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:34.242279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:34.248755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.249250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.249685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.250478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.251050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.251485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.480691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:34.511997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37f72568-1b14-47a6-b690-772cd8721d0f tempest-ServicesAdminNegativeTestJSON-51769765 tempest-ServicesAdminNegativeTestJSON-51769765-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:34.515532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37f72568-1b14-47a6-b690-772cd8721d0f tempest-ServicesAdminNegativeTestJSON-51769765 tempest-ServicesAdminNegativeTestJSON-51769765-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'bcfb0e98d9a54b3ca5170316a00247ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d197c21cf34d468506618598161d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37f72568-1b14-47a6-b690-772cd8721d0f tempest-ServicesAdminNegativeTestJSON-51769765 tempest-ServicesAdminNegativeTestJSON-51769765-project] Request method failure captured: Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_gGBhrJqeL2jRQNy_mqYOKrBHb4woAPaP2o5sdTROJF6c_OcBVCzYHpfTY0Xa9hL-o8Wo1yXKk4ubEhEnJaG-_6lZxd2KJ3LXbRk1CvL4o0phFZWmWjiR2WSECMPUQ4sP16nMMZuQPkZ4_dcMvjAPuBTFBVUroi6--elmnjM_mRD48 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b3d197c21cf34d468506618598161d9c Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-51769765 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3d197c21cf34d468506618598161d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b3d197c21cf34d468506618598161d9c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b3d197c21cf34d468506618598161d9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b3d197c21cf34d468506618598161d9c"}]}] Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-51769765 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b3d197c21cf34d468506618598161d9c Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-51769765 Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServicesAdminNegativeTestJSON-51769765-project Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bcfb0e98d9a54b3ca5170316a00247ba Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-51769765-project Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:46:34.517255 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37f72568-1b14-47a6-b690-772cd8721d0f tempest-ServicesAdminNegativeTestJSON-51769765 tempest-ServicesAdminNegativeTestJSON-51769765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:46:34.521121 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37f72568-1b14-47a6-b690-772cd8721d0f tempest-ServicesAdminNegativeTestJSON-51769765 tempest-ServicesAdminNegativeTestJSON-51769765-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.292974 Oct 10 10:46:34.524419 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1045/2032] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:46:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:46:34.544795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:34.554949 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c7def16-234f-43be-9f67-117410d1fd9e tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.319865 Oct 10 10:46:34.556358 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 988/2033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:34 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:34.556465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:34.557381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:34.568787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.570407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.572283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.573338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:34.574565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:34.575024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:34.763973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:34.765972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b2c15cb-f1e9-4ed1-a93a-42032658fed1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.218845 Oct 10 10:46:34.766734 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1046/2034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:34 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:35.158821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:35.159699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:35.160162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:35.162615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:35.209276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.209782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.210322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.211158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.214735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.215692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.216425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.216927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.217369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.218083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.218554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.218955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.634058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:35.645865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d5d4058-85b8-4f9c-b530-3f56479725e7 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1527 microversion: 2.1 time: 0.504749 Oct 10 10:46:35.649242 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 989/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:35 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1527 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:35.680995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:35.696930 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-859eb5a3-1461-4575-9117-fbe854d62b7b tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.553117 Oct 10 10:46:35.697512 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1047/2036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:35 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:35.792024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:35.793539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:35.807641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.808506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.808972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.809739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.810783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.814263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.914050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:35.914853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:35.922503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.923273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.925001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:35.925937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:35.926546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:35.927212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.191461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:36.205702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dea1975f-a137-4395-b0a0-1f53ff2c642f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.417936 Oct 10 10:46:36.225469 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1048/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:35 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:36.264030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d0aeae-9ea5-40fd-8749-d8b71c6ffd91", "name": "network-vif-deleted", "tag": "303c0b0e-b391-41a1-91a5-f96c8fac9646"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:36.277549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.278197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.278924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.283573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:36.284135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:36.292334 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] Creating event network-vif-deleted:303c0b0e-b391-41a1-91a5-f96c8fac9646 for instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 on n-h2-860687-2 Oct 10 10:46:36.294000 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00f936ce-3dca-42e2-9c81-cd2343b0fc35 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.642029 Oct 10 10:46:36.297821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b1cd3fe5-2aee-46a1-9ce7-64deb53cb499 req-7959929c-df46-41a5-ad27-29a7410257a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039201 Oct 10 10:46:36.298759 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1049/2038] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:46:36.299092 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 990/2039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:35 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:36.677187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:36.678279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:36.684762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.685615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.686515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.687416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.688039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.688654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.724548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.725028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.726317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.727068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lazy-loading 'fault' on Instance uuid 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:46:36.732785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:36.732785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:36.759756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.759756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.759756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.760594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.761266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.761943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.831106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b28b82141749ab837167304f511393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a47e60ed744ccb8f284ed8eaee44a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:36.845948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e2fb1e2-b858-4d51-8565-414b4c51b957 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 200 len: 1315 microversion: 2.1 time: 0.173074 Oct 10 10:46:36.848235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1050/2040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:36 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:36.929753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "name": "network-vif-plugged", "status": "completed", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:36.951960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:36.952499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:36.952942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:36.979942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] Creating event network-vif-plugged:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:46:36.995128 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0152b189-0176-4391-a9cd-a4a008d69dc5 req-1a34306e-8ba4-412e-b7f8-555ebc9aafbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071292 Oct 10 10:46:36.996152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1051/2041] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:37.083049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:37.096464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be211731-0be7-474d-acaa-4627119b15d5 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.374755 Oct 10 10:46:37.098392 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 991/2042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:36 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:37.231356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:37.232249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:37.246510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.249810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.250432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.254104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.255132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.257264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.324359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:37.325604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:37.334314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.335243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.335960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.336806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.337655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.338525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.564173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:37.573096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-13ec0070-552d-429a-aa94-5904d760aa06 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.347027 Oct 10 10:46:37.573722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1052/2043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:37 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:37.586298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:37.594691 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c4a0eff-4204-4db5-b3ec-d4cd5ddb4fe1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.274572 Oct 10 10:46:37.595319 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 992/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:37 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:37.874887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:37.875585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] [instance: 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:37.888103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.888714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.891580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.893259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:37.895169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:37.895770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:37.930174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] HTTP exception thrown: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Request method failure captured: Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 HTTP/1.1 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_foHdZLOO0mkanlQRr3AZvzqaypxdPIXcz_3wmjEzHGO4IRDP2eJ2f6DLFgkfrzxb7ix97jbIat1Oukne9Ly0M4aorv-Co2aFDTxS5fvezeMP0sPtpwBr39587oyiygzNjj5BQAghhK7wJ2aItPwRr_IdH1nSoPYlMiIynzRyIw49Y Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83a47e60ed744ccb8f284ed8eaee44a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83a47e60ed744ccb8f284ed8eaee44a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83a47e60ed744ccb8f284ed8eaee44a6"}]}] Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 83a47e60ed744ccb8f284ed8eaee44a6 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-530748978 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 86b28b82141749ab837167304f511393 Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-530748978-project Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '37d0aeae-9ea5-40fd-8749-d8b71c6ffd91'} Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:37.931975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. Oct 10 10:46:37.935967 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:46:37.936579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] Returning 404 to user: Instance 37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:46:37.937503 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30d8539b-2049-412c-b9cb-6d3827a33d50 tempest-ServerAddressesNegativeTestJSON-530748978 tempest-ServerAddressesNegativeTestJSON-530748978-project] 10.222.0.16 "GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91" status: 404 len: 111 microversion: 2.1 time: 0.066901 Oct 10 10:46:37.938146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1053/2045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:37 2022] GET /compute/v2.1/servers/37d0aeae-9ea5-40fd-8749-d8b71c6ffd91 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:46:38.121913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:38.122538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:38.131215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.131710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.132144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.132849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.133302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.134309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.410218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:38.423782 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9118c922-13b8-490a-bd25-860cda6c9dd9 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1323 microversion: 2.1 time: 0.302904 Oct 10 10:46:38.438091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 993/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:38 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:38.603447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:38.604635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:38.613741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.614835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.615482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.616346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.629933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.631907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.633898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:38.636807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:38.664057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.665857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.667199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.668212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:38.669876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:38.670577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:38.713496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:39.026620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:39.032401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:39.041267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-372e4eb8-0732-4551-a3b4-3b89452b9931 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.443301 Oct 10 10:46:39.044809 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a27d23d6-ab01-4c2d-90fa-ed7372c458ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.418326 Oct 10 10:46:39.046526 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1054/2047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:38 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:39.059787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 994/2048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:38 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:39.260774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1080997787", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:39.327036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:46:39.448572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:39.449335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:39.461315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:39.467579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:39.469179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:39.469937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:39.470452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:39.474192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.406390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:40.421104 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3584c38a-32b2-406d-8f2c-7d18162d3af3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1518 microversion: 2.1 time: 0.977355 Oct 10 10:46:40.431411 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 995/2049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:39 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1518 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:40.463924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:40.465591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:40.474314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.476990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.477653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.478750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.479418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.480330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.693094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:46:40.694463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:46:40.695266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:46:40.695826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:46:40.696424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:46:40.710686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.711509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.712212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.713364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.713994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.714816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.755618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Getting quotas for project f013a34213e445ea857f8fb0175d1282. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:40.764827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Getting quotas for user dafca388d68d4c9fb829c0fbf05e2c3b and project f013a34213e445ea857f8fb0175d1282. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:40.782280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:46:40.785187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:46:40.854583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-854eb086-ee87-4959-bf47-101e7f45516a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805570 Oct 10 10:46:40.859080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1055/2050] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:46:40.872514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:40.873325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:40.895238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.907800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.909019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.909551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:40.910010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:40.910543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:40.932876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:40.953014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d492fa7-4d97-4296-b295-3293c9d474a0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1499 microversion: 2.1 time: 0.518285 Oct 10 10:46:40.954585 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 996/2051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:40 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1499 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:40.973927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:40.978419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:41.003402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:41.004187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:41.004854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:41.006406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:41.007147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:41.007957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:41.043422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lazy-loading 'flavor' on Instance uuid 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:46:41.179862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f856c02d-8664-4fe8-aa9c-60b48d1fd1a4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action" status: 200 len: 32 microversion: 2.1 time: 0.219776 Oct 10 10:46:41.180704 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 997/2052] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:46:40 2022] POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:46:41.187801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e6b00fc-512a-4564-aabe-e08ecf1f7370 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:41.188754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e6b00fc-512a-4564-aabe-e08ecf1f7370 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:41.338029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e6b00fc-512a-4564-aabe-e08ecf1f7370 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:41.362497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e6b00fc-512a-4564-aabe-e08ecf1f7370 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1214 microversion: 2.1 time: 0.167904 Oct 10 10:46:41.362497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 998/2053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:41 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:41.366897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:41.367823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:41.389060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:41.389860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:41.391854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:41.399466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:41.402005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:41.402471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:41.488954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:41.507970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9540c1a-fe14-4ea6-876b-115537278c6d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.647466 Oct 10 10:46:41.508679 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1056/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:40 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:41.807726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:41.823838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffe3ee68-3d64-47e1-9349-f3f4f5b1aa48 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.466832 Oct 10 10:46:41.827153 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 999/2055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:41 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:41.985256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:41.988585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:42.010829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.012443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.015224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.018314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.021614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.022267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.369282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:42.388201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:42.391024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:42.405764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b07894b-5fef-446b-9f4f-5e2e1b78c270 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 200 len: 1476 microversion: 2.1 time: 0.426828 Oct 10 10:46:42.407186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1057/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:41 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:42.436839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.438372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.439533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.440991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.441783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.442383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.444520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-278972181"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:42.453765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:42.469409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.477702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.478411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.479727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.480078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.480506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.678300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:42.708856 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92edaa68-9fdf-4b15-993e-335ade5dcbb4 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1266 microversion: 2.1 time: 0.336220 Oct 10 10:46:42.720116 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1000/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:42 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:42.731485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:42.759460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:42.780221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.787999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.790268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.791780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:42.792272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:42.794620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:42.991473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66e0073c-42e0-488c-847f-658871dcbd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74/action" status: 202 len: 0 microversion: 2.1 time: 0.562985 Oct 10 10:46:42.992190 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1058/2058] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:46:42 2022] POST /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:46:43.011017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:43.016334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:43.037822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:43.038637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:43.039400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:43.041764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:43.043132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:43.045515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:43.127043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:43.136675 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3a32044-ea99-4bd7-9453-a376ef8ac81a tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.414432 Oct 10 10:46:43.150379 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1001/2059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:42 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:43.150379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78bf85b5-486f-479c-95f4-d05341c17513 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677cf7daf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:43.234793 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78bf85b5-486f-479c-95f4-d05341c17513 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.089013 Oct 10 10:46:43.243086 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1002/2060] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:43 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:43.355713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1152434973", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "af11dad6-136c-41f7-a9f8-2643d1a66737"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:43.429474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] validate_networks() for [('af11dad6-136c-41f7-a9f8-2643d1a66737', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:46:43.551230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:43.561598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ceef3935-c956-49c6-906e-55c4d7d9ca45 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.564422 Oct 10 10:46:43.580297 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1059/2061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:42 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:43.745590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:43.746495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:43.756217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:43.757040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:43.757687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:43.759214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:43.759940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:43.760815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:43.897100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:43.913611 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3eab473a-472f-4e83-89a0-879c8241f9db tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1272 microversion: 2.1 time: 0.169647 Oct 10 10:46:43.914282 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1060/2062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:43 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:44.165229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:44.165856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:44.183255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.183758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.184111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:46:44.184699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.184812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:46:44.184995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.185464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.185912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.190313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:46:44.190917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:46:44.191274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:46:44.194795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:44.210202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.210695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.211169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.211914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.212377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.212805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.275929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Getting quotas for project 0da0f484c5744a188efaad483207af32. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:46:44.292178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Getting quotas for user e00702cc57c94cb0826c151c05dcf649 and project 0da0f484c5744a188efaad483207af32. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:46:44.319929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:46:44.325182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:46:44.428602 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34a09545-a055-4b76-a1ce-62451b174fbb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186924 Oct 10 10:46:44.429675 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1003/2063] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:46:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:46:44.440713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ee1b04c-dbfa-465c-8c2f-d0a844e068ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca60e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:44.468338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:44.477469 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2de0647-d84f-4d01-af44-9608eb10b746 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.317048 Oct 10 10:46:44.482722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1061/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:44 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:44.499788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c6fb25a-f29d-402c-ba87-c2b07b9dc40a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:44.500656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c6fb25a-f29d-402c-ba87-c2b07b9dc40a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:44.537830 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ee1b04c-dbfa-465c-8c2f-d0a844e068ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.105407 Oct 10 10:46:44.538657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1004/2065] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:44 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:44.597952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:44.599390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:44.623569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c6fb25a-f29d-402c-ba87-c2b07b9dc40a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:44.629345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.630742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.631442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.632904 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c6fb25a-f29d-402c-ba87-c2b07b9dc40a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1224 microversion: 2.1 time: 0.148794 Oct 10 10:46:44.633507 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1062/2066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:44 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:44.636028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.636861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.638508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.943459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:44.944092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:44.953567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.954070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.955082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:44.960582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:44.961082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:44.961527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:45.216698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:45.230724 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40d8d1f1-75d8-4a40-88d4-ffec541fb4a0 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.643293 Oct 10 10:46:45.234218 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1005/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:44 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:45.460783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:45.492056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03cd7966-d907-492c-b098-1d9477a89371 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.557257 Oct 10 10:46:45.498096 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1063/2068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:44 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:45.520266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:45.520904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:45.528303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:45.533049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:45.533531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:45.534891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:45.535395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:45.535826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:45.555919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39dbd1eb-7764-42db-971b-9b2a464161c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c8a5a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:45.657476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-39dbd1eb-7764-42db-971b-9b2a464161c9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.106783 Oct 10 10:46:45.665681 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1064/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:45 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:45.691345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:45.692311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:45.714417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:45.714862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:45.723878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:45.724779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:45.725261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:45.726818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:45.912309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:45.931461 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b2880c6-521a-4ce3-9ebc-876e82eeb839 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1276 microversion: 2.1 time: 0.260755 Oct 10 10:46:45.932049 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1065/2070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:45 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:46.064528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:46.089087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94c07356-d08a-4720-9426-f791023a1e5b tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1475 microversion: 2.1 time: 0.579625 Oct 10 10:46:46.107402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1006/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:45 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1475 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:46.271220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:46.271838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:46.282746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:46.286536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:46.289378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:46.293438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:46.294919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:46.296033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:46.528165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:46.531909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:46.542244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:46.542979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:46.543987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:46.545267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:46.545929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:46.546639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.393505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:47.408960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f46106d9-e5ce-4ac9-a441-7f0dcf0b4d4d tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 1.142241 Oct 10 10:46:47.425409 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1066/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:46 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:47.434300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-569e4951-07c2-432c-9409-01bc08d55342 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a68a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:47.489590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:47.504208 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47120bf4-9d39-4a9f-be97-89749e72d993 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.986444 Oct 10 10:46:47.505796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-569e4951-07c2-432c-9409-01bc08d55342 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.076807 Oct 10 10:46:47.506598 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1067/2073] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:47 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:47.513907 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1007/2074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:46 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:47.520203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:47.521034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:47.528778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:47.529683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:47.540051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.540826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.541849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.543278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.545030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.546264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.546596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.547295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.549637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.551853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.552825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.553424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.774620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:47.784477 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1282 microversion: 2.1 time: 0.276442 Oct 10 10:46:47.804125 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1068/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:47 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:47.805439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:47.808940 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d847592f-0df5-4291-bf09-a03b2f2f0071 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003818 Oct 10 10:46:47.810844 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1069/2076] 10.222.0.16 () {56 vars in 886 bytes} [Mon Oct 10 10:46:47 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 10:46:47.824954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823962d3-3b20-49d9-aa15-d65509912a74", "name": "network-vif-plugged", "status": "completed", "tag": "d18f3d40-6b15-4336-91ea-66ed9f2cae50"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:47.850039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.853717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.854385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.883253 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] Creating event network-vif-plugged:d18f3d40-6b15-4336-91ea-66ed9f2cae50 for instance 823962d3-3b20-49d9-aa15-d65509912a74 on n-h1-860687-2 Oct 10 10:46:47.895159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-48668df3-3234-4bca-a028-e92b11f0c015 req-4fdee07d-538b-4fe9-9c92-42c7f0dbbc77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082154 Oct 10 10:46:47.900313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1070/2077] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:47.910132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-unplugged", "status": "completed", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:47.937470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:47.946051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:47.946778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:47.984881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Creating event network-vif-unplugged:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h2-860687-2 Oct 10 10:46:47.993679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:48.000276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:46:48.026825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f8eb0c7d-f41d-4dfb-a49b-01b70f0189e7 req-6e09007c-f682-4827-863d-8052f083a84e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123624 Oct 10 10:46:48.029795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1071/2078] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:48.045016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2f56ce-cfac-41f5-86aa-012676126ee6", "tag": "e22d5298-0dd6-495c-8e03-6eb3de73cec7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:48.073926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:48.075372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:48.076028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:48.119438 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] Creating event network-changed:e22d5298-0dd6-495c-8e03-6eb3de73cec7 for instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 on n-h2-860687-2 Oct 10 10:46:48.131030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b5814718-278b-4219-861a-daee915c7b8c req-59bddb08-aca3-439f-bb76-112484b7eef0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097950 Oct 10 10:46:48.135478 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1072/2079] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:48.170585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:48.183491 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf99dbdc-bafa-4ab0-9eba-952f664a2264 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1474 microversion: 2.1 time: 0.667330 Oct 10 10:46:48.185300 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1008/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:47 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1474 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:48.439851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:48.440554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:48.451042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:48.451713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:48.452156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:48.452864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:48.453318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:48.453750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:48.522234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de6361a0-399c-4734-bf19-f27fbdc51531 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca91700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:48.591229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de6361a0-399c-4734-bf19-f27fbdc51531 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.072664 Oct 10 10:46:48.601006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1009/2081] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:48 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:48.606933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:48.613012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:48.628891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:48.629770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:48.630414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:48.631402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:48.632098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:48.632680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:49.025358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:49.037536 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b8c048d-b654-439c-b44a-5228f91bd47c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.603968 Oct 10 10:46:49.056443 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1073/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:48 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:49.062468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:49.071686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:49.078163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:49.092291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd2cfdbb-7f16-4181-ac9b-a08d6ba0d21f tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.490088 Oct 10 10:46:49.096487 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1010/2083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:48 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:49.111154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:49.113201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:49.114923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:49.116776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:49.117417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:49.118265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:49.210180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:49.210706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:49.220480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:49.226373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:49.226946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:49.227912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:49.228545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:49.230795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:49.497455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:49.509530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2e79c72-e9a5-4544-9392-8e444ace0354 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.451656 Oct 10 10:46:49.511247 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1074/2084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:49 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:49.552674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:49.561516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fba4257d-1d2f-44b6-a799-c854c46d00ae tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1474 microversion: 2.1 time: 0.355509 Oct 10 10:46:49.563036 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1011/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:49 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:46:49.610148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0591be3b-2712-466b-9e1a-f6c04c557534 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777af5790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:49.714287 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0591be3b-2712-466b-9e1a-f6c04c557534 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.109265 Oct 10 10:46:49.716291 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1075/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:49 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:50.062048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:50.070039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:50.070956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:50.094406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.094920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.100389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.104710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.107343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.108177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.109255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.109918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.111591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.134574 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Creating event network-changed:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h2-860687-2 Oct 10 10:46:50.180128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:46:50.199227 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3111b82f-0db3-4289-b65d-300789a5414c req-c3010c08-c2ab-424d-ac6b-df97146ca2a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134579 Oct 10 10:46:50.200653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1076/2087] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:50.208058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:50.209182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:50.217747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.218437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.219297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.220682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.221426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.222037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.716779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:50.734585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3dddb820-cece-4542-8e9e-4969b80ede40 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.532221 Oct 10 10:46:50.735249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1077/2088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:50 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:50.741606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:50.742434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:50.744708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:50.763488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.764268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.765031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.766083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.767403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.768673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.770054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:50.785410 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07a7e97f-d735-43a8-8d5f-738ee1bff26a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.727094 Oct 10 10:46:50.786112 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1012/2089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:50 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:50.806769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:50.807899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:50.824246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.824929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.825456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:50.826278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:50.826883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:50.830696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:51.401053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:51.406188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:51.411523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-088a3bb2-01ae-4962-ad73-2e57abfeff15 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.674458 Oct 10 10:46:51.414481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1078/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:50 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:51.423207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:51.423207 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e655e3e8-48f5-405f-bc26-051406e88337 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1474 microversion: 2.1 time: 0.634715 Oct 10 10:46:51.423207 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1013/2091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:50 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1474 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:51.439271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e549f982-324a-490c-8073-96805ec4a58a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a748b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:51.518281 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e549f982-324a-490c-8073-96805ec4a58a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.083192 Oct 10 10:46:51.519347 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1079/2092] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:51 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:51.635827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-849e72da-b4e7-407d-a41c-d13b81302bfa tempest-ExtensionsTest-1536804184 tempest-ExtensionsTest-1536804184-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:51.638588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-849e72da-b4e7-407d-a41c-d13b81302bfa tempest-ExtensionsTest-1536804184 tempest-ExtensionsTest-1536804184-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.208950 Oct 10 10:46:51.640107 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1014/2093] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:46:51 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:51.650102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6994a82e-a8d9-440b-ad24-758126095043 tempest-ExtensionsTest-1536804184 tempest-ExtensionsTest-1536804184-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:51.652833 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6994a82e-a8d9-440b-ad24-758126095043 tempest-ExtensionsTest-1536804184 tempest-ExtensionsTest-1536804184-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006829 Oct 10 10:46:51.654869 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1080/2094] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 10 10:46:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:46:51.761867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:51.762663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:51.764629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:51.775546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:51.776436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:51.777107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:51.777812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:51.778295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:51.778688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:51.812129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:51.815567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:51.825327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:51.826271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:51.826906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:51.828254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:51.828991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:51.833513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:52.035027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:52.044576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ede8a32a-f39e-4799-8a14-117b76589e82 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.286818 Oct 10 10:46:52.054894 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1015/2095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:51 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:52.088287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:52.103062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-483bf46f-26c2-41d1-91a7-68e59dfdcec4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.295605 Oct 10 10:46:52.105255 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1081/2096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:51 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:52.229408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:52.241110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:52.241596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:52.242725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:52.256176 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] Creating event network-changed:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:46:52.264335 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d9cb4f67-fc98-480e-bfbf-20048afb6c8b req-8d3f8afc-5c66-414d-8ebb-2007b336aa49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038966 Oct 10 10:46:52.265305 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1016/2097] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:46:52.442127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:52.443914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:52.454595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:52.455728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:52.456465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:52.457713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:52.458684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:52.459412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:52.490458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:52.492883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:52.514023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:52.516460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:52.519817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:52.523087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:52.529504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:52.531373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:53.003396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:53.017896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74037b1d-af53-4433-9ca2-03af2c4f3516 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1472 microversion: 2.1 time: 0.532277 Oct 10 10:46:53.019173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1017/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:52 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:53.027283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f66ef0e7-3d3d-4157-ab8b-e421b4f0bff9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c9630d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:53.101834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:53.112615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f66ef0e7-3d3d-4157-ab8b-e421b4f0bff9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.091663 Oct 10 10:46:53.114115 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1018/2099] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:53 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:53.122679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:53.123683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:53.128703 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c37b0fa-ce9f-436d-b79d-c77e390226df tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.691293 Oct 10 10:46:53.129371 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1082/2100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:52 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:53.137660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:53.139320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:53.149092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:53.149767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:53.150370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:53.151375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:53.155496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:53.156773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:53.158362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:53.159830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:53.160275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:53.161214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:53.162733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:53.163902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:53.538395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:53.551082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c559480-9f88-473c-a28f-c37eb47acdb6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.420431 Oct 10 10:46:53.555051 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1083/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:53 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:53.617923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:53.630276 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74e6a652-f62f-4034-bfda-1b09e9b97f4b tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.514740 Oct 10 10:46:53.631813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1019/2102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:53 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:54.044660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.045488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.060593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.061316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.061748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.062468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.062929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.063445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.131867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0f3c87c-4f7a-4fd5-ad89-e0ba569b9f4a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677cd93430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.215636 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0f3c87c-4f7a-4fd5-ad89-e0ba569b9f4a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.089129 Oct 10 10:46:54.217463 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1020/2103] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:54.223943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.225049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.232629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.233329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.233933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.234792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.235470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.236098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.241571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:54.321619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:54.543054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:54.562989 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd7b7288-2121-4e9d-8bdb-eaeb588e5e16 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1469 microversion: 2.1 time: 0.522538 Oct 10 10:46:54.584686 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1084/2104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:54.604807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.605854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.621625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.622878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.625219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.627666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.628943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.631167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.631895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:54.646829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:54.660117 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c49ca93a-1d08-4a22-a2b7-e0ff84e24b27 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.441232 Oct 10 10:46:54.660957 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1021/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:54.678008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:54.679442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.690523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.692169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.693585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.694477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.697148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.700451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.914509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:54.928795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c4ac9fc-f2ce-4f71-a018-ae059b1f4b54 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.334598 Oct 10 10:46:54.928994 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d69fc78a-e943-4679-a590-aa6a845c5e65 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "POST /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0/action" status: 202 len: 0 microversion: 2.1 time: 0.266287 Oct 10 10:46:54.939152 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1022/2106] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:46:54 2022] POST /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:46:54.939432 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1085/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:54.939509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.939509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.955425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.959802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.960265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.961005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.962236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:54.964664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.964790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:54.970558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.975161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.976773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.977487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:54.978582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:54.978982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:54.979576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:55.280518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:55.292468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42b95af5-24f8-4c6d-ba01-88cca3df45c2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.339696 Oct 10 10:46:55.293053 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1086/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:55.308151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:55.314907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2f56ce-cfac-41f5-86aa-012676126ee6", "name": "network-vif-plugged", "status": "completed", "tag": "e22d5298-0dd6-495c-8e03-6eb3de73cec7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:55.323300 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40226bc8-a795-468e-b6e7-c7cde6e7486a tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.391775 Oct 10 10:46:55.324701 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1023/2109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:54 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:55.326845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:55.327350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:55.327851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:55.332415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00db302d-dad4-4b71-b85d-b4dc74c3d2a4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca91160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:55.341305 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] Creating event network-vif-plugged:e22d5298-0dd6-495c-8e03-6eb3de73cec7 for instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 on n-h2-860687-2 Oct 10 10:46:55.347221 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f49c07dc-2767-4213-b73e-c99a1f730786 req-c1df13f3-13ff-4fa5-9bd2-d1b2954c3134 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Oct 10 10:46:55.348177 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1087/2110] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:55.437857 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00db302d-dad4-4b71-b85d-b4dc74c3d2a4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.111406 Oct 10 10:46:55.439850 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1024/2111] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:55 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:55.693537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:55.695073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:55.739147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:55.742932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:55.747091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:55.747812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:55.753474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:55.763426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:55.764271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:55.964086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:55.964734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:55.981068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:55.981875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:55.982318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:55.983301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:55.984038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:55.985003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:56.407865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:56.416275 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3e8bc62-45b7-42a8-b78b-df230a95b04a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.456372 Oct 10 10:46:56.425668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:56.431848 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1025/2112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:55 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:56.437524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:56.438688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:56.445907 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bf5fe83-4dcb-4681-b089-0220a7e1fc25 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.759511 Oct 10 10:46:56.448548 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1088/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:55 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:56.453366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:56.454266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:56.458473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:56.460683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:56.462930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:56.472012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:56.474674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:56.475458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:56.476068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:56.479496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:56.480138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:56.481030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:56.481490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:56.481920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:56.794638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:56.803883 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80ea9167-e50e-4623-a386-24df4d9aba1d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.370239 Oct 10 10:46:56.805828 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1026/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:56 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:56.818894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c941465d-5742-4ab0-b892-9395e0dc8ab9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3c5790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:56.892737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:56.903597 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c941465d-5742-4ab0-b892-9395e0dc8ab9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.096699 Oct 10 10:46:56.906045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1027/2115] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:56 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:56.920248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81c9654b-024c-446e-bfec-51c835d54dab tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1314 microversion: 2.1 time: 0.470448 Oct 10 10:46:56.943027 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1089/2116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:56 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:57.364737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-plugged", "status": "completed", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:46:57.383192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.383681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.385926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.399323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Creating event network-vif-plugged:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h2-860687-2 Oct 10 10:46:57.404900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:46:57.455718 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-be334630-6d5b-4ddd-a76d-cb7e3e69adb4 req-0cf4b408-510e-480a-81b4-0c5751189195 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094922 Oct 10 10:46:57.456659 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1028/2117] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:57.475323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:57.476440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:57.483511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.483902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:57.484405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.485000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.486105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:57.486600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.487218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.487911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.494016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.494668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.495374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.496779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.497482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.498780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.775865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:57.793799 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-905e371a-4460-4542-ae01-819ed507f01a tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.320652 Oct 10 10:46:57.795701 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1029/2118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:57 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:57.799737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:57.818948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a101f2a-2184-48ce-8ee0-c2ae4f473cdd tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.348793 Oct 10 10:46:57.820587 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1090/2119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:57 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:57.839392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:57.840352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:57.853855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.854374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.854871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.855611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:57.856063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:57.856524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:57.923379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e071771-0bb2-4a78-99cb-d555e35d5f9c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a98a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.023175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e071771-0bb2-4a78-99cb-d555e35d5f9c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.104928 Oct 10 10:46:58.031871 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1091/2120] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:57 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:58.031871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.031871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:58.039610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.040326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.041910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.043166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.043920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.044544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.118940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:58.134154 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-468f79b7-e28d-4d1e-8167-9cb0cc24d7a1 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.304916 Oct 10 10:46:58.152936 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1030/2121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:57 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:58.235300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:58.251610 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4192f3bf-5025-4e8f-b715-3a15bfa6a446 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1464 microversion: 2.1 time: 0.223150 Oct 10 10:46:58.255605 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1092/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:58 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:58.683720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Calling method '.version_select at 0x7f677c8b2af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.712787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.713078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.713684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.733102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.733762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.734251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.756084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0107976-d45a-4474-8aa3-fa1a8a6a3c58 tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f013a34213e445ea857f8fb0175d1282?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066" status: 200 len: 647 microversion: 2.1 time: 0.479326 Oct 10 10:46:58.766256 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1031/2123] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Oct 10 10:46:58 2022] GET /compute/v2.1/os-simple-tenant-usage/f013a34213e445ea857f8fb0175d1282?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066 => generated 647 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:46:58.773865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '.version_select at 0x7f677c856c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.794369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.794957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.795691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.821060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.821868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:58.825472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.827699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.829652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.830335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.834035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.834490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.835462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.835927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.836415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.871795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-836968da-f3b9-494c-b1cb-b19ee1f7c742 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/f013a34213e445ea857f8fb0175d1282?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066" status: 200 len: 695 microversion: 2.1 time: 0.102336 Oct 10 10:46:58.877026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1093/2124] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Oct 10 10:46:58 2022] GET /compute/v2.1/os-simple-tenant-usage/f013a34213e445ea857f8fb0175d1282?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066 => generated 695 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:46:58.913235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:58.917801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:58.936444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.937105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.940188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:58.941446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:58.942698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:58.944425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.140771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:59.150493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0ac2549-e91b-4b72-84ae-df837904b947 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.333669 Oct 10 10:46:59.157038 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1032/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:58 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:59.169702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Calling method '.version_select at 0x7f677c7c74c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:59.193819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.194736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.197115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.208114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:59.212204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:59.218400 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72938109-f982-401b-b099-31d101e2c6f4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.339854 Oct 10 10:46:59.225084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.225973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.226616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.239266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1094/2126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:58 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:59.244826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38ef4900-ff7a-4487-8828-c16d200fada0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777b4e9d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:59.324983 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38ef4900-ff7a-4487-8828-c16d200fada0 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.083856 Oct 10 10:46:59.325548 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1095/2127] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:46:59 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:59.332131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:59.333062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:59.350203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e759272-b524-48f7-94df-7c357c9a444a tempest-TenantUsagesTestJSON-1518211881 tempest-TenantUsagesTestJSON-1518211881-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066&detailed=1" status: 200 len: 27484 microversion: 2.1 time: 0.191308 Oct 10 10:46:59.351673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1033/2128] 10.222.0.16 () {58 vars in 1335 bytes} [Mon Oct 10 10:46:59 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T10%3A46%3A58.272066&end=2022-10-11T10%3A46%3A58.272066&detailed=1 => generated 27484 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:46:59.352283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.353275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.355318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.358329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.360192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.361029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.393066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:59.393746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:59.409258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.409757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.410220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.410903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.412426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.413539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.459585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:46:59.538502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:46:59.591395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:59.599665 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90577905-75e0-42b7-9204-37644866fd98 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.272916 Oct 10 10:46:59.611317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1096/2129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:59 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:46:59.621779 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-291bb61b-cb45-408c-8692-badf726f4fbf tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 204 len: 0 microversion: 2.1 time: 0.229402 Oct 10 10:46:59.626919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1034/2130] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:46:59 2022] DELETE /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:46:59.632819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:46:59.633459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:46:59.649316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.650019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.650465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.651380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:46:59.651844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:46:59.652476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:46:59.888635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:46:59.899177 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-863c92cd-5b1c-4f2f-839f-6f7cd6143566 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1470 microversion: 2.1 time: 0.270430 Oct 10 10:46:59.900456 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1097/2131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:46:59 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:00.183142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:00.184421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:00.197585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.198358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.200141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.201248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.201983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.202488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.247204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:00.249140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:00.260406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.263432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.264097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.265070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.265588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.267590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.651693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:00.668393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-190a6c11-ffbf-41db-b251-548ba68e8cef tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.423023 Oct 10 10:47:00.679118 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1098/2132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:00 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:00.686114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3095af5-7671-42f1-94ee-5cef5f6099bc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a13dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:00.746866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3095af5-7671-42f1-94ee-5cef5f6099bc tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.073838 Oct 10 10:47:00.747772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1099/2133] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:00 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:00.754307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "name": "network-vif-plugged", "status": "completed", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:00.754992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:00.765335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.766302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.766941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.769494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-918ba632-55c5-46d6-9797-82a76364981c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.589716 Oct 10 10:47:00.770096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1035/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:00 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:00.781562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] Creating event network-vif-plugged:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:47:00.786365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:00.790976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:00.807865 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6b77c642-26f0-4e73-a47b-2b3ac1ce4544 req-2fe77f34-dc62-4507-8afc-ee97129bdbd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058143 Oct 10 10:47:00.808714 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1100/2135] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:00.815550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.816906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.817518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.818430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.819085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.819732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.927646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:00.932208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:00.941568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.942719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.943373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:00.944335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:00.944975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:00.945598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:01.297537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:01.311918 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adb88905-3075-48fc-af13-f69131de974d tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.537553 Oct 10 10:47:01.315057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1036/2136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:00 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:01.326704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-unplugged", "status": "completed", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:01.363809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:01.366303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:01.367824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:01.395419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:01.409508 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Creating event network-vif-unplugged:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:47:01.410589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93f71347-0a09-4b17-882d-69d95cfe4c43 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1470 microversion: 2.1 time: 0.488552 Oct 10 10:47:01.417880 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1101/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:00 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1470 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:47:01.424615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:47:01.455348 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-23939d0c-d753-455b-b18c-7cf52f86073d req-2ca1621c-e04f-4fb5-b260-9edaed34b96d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135401 Oct 10 10:47:01.457554 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1037/2138] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:01.701531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:01.702159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:01.722364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:01.722873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:01.723341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:01.724094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:01.724516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:01.740485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:01.764964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d6fcc87-1691-4d25-81dd-5c92c108a0e9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca29dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:01.839407 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d6fcc87-1691-4d25-81dd-5c92c108a0e9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.078907 Oct 10 10:47:01.850124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1038/2139] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:01 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:01.856509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:01.857718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:01.866965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:01.867753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:01.868424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:01.869462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:01.881718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:01.884062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.362938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:02.399229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b2bf39e-9ae4-49a7-903f-2760d865357a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1324 microversion: 2.1 time: 0.702251 Oct 10 10:47:02.408342 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1102/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:01 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:02.437601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2f56ce-cfac-41f5-86aa-012676126ee6", "name": "network-vif-deleted", "tag": "e22d5298-0dd6-495c-8e03-6eb3de73cec7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:02.445695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:02.457640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-598b5fab-6637-4e90-9f3c-178f4f078787 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.605925 Oct 10 10:47:02.459374 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1039/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:01 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:02.466087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:02.467989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:02.469099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.470291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.471098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.488039 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] Creating event network-vif-deleted:e22d5298-0dd6-495c-8e03-6eb3de73cec7 for instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 on n-h2-860687-2 Oct 10 10:47:02.490902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.491432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.491869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.492687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.493016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.493442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.499094 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-26688bb3-8de1-4936-b47b-706d8adc9559 req-662b31ef-85da-400f-9726-eb2807fffe1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086565 Oct 10 10:47:02.500195 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1103/2142] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:02.510399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:02.511294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:02.520773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.521560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.522109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.523142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.523710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.524715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.566879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:02.567491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:02.568194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:02.568908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lazy-loading 'fault' on Instance uuid 9f2f56ce-cfac-41f5-86aa-012676126ee6 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:47:02.716519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafca388d68d4c9fb829c0fbf05e2c3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f013a34213e445ea857f8fb0175d1282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:02.733806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c5ce9605-c689-4587-80ac-935b9d1a6658 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 200 len: 1304 microversion: 2.1 time: 0.231439 Oct 10 10:47:02.749732 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1104/2143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:02 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:02.830583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:02.842828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d9b29a3-a76d-48a7-aff3-d261f61a5f21 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.382318 Oct 10 10:47:02.843934 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1040/2144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:02 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:02.860741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b458416-490d-4a01-9256-4e3106e4f187 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777b4ea60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:02.943719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b458416-490d-4a01-9256-4e3106e4f187 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1413 microversion: 2.1 time: 0.088030 Oct 10 10:47:02.944645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1105/2145] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:02 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:03.433258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:03.434166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:03.442533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.443280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.443786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.444802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.445336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.445835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.486045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:03.496951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.497398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.497768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.510049 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Creating event network-changed:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:47:03.516176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 10:47:03.542036 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1767b34a-f1f2-46cd-9db0-684d82b5a617 req-10024a99-47b1-4f31-acc4-c9d4c706e159 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061656 Oct 10 10:47:03.550082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1106/2146] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:03.556955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:03.558045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:03.565377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.565875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.566324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.567256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.567863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.568507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.667753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:03.678661 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c5bda60-d36c-466c-b0f8-4f593ac27261 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1520 microversion: 2.1 time: 0.249311 Oct 10 10:47:03.679826 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1041/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:03 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:03.702406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09c3966d-291d-4555-aa8c-4e9997e6f74a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'create', calling method: .version_select at 0x7f677c81edc0>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:03.834300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:03.842729 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ae1884da-9c44-419e-a63d-7009a85b4ab2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.291357 Oct 10 10:47:03.859413 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1107/2148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:03 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:03.865655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:03.866408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] [instance: 9f2f56ce-cfac-41f5-86aa-012676126ee6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:03.873527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.874344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.874794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.875534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.876212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.876827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.918568 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] HTTP exception thrown: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Request method failure captured: Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 HTTP/1.1 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_gNTn_wX_AAdYmOgVr2VjNX-zszkjZv5fDwHpyUT0GAfBGzryzSWodBRN19AdhN9XK73rblpzSB_5ZHXXiNmuAoVHj-sxdb72711xW5xkD0TM52_BxSfwZFlJJEzzEhYCJrKe5u8sck-GfXjfjlvqtTd7HD9ck4VO19OFGFs9H3ZIc Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f013a34213e445ea857f8fb0175d1282 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TenantUsagesTestJSON-1122322363 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f013a34213e445ea857f8fb0175d1282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f013a34213e445ea857f8fb0175d1282", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f013a34213e445ea857f8fb0175d1282"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f013a34213e445ea857f8fb0175d1282"}]}] Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TenantUsagesTestJSON-1122322363 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f013a34213e445ea857f8fb0175d1282 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1122322363 Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TenantUsagesTestJSON-1122322363-project Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: dafca388d68d4c9fb829c0fbf05e2c3b Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TenantUsagesTestJSON-1122322363-project Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '9f2f56ce-cfac-41f5-86aa-012676126ee6'} Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:03.920444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] Returning 404 to user: Instance 9f2f56ce-cfac-41f5-86aa-012676126ee6 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:03.924998 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d256ed1-127a-4a73-9b00-62c659525192 tempest-TenantUsagesTestJSON-1122322363 tempest-TenantUsagesTestJSON-1122322363-project] 10.222.0.16 "GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6" status: 404 len: 111 microversion: 2.1 time: 0.061317 Oct 10 10:47:03.926000 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1108/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:03 2022] GET /compute/v2.1/servers/9f2f56ce-cfac-41f5-86aa-012676126ee6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:03.930827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:03.931636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:03.939540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.940034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.940782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:03.941790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:03.942784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:03.943969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:04.190815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:04.201406 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-311528d5-5c42-4f7e-a96b-236f70ef1e2f tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1468 microversion: 2.1 time: 0.274318 Oct 10 10:47:04.204020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1109/2150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:03 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:04.228276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a424e1f6-b331-493d-b39a-01e13319cfd9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a0c9d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:04.293117 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a424e1f6-b331-493d-b39a-01e13319cfd9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1422 microversion: 2.1 time: 0.070621 Oct 10 10:47:04.293694 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1110/2151] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:04 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:04.318178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-beb63aee-c404-4471-8f4d-4dfcdffef672 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a1dc10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:04.408770 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-beb63aee-c404-4471-8f4d-4dfcdffef672 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 200 len: 1422 microversion: 2.1 time: 0.102958 Oct 10 10:47:04.420018 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1111/2152] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:04 2022] GET /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:04.429174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42f49894-4ad2-443f-b338-b908b73d190b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777a0c310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:05.573194 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09c3966d-291d-4555-aa8c-4e9997e6f74a tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.875003 Oct 10 10:47:05.573917 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1042/2153] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:47:03 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:47:05.579853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:05.580698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:05.594314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:05.596536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:05.596996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:05.600122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:05.602142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:05.602917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:05.690978 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42f49894-4ad2-443f-b338-b908b73d190b tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 204 len: 0 microversion: 2.1 time: 1.269515 Oct 10 10:47:05.691664 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1112/2154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:04 2022] DELETE /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 0 bytes in 1271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:05.698668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:05.699308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:05.712051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:05.715475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:05.716265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:05.718685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:05.719386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:05.720570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.294448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:06.306106 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-603f49c4-84d8-43f8-a2c3-dfb6e4233133 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.730398 Oct 10 10:47:06.309558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:06.323789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f9975d7-bdf4-49d1-af0d-828c5d24f597 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1461 microversion: 2.1 time: 0.630296 Oct 10 10:47:06.324863 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1113/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:05 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1461 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:06.333344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:06.334536 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1043/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:05 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:06.335093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:06.340933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1760026217", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "af11dad6-136c-41f7-a9f8-2643d1a66737"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:06.342525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.342919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.343396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.345363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.345817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.346736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.385559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:06.444111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] validate_networks() for [('af11dad6-136c-41f7-a9f8-2643d1a66737', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:47:06.495965 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-778bce80-a94b-4eed-af74-53423e803d3a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 204 len: 0 microversion: 2.1 time: 0.167631 Oct 10 10:47:06.504368 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1114/2157] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:06 2022] DELETE /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:06.853286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:06.855161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:06.863459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.864298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.864947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.865978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.866771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.867775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.974046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:47:06.974670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:47:06.975435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:47:06.976057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:47:06.977418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:47:06.995862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.996774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.997236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:06.998530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:06.999023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:06.999452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.041245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Getting quotas for project 0da0f484c5744a188efaad483207af32. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:47:07.054024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Getting quotas for user e00702cc57c94cb0826c151c05dcf649 and project 0da0f484c5744a188efaad483207af32. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:47:07.056671 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bda3f5a6-c45d-4505-8dbc-54f6cd1911ed tempest-MigrationsAdminTest-429406492 tempest-MigrationsAdminTest-429406492-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1612 microversion: 2.1 time: 0.558457 Oct 10 10:47:07.060735 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1115/2158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:06 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1612 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:07.068152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:47:07.070654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:47:07.072064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1364626049", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8adcea62-172b-4b2d-a9dc-5bc930072e9a"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:07.129937 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fbd2090-21f2-4689-8774-1f0c8eecdfc2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792693 Oct 10 10:47:07.130956 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1044/2159] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:47:07.136082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:07.136806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:07.145446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.146208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.146800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.147867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.148482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.149386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.182884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:07.210436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] validate_networks() for [('8adcea62-172b-4b2d-a9dc-5bc930072e9a', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:47:07.366032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e8cae48-8813-4805-b543-471568e06254 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 204 len: 0 microversion: 2.1 time: 0.220472 Oct 10 10:47:07.366803 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1045/2160] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:07 2022] DELETE /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:07.373431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dcf077a-d9f1-4b2b-830e-801513e770b0 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:07.385119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dcf077a-d9f1-4b2b-830e-801513e770b0 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:07.497560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dcf077a-d9f1-4b2b-830e-801513e770b0 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:07.508878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dcf077a-d9f1-4b2b-830e-801513e770b0 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1224 microversion: 2.1 time: 0.140498 Oct 10 10:47:07.510123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1046/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:07 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:07.515454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-plugged", "status": "completed", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:07.536241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.540376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.541323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.558408 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] Creating event network-vif-plugged:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:47:07.567633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5eb660b3-a43f-4de9-a8b2-a8b5c748adc8 req-88f0dacc-1bee-40f2-98fe-1bf7dbce6243 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055582 Oct 10 10:47:07.568433 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1047/2162] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:07.575008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:07.576674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:07.589485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.591159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.592097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.593007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.596572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.597689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.932675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:07.942888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3458fdfb-2256-4745-846b-cb9c09e15525 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.372358 Oct 10 10:47:07.943810 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1048/2163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:07 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:07.950663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:07.951929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:07.959160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.959896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.960478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.961627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:07.962087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:07.962510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:07.991120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:47:07.991701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:47:07.992716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:47:07.994061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:47:07.994648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:47:08.008962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.009733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.010662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:08.011611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.012645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.013333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:08.037826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:47:08.044280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for user 53f07854e54a44689b1067dbcd0ec464 and project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:47:08.064604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:47:08.067097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:47:08.126562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d02eb2e-0da7-43f8-ab5e-25c3b434b3a6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063481 Oct 10 10:47:08.127561 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1116/2164] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:47:08.142219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f59e98e-06af-4ddc-b8e8-74f877e705eb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:08.143145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f59e98e-06af-4ddc-b8e8-74f877e705eb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:08.199603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:08.216570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41c8c6f1-f9df-417a-ad20-f2b10f3bf7ca tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1467 microversion: 2.1 time: 0.269903 Oct 10 10:47:08.236723 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1049/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:07 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1467 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:08.272702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f59e98e-06af-4ddc-b8e8-74f877e705eb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:08.280784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f59e98e-06af-4ddc-b8e8-74f877e705eb tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1208 microversion: 2.1 time: 0.145347 Oct 10 10:47:08.281505 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1117/2166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:08 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:08.543544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:08.544517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:08.557034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.557931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.558610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:08.559603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.560158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.560592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:08.716512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:08.730102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb7e8c8b-332e-447b-9bc7-5e250a2c1b57 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1276 microversion: 2.1 time: 0.195796 Oct 10 10:47:08.732272 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1050/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:08 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:08.966323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:08.967123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:08.982197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.983603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.984604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:08.987603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:08.988647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:08.990803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.251867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:09.255138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:09.271129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.271865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.272540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.275388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.277304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.278636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.609524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:09.618956 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f33c6b9-235f-4d5d-ae09-a02ab950d167 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.656783 Oct 10 10:47:09.624214 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1118/2168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:08 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:09.633864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:09.637449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:09.641920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:09.653871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5740dc3a-1669-4311-afe0-4dee83b91213 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1467 microversion: 2.1 time: 0.413742 Oct 10 10:47:09.654471 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1051/2169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:09 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:09.666848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.667532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.668093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823962d3-3b20-49d9-aa15-d65509912a74", "name": "network-vif-unplugged", "status": "completed", "tag": "d18f3d40-6b15-4336-91ea-66ed9f2cae50"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:09.669532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.670882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.673208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.673867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.694342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.694886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.695370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.729469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:09.730190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] Creating event network-vif-unplugged:d18f3d40-6b15-4336-91ea-66ed9f2cae50 for instance 823962d3-3b20-49d9-aa15-d65509912a74 on n-h1-860687-2 Oct 10 10:47:09.740659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5e7dfed0-de75-497e-8e0f-943e4f58c23f req-c0aa06a3-81a3-447a-b9bd-4628d7f5f34e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083622 Oct 10 10:47:09.741238 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1052/2170] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:09.755104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:09.773046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:09.773046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Searching by: {'deleted': False, 'project_id': '842cf83a29be46cca41020e234da2339'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:47:09.787680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.788181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.799371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.800291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.800820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.801264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.844545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:47:09.926967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b92222ea-65eb-4394-b624-885db14d8a8a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.184487 Oct 10 10:47:09.927602 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1053/2171] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:47:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:09.943878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:09.945215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:09.953423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.957961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.957961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.957961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:09.957961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:09.959151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:09.980217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:09.993761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:09.995321 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0a95ce6-fa85-42a6-9e4a-5b8d05cefa96 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1204 microversion: 2.1 time: 0.368398 Oct 10 10:47:09.997589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1119/2172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:09 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1204 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:10.013413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:10.038279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:10.039599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Searching by: {'deleted': False, 'project_id': '842cf83a29be46cca41020e234da2339'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:47:10.046124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:10.046822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:10.047630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:10.049567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:10.050260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:10.050859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:10.088274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:47:10.192218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:10.201235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:10.202223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:10.202817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:10.846730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:10.869219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94194c3e-7a1d-4f81-9905-8865002e25b2 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1324 microversion: 2.1 time: 0.934726 Oct 10 10:47:10.883491 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1054/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:09 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1324 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:10.895809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:10.899163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:10.903798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:10.921175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:10.922230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:10.924006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:10.926386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:10.927261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:10.927950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.076680 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c9fa14a-31db-4d22-95ab-3107b43eaea2 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 1.076080 Oct 10 10:47:11.093604 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1120/2174] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:47:09 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:11.105848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:11.106485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:11.120745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.121347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.121887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.122817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.123346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.124005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.740554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:11.750484 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef6f7602-a836-419a-b36b-7b1bff1b187f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1524 microversion: 2.1 time: 0.871436 Oct 10 10:47:11.755918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1055/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:10 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1524 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:11.776069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:11.777163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:11.789954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.790956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:11.791279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.792026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.793878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.796637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.798431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.808113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75792a64-aa8d-46e1-9a2f-ab09407f1df4 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1467 microversion: 2.1 time: 0.713215 Oct 10 10:47:11.808774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1121/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:11 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1467 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:11.825144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be626b65-e071-4ca5-aca5-33edb182cea7 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:11.846080 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be626b65-e071-4ca5-aca5-33edb182cea7 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028755 Oct 10 10:47:11.853120 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1122/2177] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:47:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:11.866455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4921af3e-8243-45e9-8e6c-b1c8e01a247c", "tag": "7d68ce5b-fa98-461c-a6d9-61c2362d019a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:11.889951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.892517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.893956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.921795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] Creating event network-changed:7d68ce5b-fa98-461c-a6d9-61c2362d019a for instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c on n-h2-860687-2 Oct 10 10:47:11.938012 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-99013776-60e3-4cc5-bd48-4ff16c99a27b req-573563a8-284a-4ac3-aabb-6f48ffae2685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082321 Oct 10 10:47:11.939540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1123/2178] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:11.944846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:11.945773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:11.954922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.955685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.958729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:11.959754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:11.960735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:11.961346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.078819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:12.087985 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5a24608-99df-4825-9f78-9a339312b978 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1266 microversion: 2.1 time: 0.330685 Oct 10 10:47:12.096204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1056/2179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:11 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:12.233685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:12.234193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:12.241073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.242270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.243198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.244264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.244793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.245544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.296512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:12.424357 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac5baea4-7613-4643-a138-4235b07439a4 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 204 len: 0 microversion: 2.1 time: 0.192968 Oct 10 10:47:12.425295 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1057/2180] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:12 2022] DELETE /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:47:12.435119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:12.436196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:12.446014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.446608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.447325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.448255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.448946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.449597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.942122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:12.957235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d16e8ca4-1d05-4733-96aa-547c67f02ff4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1324 microversion: 2.1 time: 1.010238 Oct 10 10:47:12.958290 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1124/2181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:11 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:12.973109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:12.973731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:12.982309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.983031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.983815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:12.984702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:12.986219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:12.986818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.210361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:13.222328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5eafe308-8780-4ad7-bcff-47315acde7b3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1606 microversion: 2.1 time: 0.791434 Oct 10 10:47:13.241497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1058/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:12 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1606 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:13.251471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:13.252479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:13.259394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:13.260088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:13.268794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.275429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:13.276335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:13.277456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.530693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:13.542242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95d2b585-f0b6-4493-9582-e1082d67bafa tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1297 microversion: 2.1 time: 0.297968 Oct 10 10:47:13.543407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1059/2183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:13 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1297 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:13.556688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823962d3-3b20-49d9-aa15-d65509912a74", "name": "network-vif-deleted", "tag": "d18f3d40-6b15-4336-91ea-66ed9f2cae50"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:13.587085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:13.587780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:13.588764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.605769 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] Creating event network-vif-deleted:d18f3d40-6b15-4336-91ea-66ed9f2cae50 for instance 823962d3-3b20-49d9-aa15-d65509912a74 on n-h1-860687-2 Oct 10 10:47:13.615456 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-68411516-6d9b-48e7-9344-633863ae159a req-6a0c3267-3692-4832-b397-b295323a1ef2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067516 Oct 10 10:47:13.615456 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1060/2184] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:13.621996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:13.623043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:13.631497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:13.632208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:13.632827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.633766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:13.634961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:13.635624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:13.666819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:13.687169 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-adab4177-1b47-402f-8510-30665749a2a2 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1504 microversion: 2.1 time: 0.727581 Oct 10 10:47:13.687944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1125/2185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:12 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:13.717508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f59d2cb5-6f17-444d-8ca9-7c226636634f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'create', calling method: .version_select at 0x7f6777a3cca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-955732501", "description": "tempest-description-255551402"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:14.008629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:14.022703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdb72a17-2ee6-4305-8762-e32de82d3cfd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1308 microversion: 2.1 time: 0.404907 Oct 10 10:47:14.035059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1061/2186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:13 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:14.035059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:14.035059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:14.039203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.039904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.040379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.041515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.042184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.045701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.217570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f59d2cb5-6f17-444d-8ca9-7c226636634f tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.506333 Oct 10 10:47:14.222625 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1126/2187] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:47:13 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:47:14.238112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-955732501"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:14.239143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:14.250306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.250987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.251770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.252490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.252984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.253386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.416025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:14.430579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4a13904-d205-4f85-8f21-6f5456ae730b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1324 microversion: 2.1 time: 0.405515 Oct 10 10:47:14.433454 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1062/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:14 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:14.467665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:14.474158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:14.482168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.482658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.483136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.483837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.484287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.484702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.545823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Adding security group cd40fc7b-90dc-4289-935e-714b0708968b to port b1218557-8e4d-443b-9b43-de2474ef444c Oct 10 10:47:14.881175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:14.891933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51d4d96c-2198-411f-bbe8-1f161beb55f9 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1606 microversion: 2.1 time: 0.438119 Oct 10 10:47:14.892559 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1063/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:14 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1606 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:14.908409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af2c38ec-9055-4748-bca2-2d4208c28b12", "tag": "e856159c-211a-4d88-9285-8f43b6fa83ee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:14.924006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.932819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.933753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.949841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] Creating event network-changed:e856159c-211a-4d88-9285-8f43b6fa83ee for instance af2c38ec-9055-4748-bca2-2d4208c28b12 on n-h1-860687-2 Oct 10 10:47:14.956758 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3ce1dfa3-4401-4c58-928d-1b25a52a227f req-7646b7e8-f1b9-4b36-9182-66b14e42f980 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063017 Oct 10 10:47:14.958531 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1064/2190] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:14.965670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:14.966659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:14.973757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.974556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.975448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:14.976385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:14.977392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:14.977835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.020498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:15.021005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:15.021497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.022137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lazy-loading 'fault' on Instance uuid fa5887d4-d6e1-463d-b7ec-9318c96d32f0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:47:15.209041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:15.221172 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd224c89-a5c7-4714-a753-81b5a36aa340 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 200 len: 1302 microversion: 2.1 time: 0.261168 Oct 10 10:47:15.221920 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1065/2191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:14 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 1302 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:15.234556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:15.235883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:15.256228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:15.257041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:15.258153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.259307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:15.259961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:15.260575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.809648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:15.839731 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d0bddfd-fba5-424b-b9c8-a96b89416d2f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1308 microversion: 2.1 time: 0.615052 Oct 10 10:47:15.857058 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1066/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:15 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:15.885507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:15.888040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:15.901013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:15.901632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:15.903337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.904291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:15.906518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:15.911261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:15.975171 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9da1afe3-bc80-42a8-8ee3-0d7ec97014d4 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action" status: 202 len: 0 microversion: 2.1 time: 1.743305 Oct 10 10:47:15.975796 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1127/2193] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:14 2022] POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action => generated 0 bytes in 1745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:15.981964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5887d4-d6e1-463d-b7ec-9318c96d32f0", "name": "network-vif-deleted", "tag": "fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:16.013875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:16.014274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:16.014752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:16.026802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] Creating event network-vif-deleted:fcfa57b1-1c71-46cf-ad5a-32cc35cb04dc for instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 on n-h1-860687-2 Oct 10 10:47:16.040684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-799559a4-d409-44af-8c55-322151f74c5a req-07dcd6da-b7cb-4d25-8080-889817e2c2fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063653 Oct 10 10:47:16.048777 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1128/2194] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:16.058789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:16.059820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:16.073091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:16.073963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:16.075471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:16.076520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:16.077138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:16.077723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.014154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:17.022750 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16923594-e1eb-433c-8338-79870f76d69b tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1324 microversion: 2.1 time: 1.159135 Oct 10 10:47:17.026553 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1067/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:15 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1324 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:17.042520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-955732501"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:17.044417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:17.074052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.074987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.076268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.077249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.078081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.079279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.114390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:17.128251 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f94cc9a1-65ee-46ed-98c1-595428e851ad tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1606 microversion: 2.1 time: 1.078540 Oct 10 10:47:17.133192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1129/2196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:16 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1606 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:17.142450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:17.143437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: fa5887d4-d6e1-463d-b7ec-9318c96d32f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:17.151148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.151878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.152554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.153493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.154162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.154749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.171917 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] HTTP exception thrown: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Request method failure captured: Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 HTTP/1.1 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_bdSNRMRLUE7yDK1PPqkgBO0L4rDLEHULw0w2ndxpMdv4TZ0jxjOaljw4WsTAMGtm9g1Z6kfvir8YsWNIBHBEOGzwarnFR2K8rO2CYMQcjAXgogA1iYHmoZ-MywSPRSwyjfguoDdy_GZQ5ch_Sue7zX_-j2-11JHPMst8SrXT3VMc8 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f72eed82348240eaba9c14006269bafe", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f72eed82348240eaba9c14006269bafe"}]}] Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6bd4da9b853c4eb08ca095c726a3e397 Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'fa5887d4-d6e1-463d-b7ec-9318c96d32f0'} Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:17.174741 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. Oct 10 10:47:17.178304 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:17.191609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Returning 404 to user: Instance fa5887d4-d6e1-463d-b7ec-9318c96d32f0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:17.193933 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e9aad43-d988-407e-8eec-460a0f0b1501 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0" status: 404 len: 111 microversion: 2.1 time: 0.058080 Oct 10 10:47:17.193933 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1130/2197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:17 2022] GET /compute/v2.1/servers/fa5887d4-d6e1-463d-b7ec-9318c96d32f0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:17.209809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:17.211285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:17.227443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.227958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.228558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.229611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.230407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.231045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.414108 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Removing security group cd40fc7b-90dc-4289-935e-714b0708968b from port b1218557-8e4d-443b-9b43-de2474ef444c Oct 10 10:47:17.508599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:17.823097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:17.842023 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8f609de-c8a5-42ae-97a4-1cf935846a3c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1308 microversion: 2.1 time: 0.644660 Oct 10 10:47:17.842574 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1131/2198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:17 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:17.861655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:17.862056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:17.868269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.868767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.869214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.869929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:17.870393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:17.870828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:17.922113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:18.067406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:18.092572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-68df75ac-7f1a-48e1-ae86-f50299c954d2 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 204 len: 0 microversion: 2.1 time: 0.247652 Oct 10 10:47:18.093942 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1132/2199] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:17 2022] DELETE /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:18.101954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4921af3e-8243-45e9-8e6c-b1c8e01a247c", "name": "network-vif-plugged", "status": "completed", "tag": "7d68ce5b-fa98-461c-a6d9-61c2362d019a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:18.114541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.116392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.116997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:18.132417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] Creating event network-vif-plugged:7d68ce5b-fa98-461c-a6d9-61c2362d019a for instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c on n-h2-860687-2 Oct 10 10:47:18.138836 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-36a4624c-6a09-4795-a498-87a9376849f7 req-9026dd97-1fec-489c-a5f7-b934d6f14f3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041903 Oct 10 10:47:18.140031 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1133/2200] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:18.146390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:18.147153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:18.158591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.159105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.159544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:18.163752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.163752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.163752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:18.458548 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 10:47:18.458770 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 10:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c (ip 10.222.0.16) !!! Oct 10 10:47:18.796608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:18.813938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c0f1269-b244-4311-bc05-1df4d7484ab4 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1324 microversion: 2.1 time: 0.671536 Oct 10 10:47:18.832015 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1134/2201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:18 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:18.841562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:18.864954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.865437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.865865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:18.880105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] Creating event network-changed:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:47:18.887593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e8103530-fa9a-41d3-98ed-dd84488cf75c req-a5af6afb-1264-4e02-abfb-a6678ba180d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054053 Oct 10 10:47:18.888766 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1135/2202] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:18.895357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:18.897216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:18.904633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.914504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.915300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:18.916632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:18.917499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:18.918137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:19.584517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-218656a2-fa07-4469-95d7-7821844fd649 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action" status: 202 len: 0 microversion: 2.1 time: 2.555133 Oct 10 10:47:19.586626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1068/2203] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:17 2022] POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action => generated 0 bytes in 2558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:19.592764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:19.593738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:19.601758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:19.602522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:19.603182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:19.604202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:19.604904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:19.605525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:19.814554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:20.065573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:20.141940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:20.154315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c60d7d75-afcb-4242-bd61-d7e7d8384158 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1539 microversion: 2.1 time: 0.566260 Oct 10 10:47:20.157094 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1069/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:19 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1539 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:20.163305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:20.172182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:20.173639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:20.177866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8df83192-696d-4c48-858f-0f5946f9f408 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 200 len: 1533 microversion: 2.1 time: 1.287681 Oct 10 10:47:20.180392 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1136/2205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:18 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 1533 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:20.197464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:20.198133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:20.199033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:20.199959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:20.200659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:20.201286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:20.206091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79776cd9-adc8-4810-81f2-9a72e1af3f31 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'create', calling method: .version_select at 0x7f67779ded30>, body: {"pool": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:20.223630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:21.795514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:21.800076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:21.806975 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e3aea4e-39f9-42ce-9cc3-57e914d1babf tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1308 microversion: 2.1 time: 1.648115 Oct 10 10:47:21.812871 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1070/2206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:20 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1308 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:21.830012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:21.837096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:21.861842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:21.865244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:21.868654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:21.870138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:21.871941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:21.873466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.479089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:23.491841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbfb17e2-481f-443f-9c49-a3f02bf69914 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 200 len: 1520 microversion: 2.1 time: 1.673169 Oct 10 10:47:23.495684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1071/2207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:21 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 1520 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:23.506406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83dbabda-3c39-4421-9cde-644452122411", "name": "network-vif-deleted", "tag": "0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:23.537881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:23.538619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:23.539632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.567679 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] Creating event network-vif-deleted:0edc1bfd-d5a5-4dda-b2ca-2d21d2ebc0f8 for instance 83dbabda-3c39-4421-9cde-644452122411 on n-h2-860687-2 Oct 10 10:47:23.573833 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0075d05f-ff56-462d-9738-cac0df194805 req-af4de051-119a-4dd9-a354-ed612dfb2cf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076666 Oct 10 10:47:23.574608 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1072/2208] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:23.580493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:23.581206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:23.588226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:23.588734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:23.589316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.590034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:23.590741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:23.591974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.942801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:23.955344 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e16a69c-a66a-4e64-87f5-a00eda4fba7c tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1251 microversion: 2.1 time: 0.379134 Oct 10 10:47:23.955842 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1073/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:23 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1251 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:23.960632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:23.961309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 83dbabda-3c39-4421-9cde-644452122411] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:23.970830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:23.971386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:23.972459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.973220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:23.974780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:23.975495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:23.991686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] HTTP exception thrown: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Request method failure captured: Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 HTTP/1.1 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_bdSNRMRLUE7yDK1PPqkgBO0L4rDLEHULw0w2ndxpMdv4TZ0jxjOaljw4WsTAMGtm9g1Z6kfvir8YsWNIBHBEOGzwarnFR2K8rO2CYMQcjAXgogA1iYHmoZ-MywSPRSwyjfguoDdy_GZQ5ch_Sue7zX_-j2-11JHPMst8SrXT3VMc8 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f72eed82348240eaba9c14006269bafe", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f72eed82348240eaba9c14006269bafe"}]}] Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6bd4da9b853c4eb08ca095c726a3e397 Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '83dbabda-3c39-4421-9cde-644452122411'} Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:23.993363 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Returning 404 to user: Instance 83dbabda-3c39-4421-9cde-644452122411 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6858f8cd-8266-4adf-bf91-89196a65f219 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411" status: 404 len: 111 microversion: 2.1 time: 0.038003 Oct 10 10:47:23.999164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1074/2210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:23 2022] GET /compute/v2.1/servers/83dbabda-3c39-4421-9cde-644452122411 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:24.004200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}, {"server_uuid": "8ee74691-9b0a-41a7-b38a-1b6122e6471f", "name": "network-vif-deleted", "tag": "ab2705fa-277c-4a40-9ba2-ae565c330328"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:24.015838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.016626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.017149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.037983 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Creating event network-changed:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:47:24.038663 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] Creating event network-vif-deleted:ab2705fa-277c-4a40-9ba2-ae565c330328 for instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f on n-h2-860687-2 Oct 10 10:47:24.049280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0926c6ef-21cd-4fe9-83b1-6d67b2d2be9a req-a99e8dba-0a31-4b9c-83c5-cc83a279142b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052703 Oct 10 10:47:24.050306 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1075/2211] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:24.057841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2c38ec-9055-4748-bca2-2d4208c28b12", "name": "network-vif-plugged", "status": "completed", "tag": "e856159c-211a-4d88-9285-8f43b6fa83ee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:24.082081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.082987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.087617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.108109 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] Creating event network-vif-plugged:e856159c-211a-4d88-9285-8f43b6fa83ee for instance af2c38ec-9055-4748-bca2-2d4208c28b12 on n-h1-860687-2 Oct 10 10:47:24.122046 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c6723843-45f6-4f8e-9284-17f391090d4f req-93165642-8112-4759-9833-adb8d355726b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070040 Oct 10 10:47:24.122657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1076/2212] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:24.132566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:24.137121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:24.167621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.171581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.173188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.176540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.177433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.182047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.742514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:24.750312 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-356d4e6b-3bba-4e02-9679-e4deb5cf56be tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1308 microversion: 2.1 time: 0.625146 Oct 10 10:47:24.764058 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1077/2213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:24 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:24.768494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.93"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:24.781780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:24.794327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.795029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.795635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.796533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:24.797146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:24.798256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:24.846147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:24.846596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquired lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:25.675551 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79776cd9-adc8-4810-81f2-9a72e1af3f31 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.490831 Oct 10 10:47:25.676983 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1137/2214] 10.222.0.16 () {60 vars in 1170 bytes} [Mon Oct 10 10:47:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:25.684095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef37c0bf-ae0b-4882-a12c-96175ccae2d9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '.version_select at 0x7f6777a37700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:25.771717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef37c0bf-ae0b-4882-a12c-96175ccae2d9 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625067793" status: 202 len: 0 microversion: 2.1 time: 0.092807 Oct 10 10:47:25.772763 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1138/2215] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 10:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625067793 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:25.779376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:25.782289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:25.800410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:25.802734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:25.803242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:25.803980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:25.807032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:25.808896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:26.607305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9033c0d378a545c487d7e90558a3d89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842cf83a29be46cca41020e234da2339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:26.624148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7635e213-0864-4681-9b62-27b1d4de487a tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 200 len: 1251 microversion: 2.1 time: 0.850041 Oct 10 10:47:26.636576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1139/2216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:25 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 1251 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:26.650545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.82"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:26.666780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:26.686522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:26.691517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:26.692852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:26.695281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:26.702950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:26.705192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:26.754936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:26.755747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquired lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:30.119813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:31.972672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:32.848784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Updating instance_info_cache with network_info: [{"id": "62e4150d-8914-4c8c-aa9d-b80649862d3e", "address": "fa:16:3e:ec:3e:ba", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62e4150d-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:32.873307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Releasing lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:47:32.874652 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae2a5f99-1e6e-4f2c-833f-1c730483a08d tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action" status: 202 len: 0 microversion: 2.1 time: 8.110126 Oct 10 10:47:32.876412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1078/2217] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:24 2022] POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action => generated 0 bytes in 8112 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:47:32.889656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:32.896028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:32.909067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:32.912569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:32.915893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:32.916976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:32.917721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:32.921513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.202212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:34.217597 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53105064-8dc7-4004-a148-231806e07c90 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1488 microversion: 2.1 time: 1.333846 Oct 10 10:47:34.227118 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1079/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:32 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1488 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:34.245965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:34.255042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] [instance: 8ee74691-9b0a-41a7-b38a-1b6122e6471f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:34.268278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.273889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.274886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.276050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.276748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.277629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.319879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] HTTP exception thrown: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Request method failure captured: Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f HTTP/1.1 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_e3zJInqVMSGJCeSb8xIOchezx-gdyeMt-yoJ6FB3MUQCOwlvJY1i35AnoSnVq3KzIUfgbztJRtSuBGtsPBkN5AB1JTJ1HLyg1uBZwy04aGjvckXmqy8a13yJAPDoojGRcBs5j8mYhj67_QGIYmh6xr1g5iAshWq_gZ8mNzOo-C7iQ Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 842cf83a29be46cca41020e234da2339 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestBootFromVolume-1077053298 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/842cf83a29be46cca41020e234da2339"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_842cf83a29be46cca41020e234da2339", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/842cf83a29be46cca41020e234da2339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/842cf83a29be46cca41020e234da2339"}]}] Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestBootFromVolume-1077053298 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 842cf83a29be46cca41020e234da2339 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1077053298 Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestBootFromVolume-1077053298-project Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 9033c0d378a545c487d7e90558a3d89d Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestBootFromVolume-1077053298-project Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8ee74691-9b0a-41a7-b38a-1b6122e6471f'} Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:34.326154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. Oct 10 10:47:34.330903 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:34.337318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Returning 404 to user: Instance 8ee74691-9b0a-41a7-b38a-1b6122e6471f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:34.338572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9172a205-7464-43be-ac7c-f177b86707c3 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f" status: 404 len: 111 microversion: 2.1 time: 0.108419 Oct 10 10:47:34.342173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1080/2219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:34 2022] GET /compute/v2.1/servers/8ee74691-9b0a-41a7-b38a-1b6122e6471f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:34.367329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:34.368095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:34.397426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.397552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.397949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.403450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.404317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.404913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.562528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:34.733944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Updating instance_info_cache with network_info: [{"id": "b1218557-8e4d-443b-9b43-de2474ef444c", "address": "fa:16:3e:f0:17:41", "network": {"id": "b6f1748c-0611-4e4d-8f82-a369e996a4d7", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1016039688-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "70a7c36ef3094851bb1d2f1a2f71f598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb1218557-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:34.746329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:34.764191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Releasing lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:47:34.767577 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-780241fa-185b-4e89-836a-80a8277ec7b6 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action" status: 202 len: 0 microversion: 2.1 time: 8.126420 Oct 10 10:47:34.774687 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1140/2220] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:26 2022] POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action => generated 0 bytes in 8132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:47:34.884049 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d534be20-c4b0-4415-b03a-f11282352c22 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 204 len: 0 microversion: 2.1 time: 0.533077 Oct 10 10:47:34.889446 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1081/2221] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:34 2022] DELETE /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:34.910226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.93"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:34.914977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:34.932752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.933941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.936490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:34.938076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:34.940251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:34.943590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:35.001177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:35.001850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquired lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:35.399355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:35.412153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:35.413135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:35.413881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:35.434177 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] Creating event network-changed:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:47:35.454706 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-28fbbd24-5f23-4f94-9b8d-815e31e512ee req-5a98c284-4f71-42f6-a2a7-e0edcf757bfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.678607 Oct 10 10:47:35.455741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1141/2222] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:35.461059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:35.461721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:35.493579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:35.494293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:35.494870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:35.500140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:35.501419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:35.502026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:35.557434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lazy-loading 'flavor' on Instance uuid af2c38ec-9055-4748-bca2-2d4208c28b12 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:47:35.809723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91a0a575-605b-47ad-823e-7a74e021c4ae tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12/action" status: 202 len: 0 microversion: 2.1 time: 0.351316 Oct 10 10:47:35.819085 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1142/2223] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:35 2022] POST /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:35.829365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fc0c681-f3d2-4075-b294-111e693aabf7 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] Calling method '.version_select at 0x7f6777a3cd30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:35.884983 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fc0c681-f3d2-4075-b294-111e693aabf7 tempest-ServersTestBootFromVolume-1077053298 tempest-ServersTestBootFromVolume-1077053298-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-169460523" status: 202 len: 0 microversion: 2.1 time: 0.062777 Oct 10 10:47:35.886285 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1143/2224] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-169460523 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:35.907507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.82"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:36.562409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:36.573092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:36.576406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:36.578930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:36.580570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:36.581286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:36.583701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:37.297937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:37.298532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquired lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:39.467080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:41.233233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Updating instance_info_cache with network_info: [{"id": "b1218557-8e4d-443b-9b43-de2474ef444c", "address": "fa:16:3e:f0:17:41", "network": {"id": "b6f1748c-0611-4e4d-8f82-a369e996a4d7", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1016039688-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "70a7c36ef3094851bb1d2f1a2f71f598", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb1218557-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:41.263659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Releasing lock "refresh_cache-92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:47:41.273155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-728938d3-b7f7-47e6-94aa-5b6fe8aa1588 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action" status: 202 len: 0 microversion: 2.1 time: 5.364549 Oct 10 10:47:41.274171 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1144/2225] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:35 2022] POST /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371/action => generated 0 bytes in 5375 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:47:41.281133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:41.283282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: a41a608c-76d1-46ae-a09a-60a06b3c449e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:41.292868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:41.293712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:41.294319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:41.295255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:41.295904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:41.296534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:41.319201 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] HTTP exception thrown: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Request method failure captured: Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e HTTP/1.1 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_bdSNRMRLUE7yDK1PPqkgBO0L4rDLEHULw0w2ndxpMdv4TZ0jxjOaljw4WsTAMGtm9g1Z6kfvir8YsWNIBHBEOGzwarnFR2K8rO2CYMQcjAXgogA1iYHmoZ-MywSPRSwyjfguoDdy_GZQ5ch_Sue7zX_-j2-11JHPMst8SrXT3VMc8 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f72eed82348240eaba9c14006269bafe", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f72eed82348240eaba9c14006269bafe"}]}] Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6bd4da9b853c4eb08ca095c726a3e397 Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a41a608c-76d1-46ae-a09a-60a06b3c449e'} Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:41.323358 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. Oct 10 10:47:41.327688 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:41.331391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Returning 404 to user: Instance a41a608c-76d1-46ae-a09a-60a06b3c449e could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:41.334539 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-314cb916-5c65-4e84-b93d-9080f433f4dd tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e" status: 404 len: 111 microversion: 2.1 time: 0.058640 Oct 10 10:47:41.335691 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1145/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:41 2022] GET /compute/v2.1/servers/a41a608c-76d1-46ae-a09a-60a06b3c449e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:41.341874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:41.343348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:41.369716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:41.369716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:41.369716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:41.369716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:41.381832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:41.384827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:41.667228 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.network.neutron [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] re-assign floating IP 172.25.5.93 from instance a7c2e400-7600-4f1e-b0b4-60133b526514 Oct 10 10:47:41.795975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:41.809036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:41.812172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0be5974d-cd41-4f6b-b8ad-f24d0b1934b4 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 200 len: 1479 microversion: 2.1 time: 0.475236 Oct 10 10:47:41.828795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1146/2227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:41 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 1479 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:41.855386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41a608c-76d1-46ae-a09a-60a06b3c449e", "name": "network-vif-deleted", "tag": "667b7c05-ffd5-45b0-889a-81405610d0f8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:41.884843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:41.886539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:41.887549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:41.935593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] Creating event network-vif-deleted:667b7c05-ffd5-45b0-889a-81405610d0f8 for instance a41a608c-76d1-46ae-a09a-60a06b3c449e on n-h2-860687-2 Oct 10 10:47:41.948373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e71740a0-989e-4be1-9e33-6a50e9d38cd0 req-bb6f7d43-ae3c-4856-a185-13d63eea3d87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116354 Oct 10 10:47:41.952224 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1147/2228] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:41.968543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:42.005257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:42.007357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:42.012759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:42.041322 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] Creating event network-changed:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:47:42.051966 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fdc968db-b0ee-405e-822b-c1178eaee61e req-d16b9cb3-b875-4395-8ece-6911b549d268 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093088 Oct 10 10:47:42.053338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1148/2229] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:42.388668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Calling method '.version_select at 0x7f67779de280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:42.390943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:42.391651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:42.392162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:42.436843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:42.440232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:42.440956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:42.473321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:42.474234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:42.475522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:42.497632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0164135f-ba72-462a-8e15-2edeb2b466ae tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277 tempest-PortsAdminExtendedAttrsIpV6TestJSON-267694277-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.442140 Oct 10 10:47:42.505676 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1149/2230] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:47:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:42.515145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4f50b02-5c49-4f87-b919-cd92755c7bc3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '.version_select at 0x7f6777a0c8b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:43.775242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Updating instance_info_cache with network_info: [{"id": "62e4150d-8914-4c8c-aa9d-b80649862d3e", "address": "fa:16:3e:ec:3e:ba", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62e4150d-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:43.797749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:44.943484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:45.274636 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4f50b02-5c49-4f87-b919-cd92755c7bc3 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/9cd4c9f7-bb2e-44b7-9ca5-9c1d2e6b8a5e" status: 202 len: 0 microversion: 2.1 time: 2.766015 Oct 10 10:47:45.283248 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1150/2231] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:47:42 2022] DELETE /compute/v2.1/os-floating-ips/9cd4c9f7-bb2e-44b7-9ca5-9c1d2e6b8a5e => generated 0 bytes in 2776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:45.291103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:45.292125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:45.339934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:45.417047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:45.670164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7dbb2fb3-7625-40eb-beb1-bfedb6454924 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 204 len: 0 microversion: 2.1 time: 0.383327 Oct 10 10:47:45.671612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1151/2232] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:45 2022] DELETE /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:45.678882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-248514734"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:45.686866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:45.721706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:45.724569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:45.727718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:45.728826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:45.729465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:45.734672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:45.895219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Updating instance_info_cache with network_info: [{"id": "7d68ce5b-fa98-461c-a6d9-61c2362d019a", "address": "fa:16:3e:12:c9:66", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d68ce5b-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:45.924989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Releasing lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:47:45.926264 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e939a94c-1a25-4490-b9ef-55874da1e296 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c/action" status: 202 len: 0 microversion: 2.1 time: 11.031871 Oct 10 10:47:45.927599 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1082/2233] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:34 2022] POST /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c/action => generated 0 bytes in 11038 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:47:45.942584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}, {"name": "network-changed", "server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}, {"name": "network-changed", "server_uuid": "4921af3e-8243-45e9-8e6c-b1c8e01a247c", "tag": "7d68ce5b-fa98-461c-a6d9-61c2362d019a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:45.994595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:45.998227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:45.999178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:46.030438 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Creating event network-changed:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:47:46.033233 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Creating event network-changed:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:47:46.034010 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] Creating event network-changed:7d68ce5b-fa98-461c-a6d9-61c2362d019a for instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c on n-h2-860687-2 Oct 10 10:47:46.072319 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d7bbd764-dc7d-41ea-885d-0593945e42f3 req-499c28aa-05e8-4bd6-9b90-25a5dbf40d91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.142076 Oct 10 10:47:46.074174 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1083/2234] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:46.089927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb239cab-4f3c-4420-95f6-5cb92644068c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '.version_select at 0x7f6780e311f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:46.262346 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29213689-4408-411d-adbd-5288794559a2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12/action" status: 202 len: 0 microversion: 2.1 time: 0.588636 Oct 10 10:47:46.263124 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1152/2235] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:45 2022] POST /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:47:46.281995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:46.282796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:46.320418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:46.320954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:46.328974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:46.334303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:46.334820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:46.335308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:46.774971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:46.784810 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98004004-5b3b-49b5-8d1b-626bdd6a35f0 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1469 microversion: 2.1 time: 0.520480 Oct 10 10:47:46.808804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1153/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:46 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:46.815456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.93"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:46.977895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb239cab-4f3c-4420-95f6-5cb92644068c tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cd40fc7b-90dc-4289-935e-714b0708968b" status: 202 len: 0 microversion: 2.1 time: 0.901754 Oct 10 10:47:46.978738 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1084/2237] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:47:46 2022] DELETE /compute/v2.1/os-security-groups/cd40fc7b-90dc-4289-935e-714b0708968b => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:47:46.985584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abd0379b-5edd-4865-a8f4-34a0c9b6bab1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c30b820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:47.069621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abd0379b-5edd-4865-a8f4-34a0c9b6bab1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1439 microversion: 2.1 time: 0.089234 Oct 10 10:47:47.073350 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1085/2238] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:46 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:47.095215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:47.096134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:47.106645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.107526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.108179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:47.110153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.111150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.111829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:47.145300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:47.233262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:47.252248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:47.268487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.269046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.269495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:47.270231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.272313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.272971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:47.311300 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f31b271-fca2-420e-905c-07142e80b431 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 204 len: 0 microversion: 2.1 time: 0.236248 Oct 10 10:47:47.313506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1086/2239] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:47 2022] DELETE /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:47.326900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:47.327859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:47.343053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.345940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.346465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:47.347310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:47.347885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:47.348442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:48.105488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:48.114174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b02a786-96d8-4dba-93a6-0db339a73943 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1510 microversion: 2.1 time: 0.796334 Oct 10 10:47:48.116475 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1087/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:47 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1510 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:47:48.123058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:48.124022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:48.134027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:48.134835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:48.135674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:48.137408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:48.138175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:48.138819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:48.217144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] HTTP exception thrown: Floating IP 172.25.5.93 is not associated with instance a7c2e400-7600-4f1e-b0b4-60133b526514. Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Request method failure captured: Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action HTTP/1.1 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 48 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_gS6u9QXGfsRR0lZI2fphAATt2j-nkO-eZBHFkX5MPqaB_2NAOd4XnUrCNX5OsppoVVCJhV0ai06mVJb36DeCUIeeAuL7NkjdLUCpSA2BaNFb7oGuHuFIKf71J3HVo4MbI9qmAIGm31W2nf202UC5-HGQqJ4Z4o5jtQXV9A_pjIlPI Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0da0f484c5744a188efaad483207af32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0da0f484c5744a188efaad483207af32"}]}] Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e00702cc57c94cb0826c151c05dcf649 Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: {"removeFloatingIp": {"address": "172.25.5.93"}} Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: exception: Floating IP 172.25.5.93 is not associated with instance a7c2e400-7600-4f1e-b0b4-60133b526514. Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a7c2e400-7600-4f1e-b0b4-60133b526514', 'body': {'removeFloatingIp': {'address': '172.25.5.93'}}} Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.93 is not associated with instance a7c2e400-7600-4f1e-b0b4-60133b526514. Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.93 is not associated with instance a7c2e400-7600-4f1e-b0b4-60133b526514. Oct 10 10:47:48.219709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:48.224633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Returning 409 to user: Floating IP 172.25.5.93 is not associated with instance a7c2e400-7600-4f1e-b0b4-60133b526514. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:48.225695 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c31f8c9-d3d8-4bec-819a-f518df255534 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action" status: 409 len: 145 microversion: 2.1 time: 1.415641 Oct 10 10:47:48.226433 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1154/2241] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:46 2022] POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action => generated 145 bytes in 1417 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:47:48.232399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92d72f99-4e11-4e9e-ae57-a534c9551792 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777995e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:48.243603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:48.255944 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cf050d7-a021-4b8f-9347-b74d8e91ea43 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1427 microversion: 2.1 time: 0.136551 Oct 10 10:47:48.258667 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1088/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:48 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:48.275190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc8733e-b72a-4082-954f-ddf2bb7ac6c5", "name": "network-vif-deleted", "tag": "d39d7bd1-1604-4eee-a963-18acfdf1faa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:48.312888 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92d72f99-4e11-4e9e-ae57-a534c9551792 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1439 microversion: 2.1 time: 0.084301 Oct 10 10:47:48.317260 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1155/2243] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:48 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:48.329248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:48.329765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:48.331335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:48.331751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.93"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:48.374340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] Creating event network-vif-deleted:d39d7bd1-1604-4eee-a963-18acfdf1faa1 for instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 on n-h1-860687-2 Oct 10 10:47:48.386490 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-21da53c3-4903-41fb-aa9d-a29a6a28774d req-f2bf2185-ad08-44e0-b1bf-e4d6040c9345 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126390 Oct 10 10:47:48.389264 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1089/2244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:48.601107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:48.611146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:48.613234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:48.614173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:48.614871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:48.615757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:48.616586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:48.617223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.025090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:49.025713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquired lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:49.143229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:49.144695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:49.154025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:49.155418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:49.163746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.164819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:49.165488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:49.166112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.626311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:49.637725 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7c4996e-515f-45fe-be5d-4eaff68f7729 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1510 microversion: 2.1 time: 0.497383 Oct 10 10:47:49.641580 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1090/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:49 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:47:49.662205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:49.663439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:49.689553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:49.699855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:49.707751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.708865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:49.711668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:49.712369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.804642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:49.805334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:49.805926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:49.806563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lazy-loading 'fault' on Instance uuid 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:47:49.940698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd4da9b853c4eb08ca095c726a3e397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72eed82348240eaba9c14006269bafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:49.965775 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a65623e-70df-49f4-b381-42a6ac683a60 tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 200 len: 1303 microversion: 2.1 time: 0.321677 Oct 10 10:47:49.981030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1091/2246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:49 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 1303 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:49.990268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb4c299d-86c9-4d7c-8b2d-96f5362f586c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677ca88040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:50.081058 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb4c299d-86c9-4d7c-8b2d-96f5362f586c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1439 microversion: 2.1 time: 0.098661 Oct 10 10:47:50.083743 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1092/2247] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:49 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:50.613705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:47:50.628380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4921af3e-8243-45e9-8e6c-b1c8e01a247c", "tag": "7d68ce5b-fa98-461c-a6d9-61c2362d019a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:50.684537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:50.685049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:50.689131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:50.713199 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] Creating event network-changed:7d68ce5b-fa98-461c-a6d9-61c2362d019a for instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c on n-h2-860687-2 Oct 10 10:47:50.732503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-23da8a62-aa7f-4329-8e17-19a05b70e81f req-d4ce7fa3-00ca-4656-96fa-de110ca413e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110425 Oct 10 10:47:50.736639 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1093/2248] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:47:50.747819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:50.748754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:50.769079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:50.769793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:50.770503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:50.774284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:50.775025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:50.775640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:51.386334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1aaea68afd24511bf9787b7722c7a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a7c36ef3094851bb1d2f1a2f71f598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:47:51.421642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fff5c9ad-8006-44cd-ba7a-a7df4394eee1 tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 200 len: 1510 microversion: 2.1 time: 0.681383 Oct 10 10:47:51.423904 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1094/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:50 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 1510 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:47:51.441494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:51.445408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] [instance: 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:51.460518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:51.461977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:51.465244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:51.467831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:51.469135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:51.470245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:51.508099 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] HTTP exception thrown: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Request method failure captured: Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 HTTP/1.1 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_bdSNRMRLUE7yDK1PPqkgBO0L4rDLEHULw0w2ndxpMdv4TZ0jxjOaljw4WsTAMGtm9g1Z6kfvir8YsWNIBHBEOGzwarnFR2K8rO2CYMQcjAXgogA1iYHmoZ-MywSPRSwyjfguoDdy_GZQ5ch_Sue7zX_-j2-11JHPMst8SrXT3VMc8 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f72eed82348240eaba9c14006269bafe", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f72eed82348240eaba9c14006269bafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f72eed82348240eaba9c14006269bafe"}]}] Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f72eed82348240eaba9c14006269bafe Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MigrationsAdminTest-1071808201 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6bd4da9b853c4eb08ca095c726a3e397 Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MigrationsAdminTest-1071808201-project Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7dc8733e-b72a-4082-954f-ddf2bb7ac6c5'} Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:51.537000 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. Oct 10 10:47:51.541245 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:47:51.543952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] Returning 404 to user: Instance 7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:51.548607 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a9e360a-af21-446f-a04e-cfaf25be4ccf tempest-MigrationsAdminTest-1071808201 tempest-MigrationsAdminTest-1071808201-project] 10.222.0.16 "GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5" status: 404 len: 111 microversion: 2.1 time: 0.121497 Oct 10 10:47:51.553501 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1095/2250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:51 2022] GET /compute/v2.1/servers/7dc8733e-b72a-4082-954f-ddf2bb7ac6c5 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:51.569403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40ff306d-963e-462d-9862-f0f4b9997489 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c7c7280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:52.963452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Updating instance_info_cache with network_info: [{"id": "7d68ce5b-fa98-461c-a6d9-61c2362d019a", "address": "fa:16:3e:12:c9:66", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7d68ce5b-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:47:52.972930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Releasing lock "refresh_cache-4921af3e-8243-45e9-8e6c-b1c8e01a247c" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:47:52.978600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c83616d-61fd-44bd-ab7e-787e40774ac5 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c/action" status: 202 len: 0 microversion: 2.1 time: 4.659849 Oct 10 10:47:52.995358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1156/2251] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:48 2022] POST /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c/action => generated 0 bytes in 4677 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:47:53.400989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2c38ec-9055-4748-bca2-2d4208c28b12", "name": "network-vif-plugged", "status": "completed", "tag": "e856159c-211a-4d88-9285-8f43b6fa83ee"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:53.430130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.434163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.435492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.446266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=87,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:47:53.471527 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] Creating event network-vif-plugged:e856159c-211a-4d88-9285-8f43b6fa83ee for instance af2c38ec-9055-4748-bca2-2d4208c28b12 on n-h1-860687-2 Oct 10 10:47:53.540789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-dac9714e-63fd-48bc-a01a-27e67c230e0b req-bff8151a-6d68-4857-9cd1-44236fd84ddc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.543497 Oct 10 10:47:53.550659 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1157/2252] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:53.558056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:53.559019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] [instance: 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:53.567392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.568149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.569894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.570838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.571535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.572934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.592473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] HTTP exception thrown: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Request method failure captured: Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 HTTP/1.1 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_f7o0pkb-LPwEMO8jbvLCIeLyawlElfdUEjOB_3BStfhbBqMMiHyauDEDP_HYZGaEJo1Vw16IMUpJGiaJ83W2XuzNY0A_7zaUleqwiXp9BbuS6KXKSUa8tbHGMr1Ykqdx-_ek6OTo_rOo-Z7zzfNfqjgYG_uBvxY3Oq0Hn5pyz8nos Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 70a7c36ef3094851bb1d2f1a2f71f598 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1700887053 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a7c36ef3094851bb1d2f1a2f71f598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70a7c36ef3094851bb1d2f1a2f71f598", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70a7c36ef3094851bb1d2f1a2f71f598"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70a7c36ef3094851bb1d2f1a2f71f598"}]}] Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1700887053 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 70a7c36ef3094851bb1d2f1a2f71f598 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1700887053 Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueTestJSONUnderV235-1700887053-project Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b1aaea68afd24511bf9787b7722c7a2f Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1700887053-project Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '92b1dbf0-3ede-4c7b-9218-64a6ee3a8371'} Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:53.596104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. Oct 10 10:47:53.601338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:47:53.603715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] Returning 404 to user: Instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:47:53.606390 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-39d1f42f-f2d9-481e-8000-fe2eaccd58cd tempest-ServerRescueTestJSONUnderV235-1700887053 tempest-ServerRescueTestJSONUnderV235-1700887053-project] 10.222.0.16 "GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371" status: 404 len: 111 microversion: 2.1 time: 0.051882 Oct 10 10:47:53.607600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1158/2253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:47:53 2022] GET /compute/v2.1/servers/92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:47:53.616914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b1dbf0-3ede-4c7b-9218-64a6ee3a8371", "name": "network-vif-deleted", "tag": "b1218557-8e4d-443b-9b43-de2474ef444c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:53.631144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.632247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.633060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.648821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] Creating event network-vif-deleted:b1218557-8e4d-443b-9b43-de2474ef444c for instance 92b1dbf0-3ede-4c7b-9218-64a6ee3a8371 on n-h1-860687-2 Oct 10 10:47:53.654417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b0cacd91-b352-4027-bc4a-0f009993564d req-e0c69dbb-bcb4-4445-a559-4f1547bddcfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045338 Oct 10 10:47:53.655222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1159/2254] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:47:53.663370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:47:53.664314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:53.674048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.674950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.675664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.676647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.677325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.677976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.726038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:47:53.881675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b454b904-dfb1-4e43-a3b8-28e9b8f7e7b6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 204 len: 0 microversion: 2.1 time: 0.223979 Oct 10 10:47:53.882589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1160/2255] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:47:53 2022] DELETE /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:47:53.901026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.93"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:47:53.905051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:47:53.915660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.916382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.917010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:53.918216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:47:53.920588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:47:53.921379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:47:54.092134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:47:54.093694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquired lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:47:57.878167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:48:01.128157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Updating instance_info_cache with network_info: [{"id": "62e4150d-8914-4c8c-aa9d-b80649862d3e", "address": "fa:16:3e:ec:3e:ba", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62e4150d-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:48:01.153529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Releasing lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:48:01.154437 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a64ad5ae-a1b8-4897-b7f6-82bd2880463c tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action" status: 202 len: 0 microversion: 2.1 time: 7.265008 Oct 10 10:48:01.155528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1161/2256] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:47:53 2022] POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action => generated 0 bytes in 7267 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:48:01.166664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:01.188689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:01.189189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:01.189633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:01.218495 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] Creating event network-changed:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:48:01.227331 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0ecb3f39-20b7-4488-92a3-b237aca4ab30 req-8f753106-aa72-42d8-873b-ab761041cce8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069699 Oct 10 10:48:01.227955 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1162/2257] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:01.459954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:01.482661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:01.736812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6615b3c8-0498-4247-9b7b-e40266edd835 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] Action: 'create', calling method: .version_select at 0x7f67779634c0>, body: {"security_group": {"name": "tempest-securitygroup-721829413", "description": "tempest-description-1545353595"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:03.198352 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6615b3c8-0498-4247-9b7b-e40266edd835 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.969022 Oct 10 10:48:03.199030 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1163/2258] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:48:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:03.204689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4921af3e-8243-45e9-8e6c-b1c8e01a247c", "name": "network-vif-deleted", "tag": "7d68ce5b-fa98-461c-a6d9-61c2362d019a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:03.250710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:03.255470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:03.256784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:03.326234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] Creating event network-vif-deleted:7d68ce5b-fa98-461c-a6d9-61c2362d019a for instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c on n-h2-860687-2 Oct 10 10:48:03.343904 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-79ebd2a4-bcdd-4a03-a3f4-861707733cdb req-389d9a99-18b7-4dae-8e27-d359530ace09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142881 Oct 10 10:48:03.345330 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1164/2259] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:03.377414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3efe352e-5b14-4c3d-b245-cfb9fff8a9ab tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '.version_select at 0x7f67779de9d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:03.850776 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3efe352e-5b14-4c3d-b245-cfb9fff8a9ab tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/708e19d9-8b00-4ab7-9514-c2a4b7f707c6" status: 200 len: 183 microversion: 2.1 time: 0.504085 Oct 10 10:48:03.852902 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1165/2260] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:48:03 2022] GET /compute/v2.1/os-floating-ips/708e19d9-8b00-4ab7-9514-c2a4b7f707c6 => generated 183 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:03.870746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d664c3c-94f6-45bf-acac-246637c774f8 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] Action: 'create', calling method: .version_select at 0x7f67779de0d0>, body: {"security_group": {"name": "tempest-securitygroup-2128343676", "description": "tempest-description-2051258034"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:04.468997 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d664c3c-94f6-45bf-acac-246637c774f8 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.613956 Oct 10 10:48:04.469670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1166/2261] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:48:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:04.474782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.93"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:05.018517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:05.025898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:05.026399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:05.026853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:05.027589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:05.028042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:05.028469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:05.592306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 10:48:05.593933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquired lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 10:48:07.255227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Building network info cache for instance {{(pid=128800) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 10:48:08.070158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40ff306d-963e-462d-9862-f0f4b9997489 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1439 microversion: 2.1 time: 16.515048 Oct 10 10:48:08.078799 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1096/2262] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:47:51 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1439 bytes in 16524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:08.897148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05a1126e-71f5-4c48-8114-8be41cb0ec24 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] Action: 'create', calling method: .version_select at 0x7f6780e0fc10>, body: {"security_group": {"name": "tempest-securitygroup-623888482", "description": "tempest-description-812182937"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:09.440197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Updating instance_info_cache with network_info: [{"id": "62e4150d-8914-4c8c-aa9d-b80649862d3e", "address": "fa:16:3e:ec:3e:ba", "network": {"id": "af11dad6-136c-41f7-a9f8-2643d1a66737", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1157850369-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0da0f484c5744a188efaad483207af32", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62e4150d-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:48:09.459929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Releasing lock "refresh_cache-a7c2e400-7600-4f1e-b0b4-60133b526514" {{(pid=128800) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 10:48:09.460954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d7d0860-b952-49a4-aaa9-6e9af88bfd1f tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action" status: 202 len: 0 microversion: 2.1 time: 4.990392 Oct 10 10:48:09.461683 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1167/2263] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:48:04 2022] POST /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514/action => generated 0 bytes in 4992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 10:48:09.473659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:09.502608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:09.504421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:09.505189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:09.543811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] Creating event network-changed:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:48:09.556228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1885fe3e-d999-46ec-b628-837aa363d506 req-6e3756e5-0239-472a-a989-4c7e0b66d780 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091445 Oct 10 10:48:09.558575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1168/2264] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:09.976461 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05a1126e-71f5-4c48-8114-8be41cb0ec24 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.894025 Oct 10 10:48:09.985825 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1097/2265] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:48:08 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:09.985825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f2b9f06-0800-4bd3-bfda-c83ff4db6611 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6780dabb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:10.068734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f2b9f06-0800-4bd3-bfda-c83ff4db6611 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1439 microversion: 2.1 time: 0.089767 Oct 10 10:48:10.069553 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1098/2266] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:09 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:10.075882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:10.076639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:10.088869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:10.094889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:10.096512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:10.100772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:10.101471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:10.102302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:10.128579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] HTTP exception thrown: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Request method failure captured: Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c HTTP/1.1 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_gS6u9QXGfsRR0lZI2fphAATt2j-nkO-eZBHFkX5MPqaB_2NAOd4XnUrCNX5OsppoVVCJhV0ai06mVJb36DeCUIeeAuL7NkjdLUCpSA2BaNFb7oGuHuFIKf71J3HVo4MbI9qmAIGm31W2nf202UC5-HGQqJ4Z4o5jtQXV9A_pjIlPI Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0da0f484c5744a188efaad483207af32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0da0f484c5744a188efaad483207af32"}]}] Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: e00702cc57c94cb0826c151c05dcf649 Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4921af3e-8243-45e9-8e6c-b1c8e01a247c'} Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:48:10.130437 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.134681 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.138586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Returning 404 to user: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:48:10.138586 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99b6fed6-77dc-43ca-b4fa-bbcd74f99568 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 404 len: 111 microversion: 2.1 time: 0.066140 Oct 10 10:48:10.144859 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1099/2267] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:48:10 2022] DELETE /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:48:10.153469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2770e884-21f4-45f2-b3e3-5318cfb7a77a tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] Action: 'create', calling method: .version_select at 0x7f6780d8b1f0>, body: {"security_group": {"name": "tempest-securitygroup-422316083", "description": "tempest-description-235824034"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:10.215881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-05d3c49f-721f-43f8-abd3-f607ffd0f270 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Action: 'create', calling method: .version_select at 0x7f67779b71f0>, body: {"keypair": {"name": "tempest-keypair-702138466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLquCqWHmymjmqAR+1Ykk7L7CaF8WkkiMh1kvCtPh3tw+d+LHo8jUzuzKhPd1Y5mR0mGL5vExYSuWJmhiRk7h3/CtMVOlsXXzNp50bpsBa6btxDY0rhmnpMhxNKpU8ML8A=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:10.239558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-05d3c49f-721f-43f8-abd3-f607ffd0f270 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Getting quotas for project 7aca1a275c5c431dbce978ab85f072e0. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:10.247488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-05d3c49f-721f-43f8-abd3-f607ffd0f270 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Getting quotas for user 0a383aae34c946f89d28d7d784685dd8 and project 7aca1a275c5c431dbce978ab85f072e0. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:10.309175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-05d3c49f-721f-43f8-abd3-f607ffd0f270 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.748527 Oct 10 10:48:10.311438 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1169/2268] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:48:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:10.334353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:10.335970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: 4921af3e-8243-45e9-8e6c-b1c8e01a247c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:10.345866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:10.347215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:10.348278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:10.349481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:10.350605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:10.352493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:10.385080 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] HTTP exception thrown: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Request method failure captured: Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c HTTP/1.1 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_gS6u9QXGfsRR0lZI2fphAATt2j-nkO-eZBHFkX5MPqaB_2NAOd4XnUrCNX5OsppoVVCJhV0ai06mVJb36DeCUIeeAuL7NkjdLUCpSA2BaNFb7oGuHuFIKf71J3HVo4MbI9qmAIGm31W2nf202UC5-HGQqJ4Z4o5jtQXV9A_pjIlPI Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0da0f484c5744a188efaad483207af32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0da0f484c5744a188efaad483207af32"}]}] Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e00702cc57c94cb0826c151c05dcf649 Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4921af3e-8243-45e9-8e6c-b1c8e01a247c'} Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.387033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. Oct 10 10:48:10.391180 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:10.393565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Returning 404 to user: Instance 4921af3e-8243-45e9-8e6c-b1c8e01a247c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:48:10.394677 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1822286-56c8-49de-babb-d0b531754520 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c" status: 404 len: 111 microversion: 2.1 time: 0.081440 Oct 10 10:48:10.395584 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1170/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:10 2022] GET /compute/v2.1/servers/4921af3e-8243-45e9-8e6c-b1c8e01a247c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:48:10.408109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb4090f6-20bb-445c-b874-2a6346b1af90 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '.version_select at 0x7f6777a37700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:10.836258 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2770e884-21f4-45f2-b3e3-5318cfb7a77a tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.689886 Oct 10 10:48:10.837961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1100/2270] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:48:10 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:10.856638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8aafeea-3135-4497-ab21-7d956f351217 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] Calling method '.version_select at 0x7f677ca881f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:13.550505 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb4090f6-20bb-445c-b874-2a6346b1af90 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/708e19d9-8b00-4ab7-9514-c2a4b7f707c6" status: 202 len: 0 microversion: 2.1 time: 3.148790 Oct 10 10:48:13.553549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1171/2271] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 10:48:10 2022] DELETE /compute/v2.1/os-floating-ips/708e19d9-8b00-4ab7-9514-c2a4b7f707c6 => generated 0 bytes in 3153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:48:13.559544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8876f6f2-ea73-46d6-8aaf-51576edaaf00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c948af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:13.629360 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8876f6f2-ea73-46d6-8aaf-51576edaaf00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1448 microversion: 2.1 time: 0.074384 Oct 10 10:48:13.631705 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1172/2272] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:13 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1448 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:13.641687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:13.643179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:13.651622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:13.652484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:13.653149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:13.654657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:13.656290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:13.657039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:13.699461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:48:13.848420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-349f98ca-0b8d-46f8-a20b-17877abf15c6 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 204 len: 0 microversion: 2.1 time: 0.214303 Oct 10 10:48:13.850932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1173/2273] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:48:13 2022] DELETE /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:13.889427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b733906-f5ae-4d1e-bd21-3fe38d34d852 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677cbdb790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:14.018659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b733906-f5ae-4d1e-bd21-3fe38d34d852 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 200 len: 1448 microversion: 2.1 time: 0.160907 Oct 10 10:48:14.029611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1174/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:13 2022] GET /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:14.035338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:14.036414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:14.043634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:14.044428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:14.045105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:14.047336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:14.048061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:14.048881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:14.387417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:14.396806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-adcf2276-71cb-4d11-8609-1604ed7ec939 tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1526 microversion: 2.1 time: 0.365575 Oct 10 10:48:14.401794 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1175/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:14 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1526 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:14.407292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-555c29cc-5955-4bfb-81cc-66d87b8b92e7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f67779bed30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:15.289794 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-555c29cc-5955-4bfb-81cc-66d87b8b92e7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 204 len: 0 microversion: 2.1 time: 0.886657 Oct 10 10:48:15.291249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1176/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:14 2022] DELETE /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:15.303242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:15.304509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:15.316691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:15.317751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:15.318804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:15.320979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:15.322564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:15.325903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:15.385709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:48:15.542136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc4df767-59ab-4b7a-ab6b-6b290e0b5657 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 204 len: 0 microversion: 2.1 time: 0.244714 Oct 10 10:48:15.551390 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1177/2277] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:48:15 2022] DELETE /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:15.564574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:15.572875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:15.586309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:15.587026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:15.587655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:15.588721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:15.589182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:15.589659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:15.951683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00702cc57c94cb0826c151c05dcf649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da0f484c5744a188efaad483207af32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:15.963978 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9634769-e986-446d-b5ba-ed315f1735bb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 200 len: 1526 microversion: 2.1 time: 0.410816 Oct 10 10:48:15.964994 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1178/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:15 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 1526 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:15.982448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-584060695", "imageRef": "f92d41af-cac7-459c-ad8e-4f936d7f7cc6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "02b856d9-236a-48fe-a95f-ed4e445c9572"}], "security_groups": [{"name": "tempest-securitygroup--1365711283"}], "key_name": "tempest-keypair-702138466", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:16.332177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] validate_networks() for [('02b856d9-236a-48fe-a95f-ed4e445c9572', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:19.035679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:19.036313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:19.036581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:19.037015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:19.037529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:19.043318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:19.054715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.055264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.055704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.056460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.056926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.060819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.134878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Getting quotas for project 7aca1a275c5c431dbce978ab85f072e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:19.153666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Getting quotas for user 0a383aae34c946f89d28d7d784685dd8 and project 7aca1a275c5c431dbce978ab85f072e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:19.185679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:19.192882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f92d41af-cac7-459c-ad8e-4f936d7f7cc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:19.297081 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-376e8785-774e-45e0-a982-3899196512c7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.329084 Oct 10 10:48:19.298200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1179/2279] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 3332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:48:19.315612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-328311229", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8adcea62-172b-4b2d-a9dc-5bc930072e9a"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:19.367625 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8aafeea-3135-4497-ab21-7d956f351217 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9680 microversion: 2.1 time: 8.518869 Oct 10 10:48:19.369086 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1101/2280] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Oct 10 10:48:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9680 bytes in 8521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:19.375360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2c38ec-9055-4748-bca2-2d4208c28b12", "name": "network-vif-unplugged", "status": "completed", "tag": "e856159c-211a-4d88-9285-8f43b6fa83ee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:19.387099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.387868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.388478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.404359 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] Creating event network-vif-unplugged:e856159c-211a-4d88-9285-8f43b6fa83ee for instance af2c38ec-9055-4748-bca2-2d4208c28b12 on n-h1-860687-2 Oct 10 10:48:19.408807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] validate_networks() for [('8adcea62-172b-4b2d-a9dc-5bc930072e9a', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:19.410900 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d4dbdf88-f4fa-4017-931d-d21277328552 req-84d0877a-5998-4da0-be25-813985fe9ca1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040631 Oct 10 10:48:19.413110 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1102/2281] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:19.427176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2e400-7600-4f1e-b0b4-60133b526514", "name": "network-vif-deleted", "tag": "62e4150d-8914-4c8c-aa9d-b80649862d3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:19.453929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.458468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.458468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.472255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] Creating event network-vif-deleted:62e4150d-8914-4c8c-aa9d-b80649862d3e for instance a7c2e400-7600-4f1e-b0b4-60133b526514 on n-h2-860687-2 Oct 10 10:48:19.480677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b952c0ff-6977-4de4-bc0a-901b6f8238d7 req-1df296b8-eea4-4517-ad5e-6b8cec12de88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066001 Oct 10 10:48:19.481908 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1103/2282] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:19.488884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:19.489813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] [instance: a7c2e400-7600-4f1e-b0b4-60133b526514] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:19.498590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.509688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.510469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.511566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:19.512201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:19.512812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:19.543626 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] HTTP exception thrown: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Request method failure captured: Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 HTTP/1.1 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_gS6u9QXGfsRR0lZI2fphAATt2j-nkO-eZBHFkX5MPqaB_2NAOd4XnUrCNX5OsppoVVCJhV0ai06mVJb36DeCUIeeAuL7NkjdLUCpSA2BaNFb7oGuHuFIKf71J3HVo4MbI9qmAIGm31W2nf202UC5-HGQqJ4Z4o5jtQXV9A_pjIlPI Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0da0f484c5744a188efaad483207af32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0da0f484c5744a188efaad483207af32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0da0f484c5744a188efaad483207af32"}]}] Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0da0f484c5744a188efaad483207af32 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1632151126 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: e00702cc57c94cb0826c151c05dcf649 Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1632151126-project Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a7c2e400-7600-4f1e-b0b4-60133b526514'} Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:19.545579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. Oct 10 10:48:19.550713 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:48:19.552193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] Returning 404 to user: Instance a7c2e400-7600-4f1e-b0b4-60133b526514 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:48:19.553673 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9af2a05-6c64-40d5-b135-ebc0dab2acdb tempest-FloatingIPsAssociationTestJSON-1632151126 tempest-FloatingIPsAssociationTestJSON-1632151126-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514" status: 404 len: 111 microversion: 2.1 time: 0.069293 Oct 10 10:48:19.557986 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1104/2283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:19 2022] GET /compute/v2.1/servers/a7c2e400-7600-4f1e-b0b4-60133b526514 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:48:19.565105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2068723240", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b3c0b44-47b9-47c0-bc6d-3315dd197dc7"}, {"uuid": "e9b153fc-c6bd-4bf0-96a7-7644d004a93e"}, {"uuid": "1b3c0b44-47b9-47c0-bc6d-3315dd197dc7"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:19.665520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] validate_networks() for [('1b3c0b44-47b9-47c0-bc6d-3315dd197dc7', None, None, None, None, None), ('e9b153fc-c6bd-4bf0-96a7-7644d004a93e', None, None, None, None, None), ('1b3c0b44-47b9-47c0-bc6d-3315dd197dc7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:21.625339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:21.626738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:21.627281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:21.627871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:21.628444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:21.645679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:21.650146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:21.651138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:21.652429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:21.654260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:21.658276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:21.726747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:21.741512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Getting quotas for user 53f07854e54a44689b1067dbcd0ec464 and project f96c90e82e5b41a2aac96bdc91e06c61. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:21.787455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:21.791129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:21.924902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b9094f1-8c95-4782-a74b-82bbe19697ee tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.619090 Oct 10 10:48:21.943027 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1180/2284] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:48:21.947700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:21.965891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:22.004232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:22.005255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:22.007975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:22.008915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:22.010603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:22.011401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:22.088960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:22.227241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:22.239623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-734862ed-db29-45ec-8453-a94e7ba383c8 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1302 microversion: 2.1 time: 0.297548 Oct 10 10:48:22.246726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1181/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:21 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1302 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:22.261022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c759e3d9-b925-41e8-93a3-e56a47b3c63f tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] Calling method '.version_select at 0x7f67779b99d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:24.247142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c759e3d9-b925-41e8-93a3-e56a47b3c63f tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.999002 Oct 10 10:48:24.248023 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1182/2286] 10.222.0.16 () {58 vars in 1191 bytes} [Mon Oct 10 10:48:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:24.270794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af2c38ec-9055-4748-bca2-2d4208c28b12", "name": "network-vif-deleted", "tag": "e856159c-211a-4d88-9285-8f43b6fa83ee"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:24.336697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:24.347951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:24.354948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:24.398306 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] Creating event network-vif-deleted:e856159c-211a-4d88-9285-8f43b6fa83ee for instance af2c38ec-9055-4748-bca2-2d4208c28b12 on n-h1-860687-2 Oct 10 10:48:24.418400 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6960d0c1-8cd2-41e4-ba3b-81751053439a req-7e40e57e-7db7-4d43-bc0d-4adc9824c0ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168869 Oct 10 10:48:24.419026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1183/2287] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:24.441316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:24.469007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:24.491872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:24.496537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:24.497204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:24.501780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:24.504596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:24.505236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:25.455457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:25.472168 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da82fbcf-b2a3-40ba-a5c5-fdb90367d7e5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1259 microversion: 2.1 time: 1.034785 Oct 10 10:48:25.472870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1184/2288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:24 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1259 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:25.520559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:25.523926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:25.538106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:25.541719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:25.542973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:25.545149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:25.547903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:25.548672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:26.379182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:26.387411 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-238e7065-0a1e-41a1-b4d7-35bdfb52dc69 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1302 microversion: 2.1 time: 0.913380 Oct 10 10:48:26.387971 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1185/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:25 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1302 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:26.400079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b68d4df6-60b3-4490-9e10-d3bf0ed039dc tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] Calling method '.version_select at 0x7f67779de550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:27.580315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:27.581442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:27.582145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:27.582766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:27.583559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:27.610723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:27.611684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:27.612391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:27.615022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:27.615733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:27.617767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:27.674162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Getting quotas for project 62d15ad837fe4274b7511c1d9c1971f5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:27.684936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Getting quotas for user f475c6af5cd7479cafdcb1e490119f04 and project 62d15ad837fe4274b7511c1d9c1971f5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:27.727152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:27.736498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:27.909494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3440643-2915-4abc-a854-3cfcebd199af tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.349332 Oct 10 10:48:27.914769 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1105/2290] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 8356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:48:27.929878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:27.930806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:27.964068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:27.966231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:27.970137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:27.974711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:27.983742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:27.985020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:28.445736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:28.466202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b86d4df-9d7b-46d3-bfe0-e748b195c440 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1265 microversion: 2.1 time: 0.547467 Oct 10 10:48:28.484402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1106/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:27 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1265 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:28.515360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:28.523343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:28.530915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:28.537131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:28.537933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:28.538931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:28.539654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:28.540389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:28.880789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b68d4df6-60b3-4490-9e10-d3bf0ed039dc tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f41bec31-f1d3-4e5d-beb3-1a81f59ccf70" status: 202 len: 0 microversion: 2.1 time: 2.484189 Oct 10 10:48:28.884851 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1186/2292] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:48:26 2022] DELETE /compute/v2.1/os-security-groups/f41bec31-f1d3-4e5d-beb3-1a81f59ccf70 => generated 0 bytes in 2489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:48:28.896791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5528dbe9-18bc-4a67-a0b0-4716b3e0e432 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:28.897429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5528dbe9-18bc-4a67-a0b0-4716b3e0e432 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:29.428745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5528dbe9-18bc-4a67-a0b0-4716b3e0e432 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:29.439443 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5528dbe9-18bc-4a67-a0b0-4716b3e0e432 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1213 microversion: 2.1 time: 0.546776 Oct 10 10:48:29.440039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1187/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:28 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1213 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:29.464116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3818c31c-d78c-4632-b923-65715ea00259 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] Calling method '.version_select at 0x7f677c948af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:29.772597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:29.791644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-187f169d-66ab-4b5e-a8e7-3ef32983eb3f tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 1.318361 Oct 10 10:48:29.808020 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1107/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:28 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:29.817674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0357bf0a-70fd-4e63-b187-29a3df63575a", "tag": "790da0de-4219-41e7-8879-198f90a35111"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:29.846209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:29.848224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:29.849019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:29.890702 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] Creating event network-changed:790da0de-4219-41e7-8879-198f90a35111 for instance 0357bf0a-70fd-4e63-b187-29a3df63575a on n-h2-860687-2 Oct 10 10:48:29.896933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c9af4ddd-ff54-4b66-ad93-4ab029c53891 req-791fb274-d15b-4c28-b2a5-a9646a1bc3cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087128 Oct 10 10:48:29.898054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1108/2295] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:29.915867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:29.916985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:29.929534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:29.939433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:29.940435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:29.941446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:29.942141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:29.942947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:30.238783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:30.256315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e8c0d5c-5a36-493f-86b7-682eb6837125 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1265 microversion: 2.1 time: 0.348710 Oct 10 10:48:30.257131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1109/2296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:29 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:30.483904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:30.485833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:30.524042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:30.525673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:30.528772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:30.531079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:30.535427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:30.537844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:30.772151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:30.794787 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82d6177a-22b6-4f94-962b-91848530d20c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1265 microversion: 2.1 time: 0.326277 Oct 10 10:48:30.816474 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1110/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:30 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:30.834154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:30.835152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:30.854888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:30.864414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:30.865774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:30.870040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:30.870568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:30.871036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:31.375435 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3818c31c-d78c-4632-b923-65715ea00259 tempest-SecurityGroupsTestAdminJSON-1718325648 tempest-SecurityGroupsTestAdminJSON-1718325648-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3c29f549-22d5-4aac-b3c1-c9db399f4548" status: 202 len: 0 microversion: 2.1 time: 1.922192 Oct 10 10:48:31.376621 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1188/2298] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:48:29 2022] DELETE /compute/v2.1/os-security-groups/3c29f549-22d5-4aac-b3c1-c9db399f4548 => generated 0 bytes in 1924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:48:31.382325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:31.383985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:31.417404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:31.418240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:31.419034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:31.419949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:31.421148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:31.421828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:31.675593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:31.690769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9964fd0-a66e-4241-afa3-92ca14f8c1d9 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1265 microversion: 2.1 time: 0.312486 Oct 10 10:48:31.692415 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1189/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:31 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:31.703140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:31.709032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b243d987-92b4-441e-9573-0f4dcf2368d8 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] Calling method '.version_select at 0x7f67779be310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:31.784363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:31.786686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=41 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:31.802285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a82e97c-3a03-4c03-90ce-fe894915c2b6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.974019 Oct 10 10:48:31.804126 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1111/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:30 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:31.824015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:31.824717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:31.832979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:31.844657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:31.845330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:31.845870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:31.847854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:31.853232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:31.853809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:32.059958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:32.069142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22433d45-335f-40b0-ab66-e96a2c1665e8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1271 microversion: 2.1 time: 0.249231 Oct 10 10:48:32.072751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1112/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:31 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1271 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:48:32.716455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:32.717360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:32.741990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:32.742888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:32.743586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:32.744837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:32.745508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:32.746342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:33.618239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:33.630016 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68bd8a08-51e3-423d-9c17-891c31be7fa6 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.918136 Oct 10 10:48:33.631546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1113/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:32 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:48:33.645542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:33.645862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:33.664781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:33.665370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:33.665936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:33.666725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:33.667292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:33.667793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:33.750024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b243d987-92b4-441e-9573-0f4dcf2368d8 tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/02eb6a74-515d-4285-a279-71f4c120acaf" status: 202 len: 0 microversion: 2.1 time: 2.055593 Oct 10 10:48:33.750607 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1190/2303] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:48:31 2022] DELETE /compute/v2.1/os-security-groups/02eb6a74-515d-4285-a279-71f4c120acaf => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:48:33.767674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:33.768707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:33.784326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:33.802421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:33.808063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:33.811108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:33.812182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:33.819904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:34.285336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:34.293859 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e7018e1-1c6d-4907-be86-2d041577dae5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1271 microversion: 2.1 time: 0.542162 Oct 10 10:48:34.316498 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1191/2304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:33 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1271 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:34.705068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a45345a-49ae-42e7-a186-71377e0266f8 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: .version_select at 0x7f67779de040>, body: {"keypair": {"name": "tempest-keypair-580224880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHynEl+s1XcH5MzZRBGxnxVghFN8QmMySFqVk1QqkqD+pq4HiWehoG4+TUikqOkICjLJHnqOilJIUMGOBki+/H9WdI8fkfLVKYI30+5JgAUyJ7HBkhKM1nkqacP5in6vgg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:34.739046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:34.757173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d44a47e-bf3c-40dd-884b-f957f6260dcb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 1.123522 Oct 10 10:48:34.764590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=19 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:34.766776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5a45345a-49ae-42e7-a186-71377e0266f8 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for project 42e1556caa994a6e9b322c4da89dd453. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:34.777581 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1114/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:33 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:34.783854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5a45345a-49ae-42e7-a186-71377e0266f8 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for user f4ea69b8d1c14356a46d3d1db32e0456 and project 42e1556caa994a6e9b322c4da89dd453. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:34.787247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c58694b7-2a52-4035-80aa-1c7db1a7beba tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] Calling method '.version_select at 0x7f6780d9aaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:34.839580 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a45345a-49ae-42e7-a186-71377e0266f8 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.521551 Oct 10 10:48:34.841265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1192/2306] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:48:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:48:34.846593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:34.851084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:34.869314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:34.870224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:34.870842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:34.872010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:34.872716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:34.873299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.484327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:35.494855 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-35221677-ace7-4faf-9981-2174259cc2a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.652373 Oct 10 10:48:35.499313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1193/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:34 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:35.515410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:35.516332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:35.531756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:35.532486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:35.533134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.534012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:35.534672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:35.535321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.847630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:35.860450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c58694b7-2a52-4035-80aa-1c7db1a7beba tempest-SecurityGroupsTestAdminJSON-383683597 tempest-SecurityGroupsTestAdminJSON-383683597-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c31aa616-e4f5-486d-a4e5-fea1c1c8f8dc" status: 202 len: 0 microversion: 2.1 time: 1.081222 Oct 10 10:48:35.862019 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1115/2308] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:48:34 2022] DELETE /compute/v2.1/os-security-groups/c31aa616-e4f5-486d-a4e5-fea1c1c8f8dc => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:48:35.863936 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d2bd976-445b-4448-abfe-02f844c447fa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1313 microversion: 2.1 time: 0.359588 Oct 10 10:48:35.879034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1194/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:35 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:35.887792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:35.889722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:35.919554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:35.921159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57449e95-d15e-4650-a96c-bad0e6bfbeea", "tag": "f029953e-01ee-42da-b655-b0d6317c5bbc"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:35.921685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:35.922298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.925276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:35.935762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:35.936651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.946551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:35.947491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:35.948116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:35.969578 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] Creating event network-changed:f029953e-01ee-42da-b655-b0d6317c5bbc for instance 57449e95-d15e-4650-a96c-bad0e6bfbeea on n-h1-860687-2 Oct 10 10:48:35.980697 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-110dddad-3df3-4e07-adec-9f50684c66bb req-42aab8c2-c5a5-4bde-abee-63e3ce448334 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064663 Oct 10 10:48:35.981314 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1195/2310] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:48:36.336135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:36.349915 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b83a1d6-2839-44d8-a9aa-c45da96f27e7 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.486048 Oct 10 10:48:36.352718 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1116/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:35 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:36.522458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:36.523280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:36.536131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:36.536626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:36.537058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:36.548105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:36.548799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:36.549400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:36.957408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-110921141", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:37.057487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:37.647060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:37.700395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:37.745114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:37.762267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1306793-d4ef-4877-8acc-fd333ad9b075 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 1.243845 Oct 10 10:48:37.763181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1196/2312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:36 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:37.769196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:37.776850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:37.788241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:37.788742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:37.791630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:37.792390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:37.792868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:37.793315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:37.886850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:37.887534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:37.888329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:37.888950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:37.891714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:37.914750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:37.915681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:37.916129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:37.916869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:37.917325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:37.917749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:37.942971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Getting quotas for project 59dd868a1eb44951b5aca992f87527cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:37.953187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Getting quotas for user 2ad413c40d2e45ce9fb7183d9afbbafe and project 59dd868a1eb44951b5aca992f87527cb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:37.992399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:37.997331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:38.100737 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3985679e-a105-4d61-afcd-a53e889054fa tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.376411 Oct 10 10:48:38.103306 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1117/2313] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:48:38.116226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:38.117016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:38.130581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.131739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.132324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.133325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.133756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.134188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.144737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:38.166076 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4471b574-80dc-4e31-9aae-8d37d98691ba tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1334 microversion: 2.1 time: 0.401551 Oct 10 10:48:38.171362 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1197/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:37 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1334 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:38.411851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:38.412710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:38.423632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.424383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.424992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.425913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.426669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.428855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.473033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:48:38.556590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:38.566838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5293e38-c4d7-4043-93ea-8f88a9b1e031 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.462230 Oct 10 10:48:38.570805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1118/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:38 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:38.582325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49494e49-2cee-4e8f-ba60-baa2e3e85e6a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:38.585249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49494e49-2cee-4e8f-ba60-baa2e3e85e6a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:38.628899 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfb382c4-9c43-43c4-af1b-6ed8a3398135 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 204 len: 0 microversion: 2.42 time: 0.453629 Oct 10 10:48:38.632756 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1198/2316] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:48:38 2022] DELETE /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:48:38.644448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:38.648152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:38.655342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.655850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.656553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.657737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.658401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.659042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.705759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49494e49-2cee-4e8f-ba60-baa2e3e85e6a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:38.713087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49494e49-2cee-4e8f-ba60-baa2e3e85e6a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1216 microversion: 2.1 time: 0.138083 Oct 10 10:48:38.713691 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1119/2317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:38 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:38.786627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:38.787262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:38.800076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.800583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.801014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:38.801716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:38.802217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:38.802644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.142971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.153271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.155701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.157185 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f680d161-1bd0-45ce-8855-8eb7c2a1f5fe tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2955 microversion: 2.42 time: 0.519807 Oct 10 10:48:39.161122 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1199/2318] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:38 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2955 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:39.196970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:39.198780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:39.216132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.223512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.225707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.226452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.230465 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4266bf07-2285-4b62-97eb-0b38ad0c0e35 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.447547 Oct 10 10:48:39.234009 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1120/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:38 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:48:39.238790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.239682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.240882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.596443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:39.597473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:39.607627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.608657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.609345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.610274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.610944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.611612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.878137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.891472 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0336c6a4-b71e-46e2-8d42-3202b45a6bea tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.699583 Oct 10 10:48:39.892053 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1200/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:39 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:39.903214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:39.903843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:39.915543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.917327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.917818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.918662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:39.919335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:39.920054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:39.946755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:39.965228 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d51b4309-3add-4ea2-88d6-66e50bd7f46e tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.370524 Oct 10 10:48:39.967552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1121/2321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:39 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:48:40.035120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:40.049139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab268029-4724-41ca-bc09-40d9d2df3b28 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1220 microversion: 2.1 time: 0.149584 Oct 10 10:48:40.051634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1201/2322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:39 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:40.105250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-704155624", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d3a7b62-8c84-4abe-b3b5-946ae78094eb"}], "security_groups": [{"name": "tempest-securitygroup--1323499474"}], "key_name": "tempest-keypair-580224880", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:40.187912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:40.188524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:40.199968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:40.201533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:40.207057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:40.211153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:40.213993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:40.214645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:40.715594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] validate_networks() for [('2d3a7b62-8c84-4abe-b3b5-946ae78094eb', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:41.037404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:41.054904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:41.056400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:41.057702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e8b73bd-c212-44b3-9e4d-ef196cfaa569 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2955 microversion: 2.42 time: 0.874883 Oct 10 10:48:41.058272 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1202/2323] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:40 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2955 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:41.074028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:41.075072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:41.093035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:41.093550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:41.093999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:41.094732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:41.095222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:41.099506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:41.147102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:41.606329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:41.624291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b709d57-4417-405d-8b22-426f12f45e0c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.557179 Oct 10 10:48:41.624889 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1203/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:41 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:41.639739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:41.640797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:41.649203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:41.651689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:41.652506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:41.653274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:41.655655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:41.659331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.255800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:42.265507 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb333e91-b6f4-4e43-a2f2-4b18509e87a0 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.639138 Oct 10 10:48:42.266451 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1204/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:41 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:42.272211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:42.272973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:42.279340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.280181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.281138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.282136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.282834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.283560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.395768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:42.396262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:42.396690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:42.398097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:42.398539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:42.409380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.410017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.410636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.411940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.412727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.413340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.433324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for project 42e1556caa994a6e9b322c4da89dd453. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:42.439352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for user f4ea69b8d1c14356a46d3d1db32e0456 and project 42e1556caa994a6e9b322c4da89dd453. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:42.454051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:42.456493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:42.511913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afa209d3-76e5-4c40-b96a-1c03422cb565 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.411718 Oct 10 10:48:42.516435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:42.520584 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1122/2326] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:48:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:48:42.525645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0357bf0a-70fd-4e63-b187-29a3df63575a", "name": "network-vif-plugged", "status": "completed", "tag": "790da0de-4219-41e7-8879-198f90a35111"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:42.529190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cafd1a51-0a8b-4772-a27e-ccc3a0fbe49c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.261387 Oct 10 10:48:42.543051 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1205/2327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:42 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:42.543278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.543278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.543278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.543556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "tag": "5bbba364-5186-4738-a18d-2dcff21518a1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:42.550788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] Creating event network-vif-plugged:790da0de-4219-41e7-8879-198f90a35111 for instance 0357bf0a-70fd-4e63-b187-29a3df63575a on n-h2-860687-2 Oct 10 10:48:42.557538 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb13318b-1d00-497a-b20c-96769ed8c089 req-bbdf8eae-b690-4a06-a210-f81b87665e92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 Oct 10 10:48:42.558671 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1123/2328] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:42.564882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:42.565603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:42.573705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.577124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.579049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.585432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.585935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.586382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.587130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.587597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.588141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.626120 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] Creating event network-changed:5bbba364-5186-4738-a18d-2dcff21518a1 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:48:42.641559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6cda31a7-20d6-483c-aa06-08c8afc9b3f7 req-71648bc4-e76b-46d8-beb9-137818ed2cb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108619 Oct 10 10:48:42.656522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1206/2329] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:42.663221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:42.664134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:42.672607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.673331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.673924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.675526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:42.676134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:42.676740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:42.707897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:42.718122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54e9882a-5c0c-4a9d-bc84-d2e33c9c62fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1274 microversion: 2.1 time: 0.158134 Oct 10 10:48:42.718721 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1124/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:42 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:42.928391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-349991864", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:43.013074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:43.236501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.247695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.250009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.251812 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c82a355-3e2b-4d1e-9f48-ecae80183bb9 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2955 microversion: 2.42 time: 0.593799 Oct 10 10:48:43.253399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1207/2331] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:42 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2955 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:43.258310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:43.258921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:43.265441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.266108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.266697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.267593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.268200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.268950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.463278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.497137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.500651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.504152 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfd11140-c6fd-4f1c-9e14-71b404a9ad80 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1284 microversion: 2.20 time: 0.249480 Oct 10 10:48:43.533163 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1208/2332] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:43 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:43.546768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:43.548152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:43.564218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.566155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.567670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.568757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.569480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.570168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.640814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:43.642612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:43.643386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:43.643855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:43.644784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:43.659491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.659491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.659885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.661680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.662295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.662897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.689191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:43.718567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for user 26acf3a710d548238d3fc19da3cc2376 and project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:43.782007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:43.784391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:43.829069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:43.841943 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f75972a-e0b7-4d05-9426-9c3da35e66d1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.306882 Oct 10 10:48:43.843691 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1209/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:43 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:43.872276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:43.872922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:43.886000 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4886efd-d503-4b86-b600-e9c27899e496 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163033 Oct 10 10:48:43.887822 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1125/2334] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:48:43.912105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.914597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.915983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.922761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.924130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.924741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.928637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:43.930078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:43.950298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.952787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.957533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:43.958494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:43.960471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:43.962864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:44.355916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:44.379963 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4dc23599-8f8e-4b0a-b7bb-c136ba3e8c37 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.520049 Oct 10 10:48:44.380974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1210/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:43 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:44.391128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:44.394972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:44.398321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:44.418864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:44.423357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:44.424097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:44.429716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:44.430443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:44.430991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:44.459078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:44.471584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f178efd-19a6-4710-b201-1d23c6f8f248 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1370 microversion: 2.1 time: 0.581952 Oct 10 10:48:44.472172 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1126/2336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:43 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:44.480042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1879880373", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:44.597411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:48:44.810275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:45.439620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:45.452871 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16f61705-6779-45f0-8a41-d7d0e75158d9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 1.070436 Oct 10 10:48:45.453717 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1211/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:44 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:45.460096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:45.461034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:45.472875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.473441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.473815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:45.474672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.475187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.475857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:45.654100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:48:45.654818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:48:45.655058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:48:45.655651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:48:45.656303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:48:45.678256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.678895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.679466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:45.680436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.680917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.682329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:45.710390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:48:45.719836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for user 26acf3a710d548238d3fc19da3cc2376 and project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:48:45.752280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:48:45.755110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:48:45.849121 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e80738f-7ca3-42dd-b212-810f8d9862b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375572 Oct 10 10:48:45.849708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1127/2338] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:48:45.872887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:45.874088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:45.891611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.892440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.893680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:45.895066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:45.897132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:45.897920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.055190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.082444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.084320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.086732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d95f8eb3-6f9f-457f-94ac-ad772cc62980 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1338 microversion: 2.20 time: 0.232814 Oct 10 10:48:46.087802 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1128/2339] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:45 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1338 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:46.097597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57449e95-d15e-4650-a96c-bad0e6bfbeea", "name": "network-vif-plugged", "status": "completed", "tag": "f029953e-01ee-42da-b655-b0d6317c5bbc"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "56698754-5517-4926-b856-1f98d0d5ac33"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "cfddb5ce-0ba5-48b3-a0ea-9a684b78719d"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "198e4aa3-6b8a-4203-be82-10cfce441ef5"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:46.100658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.112820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.114730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.116325 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b573558f-bef2-49e7-b8e8-f82352431a5f tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2913 microversion: 2.42 time: 0.661236 Oct 10 10:48:46.131647 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1212/2340] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:45 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2913 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:46.140169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "tag": "fbf1dcdb-065c-421d-9cb7-089d8eaff412"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:46.144850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.145453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.151713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.162241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.162940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.163575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.186765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-plugged:f029953e-01ee-42da-b655-b0d6317c5bbc for instance 57449e95-d15e-4650-a96c-bad0e6bfbeea on n-h1-860687-2 Oct 10 10:48:46.190300 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] Creating event network-changed:fbf1dcdb-065c-421d-9cb7-089d8eaff412 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:48:46.191173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-unplugged:4b5563fd-cc2e-4abe-8f7a-6c5fee28a0e6 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:46.191908 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-unplugged:56698754-5517-4926-b856-1f98d0d5ac33 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:46.192630 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-unplugged:cfddb5ce-0ba5-48b3-a0ea-9a684b78719d for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:46.194510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-unplugged:198e4aa3-6b8a-4203-be82-10cfce441ef5 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:46.195259 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] Creating event network-vif-unplugged:3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:46.203476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-58059185-8139-4f4f-8d19-83ae56358fec req-084034e8-3c8d-4172-a3df-81e978c2a4e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072379 Oct 10 10:48:46.207429 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1213/2341] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:46.212909 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e746b3a8-d28d-4e89-8427-776b78362491 req-199e8751-0e00-4307-9c78-ac8d096c6679 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.123452 Oct 10 10:48:46.217527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1129/2342] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:46.225211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:46.227704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:46.231410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:46.234049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:46.253663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.254748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.255415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.256383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.258286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.261068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.263395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.264682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.266288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.267940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.270448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.271306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.777688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.790216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:46.791453 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50930374-9b2f-48b6-acad-baf020615dbb tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.572278 Oct 10 10:48:46.799539 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff7fca96-1c46-4d5b-b5e6-2ba04b8746a1 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1307 microversion: 2.1 time: 0.590235 Oct 10 10:48:46.807796 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1214/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:46 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:46.811022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1130/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:46 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:46.824853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:46.825837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:46.827281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:46.828273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:46.837638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.838137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.839404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.840619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.841499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.842953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.843955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.844990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.845683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:46.846720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:46.847441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:46.848143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.055286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.065487 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27e7facc-d818-40a9-8e65-da767d47aeed tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1266 microversion: 2.1 time: 0.244753 Oct 10 10:48:47.066255 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1215/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:46 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:47.080473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:47.081725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:47.089831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.090631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.091356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.093722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.094916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.095524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.411420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.419669 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-998324fe-7047-477f-9ba2-da7fc077688c tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1555 microversion: 2.1 time: 0.607238 Oct 10 10:48:47.420658 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1131/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:46 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1555 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:47.425522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:47.426126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:47.432471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.433154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.433811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.434783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.437662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.438505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.583795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.593383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-068645dd-303e-4bb1-b950-4bdcb133ce8d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 0.525496 Oct 10 10:48:47.594548 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1216/2347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:47 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:47.614421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:47.615240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:47.617946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.624329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.626941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.629114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.630139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.631298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.633842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:47.635556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64ad60d4-05cb-45cc-b791-ac901c0ea0aa tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1338 microversion: 2.20 time: 0.213476 Oct 10 10:48:47.637224 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1132/2348] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:47 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:47.658699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.661146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.665848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:47.666598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:47.676351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:47.678113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.679102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.679828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.681326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.682106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.682765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.958575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e052a72-0f1f-48ac-8094-5cf31e4fc53d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319881 Oct 10 10:48:47.960001 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1133/2349] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:48:47 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:47.973428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:47.974075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:47.980608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.981483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.982186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:47.983429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:47.983909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:47.984456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:48.649215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:48.670438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:48.672167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:48.673574 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ff47a41-aa6d-4c98-b01c-ae45c860e7d5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2913 microversion: 2.42 time: 1.077201 Oct 10 10:48:48.674315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1217/2350] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:47 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2913 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:48.699724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:48.700359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:48.707371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:48.707874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:48.708316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:48.709130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:48.709620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:48.710054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:48.924260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:48.926512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:48.940304 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c9e23b4-d24d-4365-b7d5-f82755196722 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.971472 Oct 10 10:48:48.959139 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1134/2351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:47 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:48.970953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:48.986207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:48.986922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:48.987750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.002205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] Creating event network-changed:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:48:49.018128 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-49a58d82-b2fe-448d-947c-8fd0a79dcdf2 req-a661cf5b-2ea3-49db-92d5-1675dad43237 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055623 Oct 10 10:48:49.018962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1135/2352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:49.024794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:49.025737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:49.033957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.035414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.036085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.037278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.037920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.038608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.141324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:49.161999 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb9b9ba9-a2e8-42a1-ad65-fe4d99143c24 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1488 microversion: 2.1 time: 0.473155 Oct 10 10:48:49.196706 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1218/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:48 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1488 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:49.201304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:49.213882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "cc4d9617-8d19-468f-ae51-56148d59eab0"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-unplugged", "status": "completed", "tag": "2cdf4285-725e-4f67-bc52-d7e2945c3b0b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:49.227718 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7f66871-7d1f-408e-821d-aa0bbe1b8af0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1272 microversion: 2.1 time: 0.204848 Oct 10 10:48:49.251770 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1136/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:49 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:49.270077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.270564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.270992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.275103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "tag": "92c413e4-9e62-4997-b57e-295b478d4a4e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:49.293288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.294027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.294612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.304361 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Creating event network-vif-unplugged:cc4d9617-8d19-468f-ae51-56148d59eab0 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:49.308288 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] Creating event network-vif-unplugged:2cdf4285-725e-4f67-bc52-d7e2945c3b0b for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:49.320370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5067036f-682e-4f05-b82d-684ef13b736b req-fdc5d229-de37-48c0-a3ee-736e61b91766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.114422 Oct 10 10:48:49.324278 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1219/2355] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:49.327363 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] Creating event network-changed:92c413e4-9e62-4997-b57e-295b478d4a4e for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:48:49.333370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:49.338738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:49.341410 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1ffbe5a9-1f70-40b0-a2bf-7b3e2a2a6a02 req-4299c7ab-f0a8-46c3-b969-6647bc8dd361 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088013 Oct 10 10:48:49.346182 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1137/2356] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:49.359111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:49.359111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:49.363559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.364063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.364503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.365213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.365669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.366094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.375349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.379612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.380214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.381118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.381723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.382293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.944528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:49.959540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f2951ab-31a9-4171-9a49-a328629ce1d5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 0.628544 Oct 10 10:48:49.979081 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1220/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:49 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:49.985798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-905639593"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:49.988654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:49.995319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.996154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:49.996838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:49.997828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:49.997942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:49.999603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.000292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.020289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:50.026207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:50.030863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10b586c1-3b4b-4888-85aa-aa84dc982fa4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.681452 Oct 10 10:48:50.053034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1138/2358] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:49 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:50.082083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:50.084832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:50.096485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.098369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.099137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.100100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.100736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.107227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.191108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:50.253136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d7e5bd2-c6b0-42f0-885e-e03dfd736271 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "POST /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea/action" status: 202 len: 0 microversion: 2.1 time: 0.271287 Oct 10 10:48:50.254036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1221/2359] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:48:49 2022] POST /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:48:50.269207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:50.270157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:50.293149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.293836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.299570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.300594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.302370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.308931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.760389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:50.787655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:50.794101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:50.797174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9a708b8-094d-4949-9ea3-e07319a95349 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2867 microversion: 2.42 time: 0.741171 Oct 10 10:48:50.797756 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1139/2360] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:50 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2867 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:50.805418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:50.806061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:50.815310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.816009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.817194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:50.818637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:50.819274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:50.819867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.008396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:51.017463 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41e16b7d-5ad1-4210-a4c2-3ce24edb0a6e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.762101 Oct 10 10:48:51.027813 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1222/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:50 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:51.039153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef69f27a-c624-455f-86fa-c39fe79615fd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c85aca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:51.093509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef69f27a-c624-455f-86fa-c39fe79615fd tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7" status: 200 len: 1413 microversion: 2.1 time: 0.064313 Oct 10 10:48:51.102441 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1223/2362] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:51 2022] GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:51.109338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:51.118132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:51.128629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:51.139916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:51.140704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.141725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:51.142378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:51.143047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.446895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:51.457453 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f926b803-eb0a-42ae-9c02-ebf1cd619bb3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.658659 Oct 10 10:48:51.468210 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1140/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:50 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:51.505253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:51.509560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:51.527230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:51.527925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:51.528518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.533027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:51.533702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:51.534318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.695839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:51.704376 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd2f83df-e4e2-4ffb-8246-d7f09a9855cb tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 0.600544 Oct 10 10:48:51.709486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1224/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:51 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:51.718320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ee7f294-077a-4338-8c12-f942fb7a066c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f67779959d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:51.792642 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ee7f294-077a-4338-8c12-f942fb7a066c tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7" status: 200 len: 1413 microversion: 2.1 time: 0.081728 Oct 10 10:48:51.797274 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1225/2365] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:51 2022] GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:51.807643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-deleted", "tag": "cc4d9617-8d19-468f-ae51-56148d59eab0"}, {"name": "network-changed", "server_uuid": "0357bf0a-70fd-4e63-b187-29a3df63575a", "tag": "790da0de-4219-41e7-8879-198f90a35111"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:51.832954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:51.836153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:51.836995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:51.896748 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Creating event network-vif-deleted:cc4d9617-8d19-468f-ae51-56148d59eab0 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:51.897480 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] Creating event network-changed:790da0de-4219-41e7-8879-198f90a35111 for instance 0357bf0a-70fd-4e63-b187-29a3df63575a on n-h2-860687-2 Oct 10 10:48:51.920901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-95da310f-c4cc-428a-955d-22cf1f383461 req-df31eb5b-ba2c-44c8-a27b-b55254454b0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.121595 Oct 10 10:48:51.923757 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1226/2366] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:51.936904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10952341-e1a8-4b4b-a10d-872d690ddac8 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f6777af5280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:52.178321 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10952341-e1a8-4b4b-a10d-872d690ddac8 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7" status: 204 len: 0 microversion: 2.1 time: 0.251220 Oct 10 10:48:52.180555 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1227/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:51 2022] DELETE /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:52.190898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:52.192166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:52.203196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:52.204359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:52.204976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:52.206433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:52.207563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:52.209064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:53.336375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.365638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.370469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.390073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c272d736-6211-4a03-ba8a-f1bd6d4cbd26 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 1.919951 Oct 10 10:48:53.391418 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1141/2368] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:51 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:53.398109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:53.413210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:53.435221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:53.436128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:53.436814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:53.437919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:53.438603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:53.439282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:53.646320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.666027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.669024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:53.674735 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11fd5dbd-a3e4-4f46-98ca-990a96ae8e49 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2485 microversion: 2.42 time: 1.492814 Oct 10 10:48:53.688080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1228/2369] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:52 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2485 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:53.706883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4cce3aae-727b-4ad9-b63f-3df51d264980 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c7de310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:53.740957 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4cce3aae-727b-4ad9-b63f-3df51d264980 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Image not found. Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4cce3aae-727b-4ad9-b63f-3df51d264980 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 HTTP/1.1 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a76f7ba4-daec-4b04-beee-c6923920fac7'} Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a76f7ba4-daec-4b04-beee-c6923920fac7 Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:48:53.743626 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a76f7ba4-daec-4b04-beee-c6923920fac7 could not be found. Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4cce3aae-727b-4ad9-b63f-3df51d264980 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4cce3aae-727b-4ad9-b63f-3df51d264980 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7" status: 404 len: 62 microversion: 2.1 time: 0.055364 Oct 10 10:48:53.747630 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1229/2370] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:48:53 2022] GET /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:48:53.762690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:53.765696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:53.782840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:53.786585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:53.790201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:53.791401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:53.792056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:53.793067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:54.446318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:54.461315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-776bbcb7-ee59-4961-b63a-ed56bc8ea19a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 1.064617 Oct 10 10:48:54.476369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1142/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:53 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:54.480857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:54.496184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:54.497631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:54.498925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:54.578341 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] Creating event network-changed:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:48:54.588700 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1387e10b-3d57-4d05-b7c9-cc52ea513390 req-4942eaad-d6ca-4fab-aaa8-e91771635933 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117098 Oct 10 10:48:54.593314 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1143/2372] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:54.606057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:54.607946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:54.608190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:54.621089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:54.624286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9988b2c-450b-4330-9258-6e33cbc527b4 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.877135 Oct 10 10:48:54.624862 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1230/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:53 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:54.626176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:54.626980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:54.628020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:54.629558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:54.630163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:54.630290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:54.630802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:54.648869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:54.649370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:54.649813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:54.650526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:54.651036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:54.651438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.227752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.236434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.250415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1fb6fd92-543b-455e-9fdc-e0e5138203ee tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 0.654909 Oct 10 10:48:55.251547 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1144/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:54 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:55.252715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75e907b8-f111-409d-bc2f-985a7b8ca93f tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1488 microversion: 2.1 time: 0.626454 Oct 10 10:48:55.267497 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1231/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:54 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1488 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:55.267729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-deleted", "tag": "198e4aa3-6b8a-4203-be82-10cfce441ef5"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-deleted", "tag": "3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:55.267869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:55.274498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:55.274719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.275347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.275839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.286440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.293812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.294596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.296220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.296702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.297662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.300786 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Creating event network-vif-deleted:198e4aa3-6b8a-4203-be82-10cfce441ef5 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:55.302972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] Creating event network-vif-deleted:3f4d0fa0-a0c7-46a7-9f96-f995d4a875c2 for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:55.309972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f82c8fc9-5407-470f-bd14-49851332185d req-e61daa6e-836e-41c6-9104-1f1342fce8d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056897 Oct 10 10:48:55.315801 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1145/2376] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:55.328677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:55.335613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:55.352294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.358824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.359608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.360552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.366533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.367271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.695790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:55.730928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=26 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:55.860797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.885163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.886299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.894270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.898274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0d2e2ab-3973-4236-8a00-5e9e6ffd4cbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.643622 Oct 10 10:48:55.899493 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1232/2377] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:55 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:55.906634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:55.907353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:55.916295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.917163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.917797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.918725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.919411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.920859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.926155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.930053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:55.932914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2197d935-62a3-4745-bb08-4328398a582c tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 2325 microversion: 2.42 time: 0.615583 Oct 10 10:48:55.933527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1146/2378] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:55 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 2325 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:55.971832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:55.975232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:55.983401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.993454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:48:55.993731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.994330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:55.995310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:55.998850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:55.999902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:56.129040 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b3a8a4b9-9fd5-4919-8c76-c5fe8017388e tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 204 len: 0 microversion: 2.1 time: 0.227625 Oct 10 10:48:56.130575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1233/2379] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:48:55 2022] DELETE /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:56.149914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:56.152166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:56.163865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:56.164871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:56.166309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:56.167597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:56.175041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:56.175890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.032662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.050765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.057901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f255078-580f-45e2-9c25-b3989a3c2849 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 1.097074 Oct 10 10:48:57.062517 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45a54595-7a1f-4b29-ae97-2adc1ece8f94 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.930289 Oct 10 10:48:57.063152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1234/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:56 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:57.067759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c3b2318-55d3-466c-82ec-1bfdd2f2eef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f67779ded30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.082409 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1147/2381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:55 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:57.095058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-plugged", "status": "completed", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:57.127104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.128142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.128754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.149418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8c3b2318-55d3-466c-82ec-1bfdd2f2eef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Image not found. Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c3b2318-55d3-466c-82ec-1bfdd2f2eef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 HTTP/1.1 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a76f7ba4-daec-4b04-beee-c6923920fac7'} Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a76f7ba4-daec-4b04-beee-c6923920fac7 to delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a76f7ba4-daec-4b04-beee-c6923920fac7 could not be found. Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.151667 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:48:57.156866 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:48:57.158283 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] Creating event network-vif-plugged:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:48:57.159753 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8da6aeb1-eaf6-4629-ab44-e7056f33896d req-b1972b39-4534-4277-b6c5-19e989b56755 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074913 Oct 10 10:48:57.159878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c3b2318-55d3-466c-82ec-1bfdd2f2eef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:48:57.159990 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1148/2382] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:57.161046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c3b2318-55d3-466c-82ec-1bfdd2f2eef3 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7" status: 404 len: 62 microversion: 2.1 time: 0.096971 Oct 10 10:48:57.162019 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1235/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:57 2022] DELETE /compute/v2.1/images/a76f7ba4-daec-4b04-beee-c6923920fac7 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:48:57.169008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.169731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:57.170385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d8f186-3cf1-4caa-93e7-67caef14166b", "tag": "ba2c123e-7d3f-4b48-baf2-3262b0eadc0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:57.185047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.187159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.187775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.188674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.189488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.190076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.192999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.193488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.193934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.225072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] Creating event network-changed:ba2c123e-7d3f-4b48-baf2-3262b0eadc0d for instance 13d8f186-3cf1-4caa-93e7-67caef14166b on n-h1-860687-2 Oct 10 10:48:57.233391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f2da5081-4c31-4c8c-bcd2-c1002201f669 req-ff10a2fe-f078-4a66-8aae-45ad139a2980 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069879 Oct 10 10:48:57.234104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1236/2384] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:57.239373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.251172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:57.257934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.258433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.258874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.259820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.260279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.260922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.657903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.667297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.668745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.670519 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d3bf2fa-fb46-46aa-be40-727183c9135a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.434496 Oct 10 10:48:57.676282 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1237/2385] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:57 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:57.683339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.684407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:57.697463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.700041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.702620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.704079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.704847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.705612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.724437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.732529 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-296c446e-f0be-4105-b447-a8a148342d25 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 0.571145 Oct 10 10:48:57.735668 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1149/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:57 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:57.751393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.752141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:57.758555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.762148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.762784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.766058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.766809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.767504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.803134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:48:57.836006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.867675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.869207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:57.878087 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7350178-8ed2-475c-93b7-89893b58bf2b tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.200245 Oct 10 10:48:57.878696 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1238/2387] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:57 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:57.912965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-deleted", "tag": "2cdf4285-725e-4f67-bc52-d7e2945c3b0b"}, {"name": "network-changed", "server_uuid": "d4de5790-f609-4d97-85eb-67dd74576ca9", "tag": "6b378f05-1810-4387-9fe6-ce011c572782"}, {"server_uuid": "e7fff432-7a1b-4740-af08-78b82d1fea83", "name": "network-vif-deleted", "tag": "cfddb5ce-0ba5-48b3-a0ea-9a684b78719d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:48:57.925417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Instance is already in deleting state, ignoring this request Oct 10 10:48:57.929877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.930861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.931022 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97137bdb-05e7-4135-a7d2-a7d0099f3ec7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 204 len: 0 microversion: 2.1 time: 0.186064 Oct 10 10:48:57.931602 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1150/2388] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:48:57 2022] DELETE /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:48:57.931715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.944965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:57.946430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:57.950505 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Creating event network-vif-deleted:2cdf4285-725e-4f67-bc52-d7e2945c3b0b for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:57.952401 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Creating event network-changed:6b378f05-1810-4387-9fe6-ce011c572782 for instance d4de5790-f609-4d97-85eb-67dd74576ca9 on n-h2-860687-2 Oct 10 10:48:57.953165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] Creating event network-vif-deleted:cfddb5ce-0ba5-48b3-a0ea-9a684b78719d for instance e7fff432-7a1b-4740-af08-78b82d1fea83 on n-h1-860687-2 Oct 10 10:48:57.953940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.954474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.954950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.955680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:57.956293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:57.956982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:57.974631 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ee4ca632-ee95-4efc-85c6-0ab8a7656ab5 req-0ade0f8e-5d3d-4d22-a73c-4daa1b29d157 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.094605 Oct 10 10:48:57.975786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1239/2389] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:48:58.089263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:58.094192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:58.105070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.106793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.107736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.109193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.110068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.111324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.176273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:58.189565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bf8883d-ba06-47c0-9ca1-c5654797f33a tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1494 microversion: 2.1 time: 0.250350 Oct 10 10:48:58.190097 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1151/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:57 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1494 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:58.194666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:58.199978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:58.218471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.219287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.219887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.221426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.222864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.223582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.413806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:58.423369 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d31e82c5-be78-41df-981b-c8a2ead95a97 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.341387 Oct 10 10:48:58.430202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1240/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:58 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:58.459681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:58.472188 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc20a09f-5d93-4ac2-9e11-845cefcc8ff2 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.280966 Oct 10 10:48:58.473145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1152/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:58 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:58.703407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:58.703952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:58.717719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.718408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.718858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.723883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.724532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.725117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.762123 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 10:48:58.762123 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 10:48:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a (ip 10.222.0.16) !!! Oct 10 10:48:58.769064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:58.770935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:58.797368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.798243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.800751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.801769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:58.802447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:58.828135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:58.868472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:48:59.868372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:59.877972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:59.892999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:59.894438 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03df350f-cab0-41a6-8027-4beca19a573b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 1.197834 Oct 10 10:48:59.895246 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1241/2393] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:58 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:48:59.900578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:59.901460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:48:59.913426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:59.914155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:59.917252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:59.918223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:48:59.923165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:48:59.924024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:48:59.972706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:48:59.986531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e727fc1-66b9-47d5-a502-4d73397246b9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1316 microversion: 2.1 time: 1.227124 Oct 10 10:48:59.988971 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1153/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:58 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1316 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:48:59.994406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:48:59.995314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:00.004957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.005780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.006454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.007443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.008560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.009810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.127895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.134452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:00.137935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.148606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.149879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2156a80c-6c0e-4d1f-a1b3-0a4041195292 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.253548 Oct 10 10:49:00.163514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1242/2395] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:48:59 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:00.169546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57449e95-d15e-4650-a96c-bad0e6bfbeea", "name": "network-vif-plugged", "status": "completed", "tag": "f029953e-01ee-42da-b655-b0d6317c5bbc"}, {"server_uuid": "57449e95-d15e-4650-a96c-bad0e6bfbeea", "name": "network-vif-unplugged", "status": "completed", "tag": "f029953e-01ee-42da-b655-b0d6317c5bbc"}, {"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-plugged", "status": "completed", "tag": "fbf1dcdb-065c-421d-9cb7-089d8eaff412"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:00.178021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f07854e54a44689b1067dbcd0ec464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96c90e82e5b41a2aac96bdc91e06c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.191771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ca65cf9-bc73-42ff-99a3-5dc4042b3946 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 200 len: 1452 microversion: 2.1 time: 0.201098 Oct 10 10:49:00.193560 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1154/2396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:48:59 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:00.210020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:00.211447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:00.218569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.219089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.219919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.232635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.234727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.235461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.239143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.239899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.240911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.259867 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Creating event network-vif-plugged:f029953e-01ee-42da-b655-b0d6317c5bbc for instance 57449e95-d15e-4650-a96c-bad0e6bfbeea on n-h1-860687-2 Oct 10 10:49:00.260380 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Creating event network-vif-unplugged:f029953e-01ee-42da-b655-b0d6317c5bbc for instance 57449e95-d15e-4650-a96c-bad0e6bfbeea on n-h1-860687-2 Oct 10 10:49:00.260883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] Creating event network-vif-plugged:fbf1dcdb-065c-421d-9cb7-089d8eaff412 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:00.290946 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b1e95501-fce9-49a7-a590-d0d33d83aebd req-841b4f69-55ef-4619-8fa9-e1c4a2ff1a1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.126048 Oct 10 10:49:00.291602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1243/2397] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:00.297385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:00.302187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:00.313093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.319731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.320418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.321308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.321921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.322500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.696991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.707468 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f351c76-f3eb-44cd-a797-da58ef9f05bd tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.511008 Oct 10 10:49:00.708060 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1155/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:00 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:00.715626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57449e95-d15e-4650-a96c-bad0e6bfbeea", "name": "network-vif-deleted", "tag": "f029953e-01ee-42da-b655-b0d6317c5bbc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:00.726106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:00.734406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.735137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.735726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.737803 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fbbb79e9-96b4-44d9-b0a0-7a8b8bd2cdf7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.445035 Oct 10 10:49:00.738518 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1244/2399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:00 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:00.763202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] Creating event network-vif-deleted:f029953e-01ee-42da-b655-b0d6317c5bbc for instance 57449e95-d15e-4650-a96c-bad0e6bfbeea on n-h1-860687-2 Oct 10 10:49:00.769442 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-128a227e-84bd-4ffb-b813-10bf25261791 req-a46c72ae-64a4-44ab-840b-8b391a4f9984 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057316 Oct 10 10:49:00.770419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1156/2400] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:00.923796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:00.924408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:00.942720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.943255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.943689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:00.944582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:00.945199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:00.945625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.017187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.017978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.026978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.027549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.028167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.030372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.031095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.031693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.229412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.239133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.247596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.249982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f615475a-3ab9-43ef-b65b-52aef762d75d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.330659 Oct 10 10:49:01.264188 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1245/2401] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:00 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:01.274900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.275561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.283077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.283799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.284612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.285475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.286109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.286736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.298386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.309562 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e551f208-855f-4f0e-8243-26a508697ef5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1466 microversion: 2.1 time: 0.297867 Oct 10 10:49:01.313005 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1157/2402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1466 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:01.322072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.324438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 57449e95-d15e-4650-a96c-bad0e6bfbeea] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.337796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.338546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.341253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.342201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.342815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.343416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.374346 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea HTTP/1.1 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '57449e95-d15e-4650-a96c-bad0e6bfbeea'} Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.384964 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. Oct 10 10:49:01.389622 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.391036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance 57449e95-d15e-4650-a96c-bad0e6bfbeea could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.392075 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c74bed7-7e5f-4929-9c3e-82b76d76dd78 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea" status: 404 len: 111 microversion: 2.1 time: 0.077955 Oct 10 10:49:01.392804 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1158/2403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/57449e95-d15e-4650-a96c-bad0e6bfbeea => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:01.397988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1976065663", "metadata": {"image_type": "test"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:01.404071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.410679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.411426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.412267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.413130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.413734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.414310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.421665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.442924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.445108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:01.446513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c81da6ee-76c8-4ff2-972e-753efaf421a2 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.180831 Oct 10 10:49:01.447264 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1246/2404] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:01.453954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-436c42fb-4ae6-4565-8ade-3c5bf5cacae2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c9a8e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.482249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Getting quotas for project 59dd868a1eb44951b5aca992f87527cb. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:49:01.488375 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-436c42fb-4ae6-4565-8ade-3c5bf5cacae2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Image not found. Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-436c42fb-4ae6-4565-8ade-3c5bf5cacae2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 HTTP/1.1 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2f42a425-d059-4742-8cf2-9758b4de9b72'} Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f42a425-d059-4742-8cf2-9758b4de9b72 to delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f42a425-d059-4742-8cf2-9758b4de9b72 could not be found. Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.490505 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-436c42fb-4ae6-4565-8ade-3c5bf5cacae2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-436c42fb-4ae6-4565-8ade-3c5bf5cacae2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72" status: 404 len: 62 microversion: 2.1 time: 0.043622 Oct 10 10:49:01.495804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1247/2405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] DELETE /compute/v2.1/images/2f42a425-d059-4742-8cf2-9758b4de9b72 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:49:01.500891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.500891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.504521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Getting quotas for user 2ad413c40d2e45ce9fb7183d9afbbafe and project 59dd868a1eb44951b5aca992f87527cb. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:49:01.518987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.519513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.522365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.523095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.523570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.527503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.556229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 HTTP/1.1 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'af2c38ec-9055-4748-bca2-2d4208c28b12'} Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:01.557511 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fe95f56-44be-4e2f-9ece-6cd5217b2e73 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 404 len: 111 microversion: 2.1 time: 0.062470 Oct 10 10:49:01.563901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1248/2406] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:49:01 2022] DELETE /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:01.570144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.570862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: af2c38ec-9055-4748-bca2-2d4208c28b12] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.589507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.590130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.590671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.592456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.593028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.593700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.609660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 HTTP/1.1 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'af2c38ec-9055-4748-bca2-2d4208c28b12'} Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.611405 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.616459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance af2c38ec-9055-4748-bca2-2d4208c28b12 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.617341 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1412f882-ff59-41ed-8871-c49354552924 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12" status: 404 len: 111 microversion: 2.1 time: 0.050684 Oct 10 10:49:01.618421 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1249/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/af2c38ec-9055-4748-bca2-2d4208c28b12 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:01.626401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1230d122-5ae2-4d38-9e22-3f6e04a797a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c7d9280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.650195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-1230d122-5ae2-4d38-9e22-3f6e04a797a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Image not found. Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1230d122-5ae2-4d38-9e22-3f6e04a797a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa HTTP/1.1 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'addca65b-33c1-42ea-93c5-3a255ab30daa'} Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image addca65b-33c1-42ea-93c5-3a255ab30daa to delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image addca65b-33c1-42ea-93c5-3a255ab30daa could not be found. Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.652503 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1230d122-5ae2-4d38-9e22-3f6e04a797a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.657716 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1230d122-5ae2-4d38-9e22-3f6e04a797a7 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa" status: 404 len: 62 microversion: 2.1 time: 0.031636 Oct 10 10:49:01.663023 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1250/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] DELETE /compute/v2.1/images/addca65b-33c1-42ea-93c5-3a255ab30daa => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 10:49:01.664516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.665020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.674507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.675072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.675494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.676212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.676676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.677361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.692935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 HTTP/1.1 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '823962d3-3b20-49d9-aa15-d65509912a74'} Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:01.694532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.698804 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82e0fb29-08dd-4e2f-b1bc-5f67c26a5e79 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 404 len: 111 microversion: 2.1 time: 0.035334 Oct 10 10:49:01.699773 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1251/2409] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:49:01 2022] DELETE /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:01.705434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.706731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 823962d3-3b20-49d9-aa15-d65509912a74] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.713787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.714288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.714733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.715494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.716210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.716709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.731900 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 HTTP/1.1 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '823962d3-3b20-49d9-aa15-d65509912a74'} Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.734055 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. Oct 10 10:49:01.740707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.742386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance 823962d3-3b20-49d9-aa15-d65509912a74 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.744488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d69b5d08-9605-4e7e-9e96-d0588020d5a5 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74" status: 404 len: 111 microversion: 2.1 time: 0.043010 Oct 10 10:49:01.750389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1252/2410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/823962d3-3b20-49d9-aa15-d65509912a74 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:01.753030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.753650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.759955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.760565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.760996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.761875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.762484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.763093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.900428 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e9b71c6-38fe-4bc3-817c-63e940fddc66 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "POST /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a/action" status: 202 len: 0 microversion: 2.1 time: 0.505723 Oct 10 10:49:01.901147 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1159/2411] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:01 2022] POST /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:49:01.908988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06fcbb0a-f149-4553-af65-39e090fd6e00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '.version_select at 0x7f677c3c54c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.938312 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-06fcbb0a-f149-4553-af65-39e090fd6e00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Image not found. Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06fcbb0a-f149-4553-af65-39e090fd6e00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb HTTP/1.1 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: exception: Image not found. Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '32cf50f9-88cd-41fe-9ed3-c556627949fb'} Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 32cf50f9-88cd-41fe-9ed3-c556627949fb to delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32cf50f9-88cd-41fe-9ed3-c556627949fb could not be found. Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.940647 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06fcbb0a-f149-4553-af65-39e090fd6e00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06fcbb0a-f149-4553-af65-39e090fd6e00 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb" status: 404 len: 62 microversion: 2.1 time: 0.040248 Oct 10 10:49:01.944373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1160/2412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] DELETE /compute/v2.1/images/32cf50f9-88cd-41fe-9ed3-c556627949fb => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:49:01.949998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:01.950745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:01.962441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.962947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.963532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:01.964255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:01.964713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:01.965140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.251360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.267719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-832d057a-d032-4876-b6f5-441ac45bba6b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.518306 Oct 10 10:49:02.268328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1253/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:02.273408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a17d2b1-e9ab-4f9b-8583-970afaae5274 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6777af5310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:02.314136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.324551 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6409f5e-34c2-423b-b2b1-a617b5d440fb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.380353 Oct 10 10:49:02.355719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1161/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:01 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:02.366666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a17d2b1-e9ab-4f9b-8583-970afaae5274 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.097144 Oct 10 10:49:02.367275 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1254/2415] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:02 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:02.375147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:02.375147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:02.380017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:02.381948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.384978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:02.387059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.390256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.393291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.393969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.394550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.402517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.406382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.407812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.408695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.411832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.413511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.441622 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 HTTP/1.1 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7ab5ee1d-7e41-410f-93ed-ca2621aed2a8'} Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:02.448699 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47436f1e-e0d7-4677-b45a-05aa2a11e1c2 tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 404 len: 111 microversion: 2.1 time: 0.093351 Oct 10 10:49:02.453865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1162/2416] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:49:02 2022] DELETE /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:02.461256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-plugged", "status": "completed", "tag": "5bbba364-5186-4738-a18d-2dcff21518a1"}, {"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-plugged", "status": "completed", "tag": "92c413e4-9e62-4997-b57e-295b478d4a4e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:02.487126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.488485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.488935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.513552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Creating event network-vif-plugged:5bbba364-5186-4738-a18d-2dcff21518a1 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:02.519960 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] Creating event network-vif-plugged:92c413e4-9e62-4997-b57e-295b478d4a4e for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:02.528668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-05d3810c-0971-4eb9-89a4-6e0f0f28c966 req-0abecc83-6e07-46a5-af3e-a31e0f4e7445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073403 Oct 10 10:49:02.530331 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1163/2417] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:02.554900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:02.555862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] [instance: 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:02.565570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.566005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.575221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.576264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.576952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.577415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.606677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] HTTP exception thrown: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Request method failure captured: Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 HTTP/1.1 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_eSZy22MThiUAaE5_huw72AqTMoat3Q9UC1ESpooPhRIf1KSQyIrw4ybzgQIBTlScowQTKviXc9EdMVawFtaGytaeFqM9MAqJXDUNkAG98M6YNHY5q-aYMA2kekdhDBICgeAjcgQj6wpCnqLg9x1KDYtJL9cq5QwCxqvaintfPEozw Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f96c90e82e5b41a2aac96bdc91e06c61", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f96c90e82e5b41a2aac96bdc91e06c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f96c90e82e5b41a2aac96bdc91e06c61"}]}] Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f96c90e82e5b41a2aac96bdc91e06c61 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-1688389119 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 53f07854e54a44689b1067dbcd0ec464 Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-1688389119-project Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7ab5ee1d-7e41-410f-93ed-ca2621aed2a8'} Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.614720 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] Returning 404 to user: Instance 7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:02.619358 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-012e6fe1-c84e-4c66-8c21-31c8fe894d2d tempest-ImagesTestJSON-1688389119 tempest-ImagesTestJSON-1688389119-project] 10.222.0.16 "GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8" status: 404 len: 111 microversion: 2.1 time: 0.084520 Oct 10 10:49:02.627837 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1164/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:02 2022] GET /compute/v2.1/servers/7ab5ee1d-7e41-410f-93ed-ca2621aed2a8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:02.632550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:02.633179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:02.652704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.653200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.653840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.654792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:02.655435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:02.656015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:02.884537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.898038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.913052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.914290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.915994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.917854 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c9e2116-b412-4bd6-8778-ef3cec484cfc tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.289383 Oct 10 10:49:02.926311 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1165/2419] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:02 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:02.930646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:02.931922 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9580a79f-b94d-4ed6-a492-f2d4b215c871 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.560093 Oct 10 10:49:02.932486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1255/2420] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:02 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:03.296023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:03.296878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:03.309947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.315486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:03.317694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:03.318442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.319854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:03.320450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:03.361288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:03.361897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:03.369228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.369707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:03.370349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:03.371243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.371852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:03.372430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:03.864776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:03.879219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a830c6e-6f9f-44a4-8aa1-9f7d5fb7eefd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.518010 Oct 10 10:49:03.887352 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1256/2421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:03 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:03.892726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c3c5270-b77e-474d-87ae-be8432efa281 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c9a8280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:03.963736 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c3c5270-b77e-474d-87ae-be8432efa281 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.074660 Oct 10 10:49:03.967495 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1257/2422] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:03 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:03.978505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:03.980294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:03.994509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.995074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:03.995502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:03.998464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:03.999719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.000166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.002768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.014522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50176ac6-e675-4820-a719-7eac3060d48f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1355 microversion: 2.1 time: 0.722312 Oct 10 10:49:04.028548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1166/2423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:03 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1355 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:04.037437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:04.039736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:04.047845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:04.048670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.049816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.050681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:04.051330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.051911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.209251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.226155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.236028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.243963 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7fb7604e-e782-4f98-b530-b18ce8d011d8 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.214262 Oct 10 10:49:04.245965 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1167/2424] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:04 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:04.433500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.445601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.447367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:04.448836 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dcf7d845-b48f-4663-9f10-2774e10e840a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.480399 Oct 10 10:49:04.463804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1258/2425] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:03 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:04.583816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f186-3cf1-4caa-93e7-67caef14166b", "name": "network-vif-plugged", "status": "completed", "tag": "ba2c123e-7d3f-4b48-baf2-3262b0eadc0d"}, {"server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "name": "network-vif-plugged", "status": "completed", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:04.599031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:04.599743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.600337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.615458 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Creating event network-vif-plugged:ba2c123e-7d3f-4b48-baf2-3262b0eadc0d for instance 13d8f186-3cf1-4caa-93e7-67caef14166b on n-h1-860687-2 Oct 10 10:49:04.619242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] Creating event network-vif-plugged:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:49:04.629371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6a0cd73e-3ca2-460d-adcc-98627de52eca req-0621b2e6-c8c7-43c8-a4b5-05ee4785077b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050332 Oct 10 10:49:04.630538 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1168/2426] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:04.905137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:04.905761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:04.914583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:04.915100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.915547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.919373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:04.921995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:04.922781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:04.983279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43129cd9-9631-46ae-bca2-b2d8836e611d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d0fca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.050645 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43129cd9-9631-46ae-bca2-b2d8836e611d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.071869 Oct 10 10:49:05.055074 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1169/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:04 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:05.070224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.072373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.093543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.094306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.094905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.095815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.096475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.097058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.276060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.287613 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48b997e4-12df-47c7-bf82-c317213ce973 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.386617 Oct 10 10:49:05.294604 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1259/2428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:04 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:05.302028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.306260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.314249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.314752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.315241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.315990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.316455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.316888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.391920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.408911 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1492d811-f4cb-47c9-98a7-25ddb82db66f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1806 microversion: 2.1 time: 0.352566 Oct 10 10:49:05.433315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1170/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:05 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1806 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:05.456834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.459483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.476261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.476776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.477220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.478101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.478561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.480235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.505105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.522627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.524130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.525434 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff94f57a-b4e1-407a-a207-6d1174b030cf tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.229422 Oct 10 10:49:05.526015 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1260/2430] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:05 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:05.549538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.549761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-610b9c6a-ccdc-4386-b313-f52d4316090f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d/ips" status: 200 len: 219 microversion: 2.1 time: 0.096980 Oct 10 10:49:05.549761 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1171/2431] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:49:05 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d/ips => generated 219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:05.551313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.557865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.558420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.558865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.559743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.559858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.560792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.560904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.561231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.588294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.589268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.590345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.590531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.591189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.591654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.651109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:49:05.738806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:05.785967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3d2adfd-8664-42db-af96-8a4b4075f94a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 204 len: 0 microversion: 2.1 time: 0.230798 Oct 10 10:49:05.790384 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1172/2432] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:49:05 2022] DELETE /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:49:05.805360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:05.808841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:05.839252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.839914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.840372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.841434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:05.841894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:05.842474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:05.945289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.965588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.969960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:05.974129 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-941e99af-14d1-4148-ab05-99825cc0876c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.441530 Oct 10 10:49:05.989035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1261/2433] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:05 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:06.066054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d64030f-6770-4381-98aa-ea2aa0aa4cf7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677cbdbb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:06.153203 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d64030f-6770-4381-98aa-ea2aa0aa4cf7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.091222 Oct 10 10:49:06.162240 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1262/2434] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:06 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:06.319399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:06.320045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:06.339645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:06.340202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:06.340703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:06.341772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:06.349355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:06.349783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:06.489408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:06.522699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c38d308-9e75-43d7-b704-1205da0d364a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1812 microversion: 2.1 time: 0.729705 Oct 10 10:49:06.523659 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1173/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:05 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1812 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:06.558614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:06.559957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:06.581517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:06.583885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:06.585727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:06.586742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:06.594487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:06.596789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:06.614737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:06.624318 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb126236-76cb-4804-b8a3-d02d1b1dfd59 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.310250 Oct 10 10:49:06.635233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1263/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:06 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:06.849182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:06.859913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:06.867229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:06.874425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e42c1af4-67a7-4d5d-9f9e-5d8e952d2c39 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.318256 Oct 10 10:49:06.904542 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1174/2437] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:06 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:06.915424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4de5790-f609-4d97-85eb-67dd74576ca9", "name": "network-vif-plugged", "status": "completed", "tag": "6b378f05-1810-4387-9fe6-ce011c572782"}, {"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-plugged", "status": "completed", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:06.934498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:06.935017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:06.935535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:06.950263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Creating event network-vif-plugged:6b378f05-1810-4387-9fe6-ce011c572782 for instance d4de5790-f609-4d97-85eb-67dd74576ca9 on n-h2-860687-2 Oct 10 10:49:06.951042 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] Creating event network-vif-plugged:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:49:06.964876 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f88a3404-4873-4eae-bb08-b81b2bd47c63 req-771ef711-931e-4bda-9a00-e5fad466311f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053968 Oct 10 10:49:06.966037 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1264/2438] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:07.010452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:07.011505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:07.021819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.025192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.025921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:07.026876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.031173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.032951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:07.172541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e32e535-6846-4f89-ad84-2b8218ef5f21 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c85ac10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:07.262317 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e32e535-6846-4f89-ad84-2b8218ef5f21 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.095934 Oct 10 10:49:07.264415 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1265/2439] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:07 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:07.348887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:07.378789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:07.386394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:07.389131 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15ca3020-8b12-4d53-abf5-9a1c9c43fa91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1406 microversion: 2.20 time: 0.382643 Oct 10 10:49:07.392847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1175/2440] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:07 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:07.556765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:07.561151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:07.600418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.605938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.608093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:07.610248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.611070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.614154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:07.670264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:07.671759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:07.691065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.692662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.693400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:07.694603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:07.703639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:07.705017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:08.058914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:08.067830 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c4c1979-b9b8-4fda-850a-3a1119651f1c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1812 microversion: 2.1 time: 0.522032 Oct 10 10:49:08.071269 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1266/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:07 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1812 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:08.087030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:08.087934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:08.101228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:08.108289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:08.113814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:08.114883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:08.115429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:08.115887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:08.146724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:08.160482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74ec1440-d4f6-406d-b8bc-83b53d228077 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1314 microversion: 2.1 time: 0.505167 Oct 10 10:49:08.162837 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1176/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:07 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:08.232515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:08.251307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:08.252773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:08.253997 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-258413a9-f994-46ab-976b-fd1de4185ba6 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.181540 Oct 10 10:49:08.254581 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1267/2443] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:08 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:08.281981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41ca1b5a-6d11-4ca3-8adf-6b2966ca4af4 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d774c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:08.390219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41ca1b5a-6d11-4ca3-8adf-6b2966ca4af4 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.113250 Oct 10 10:49:08.406011 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1177/2444] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:08 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:08.422495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:08.423567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:08.437944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:08.439531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:08.441894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:08.443079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:08.444796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:08.447112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.023951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:09.045979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:09.051382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:09.054784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e88b939c-8bf4-4f10-ab37-053729560e89 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1597 microversion: 2.20 time: 0.636460 Oct 10 10:49:09.070871 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1268/2445] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:08 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1597 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:09.102632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:09.110966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:09.114360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:09.116348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:09.118671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:09.127585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.128213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.132053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.132922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.133632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.133906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.135121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.147823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.148667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.149650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.150339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.151051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.188666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:09.602220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4836ecf4-9a7f-4427-8c52-fc3255e2d4f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.504663 Oct 10 10:49:09.604360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1269/2446] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:49:09 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-interface => generated 284 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:49:09.609290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:09.610218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:09.632618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.635805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.636740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:09.638833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:09.641351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:09.643123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.026560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:10.043155 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47a71b44-9d4d-4715-b46c-761a0d1cab34 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1791 microversion: 2.1 time: 0.944519 Oct 10 10:49:10.048854 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1178/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:09 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1791 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:10.069379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:10.070313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:10.072890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:10.109560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:10.110871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:10.111513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.112820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:10.113437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:10.114578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.273182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:10.297990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf6950f3-4352-44da-ae6a-b87bcc2f6a06 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1463 microversion: 2.1 time: 0.692232 Oct 10 10:49:10.337525 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1270/2448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:09 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1463 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:10.355794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a948457-3d4c-45b7-bfe6-f294539bd5e4 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c856040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:10.372087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:10.408507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:10.409939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:10.432486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c51bde26-3d64-469d-b51b-5ff722b3c4a0 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.363373 Oct 10 10:49:10.433131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1179/2449] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:10 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:10.459396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-deleted", "tag": "fbf1dcdb-065c-421d-9cb7-089d8eaff412"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:10.464495 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a948457-3d4c-45b7-bfe6-f294539bd5e4 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.123637 Oct 10 10:49:10.465448 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1271/2450] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:10 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:10.478609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:10.480413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:10.481006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.483314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:10.484450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:10.516291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] Creating event network-vif-deleted:fbf1dcdb-065c-421d-9cb7-089d8eaff412 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:10.519358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:10.519876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:10.520328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.521063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:10.527599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:10.528174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:10.529617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ccc0c8e-ac33-47c4-922d-7cc761c66119 req-d708ade7-fa07-4f31-9cb9-9bef0bcecc2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094337 Oct 10 10:49:10.532949 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1180/2451] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:11.002558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:11.020053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc8d8cd4-f571-43d5-a3f8-f96471044c40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1463 microversion: 2.1 time: 0.546185 Oct 10 10:49:11.024372 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1272/2452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:10 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:11.078257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:11.078960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:11.091351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:11.092345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:11.092784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:11.093493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:11.093947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:11.094372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:11.296296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2035247286", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "13d8f186-3cf1-4caa-93e7-67caef14166b"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:11.398226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:49:11.782303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:11.804220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9bd66be-b7e3-4b29-9afa-362be2c4a796 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1632 microversion: 2.1 time: 0.727674 Oct 10 10:49:11.837724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1181/2453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:11 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1632 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:11.849438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:11.852967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:11.874963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:11.875883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:11.878943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:11.881801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:11.882531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:11.884817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:11.976578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:49:11.977059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:49:11.977542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:49:11.978390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:49:11.978813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:49:11.994217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:11.999944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:12.000784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:12.008129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:12.009511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:12.010982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:12.066153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:49:12.072440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Getting quotas for user 26acf3a710d548238d3fc19da3cc2376 and project beb8bd8b1ca54f8584cd48cff8a0a41b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:49:12.088463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:12.092917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:49:12.095613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:49:12.122524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:12.124785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:12.130878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-feea2da2-6471-4562-8131-bdfdb1e6e220 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.291682 Oct 10 10:49:12.131658 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1182/2454] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:11 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:12.151363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d31c5448-10ac-4098-8163-39b047b1b9b2 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d0fca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:12.169995 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e37e2395-9ae3-4da3-b7f3-d3d8bd21f599 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877592 Oct 10 10:49:12.182364 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1273/2455] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:49:12.195784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-08c56c53-3c8b-46c7-a8fd-6125a4c6a19f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:12.208770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-08c56c53-3c8b-46c7-a8fd-6125a4c6a19f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:12.267904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d31c5448-10ac-4098-8163-39b047b1b9b2 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.129341 Oct 10 10:49:12.274095 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1183/2456] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:12 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:12.486249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-unplugged", "status": "completed", "tag": "92c413e4-9e62-4997-b57e-295b478d4a4e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:12.518280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:12.519132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:12.519671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:12.546512 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] Creating event network-vif-unplugged:92c413e4-9e62-4997-b57e-295b478d4a4e for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:12.558403 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e804fa9e-4884-45ab-9f81-5ace2604c739 req-0bb6bb5b-653b-4bfa-89aa-dcd76073cf60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076393 Oct 10 10:49:12.561316 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1184/2457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:49:12.833030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:12.833847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:12.848793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:12.851804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:12.853598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:12.858009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:12.859518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:12.860666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:13.265318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-08c56c53-3c8b-46c7-a8fd-6125a4c6a19f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:13.275348 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-08c56c53-3c8b-46c7-a8fd-6125a4c6a19f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1214 microversion: 2.1 time: 1.083657 Oct 10 10:49:13.302273 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1274/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:12 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1214 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:13.322100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:13.324974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:13.338901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:13.341789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:13.345303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:13.349643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:13.353127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:13.354736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:13.642444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:13.654329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:13.662850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:13.664170 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02defee7-e293-4481-a70b-c56ffb6a9113 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.357144 Oct 10 10:49:13.664752 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1275/2459] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:13 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:13.679272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8a50d76-1d1f-412e-9749-568fa91c7361 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca50670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:13.691522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:13.706708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20a33648-f6f6-4a15-b4ad-19c0a67d6d16 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1632 microversion: 2.1 time: 0.878249 Oct 10 10:49:13.707362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1185/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:12 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1632 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:13.770647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8a50d76-1d1f-412e-9749-568fa91c7361 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.096381 Oct 10 10:49:13.772092 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1276/2461] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:13 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:14.246985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-deleted", "tag": "5bbba364-5186-4738-a18d-2dcff21518a1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:14.264411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.275799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.276534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.305959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:14.308096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:14.320242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.325445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.327543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.327952 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] Creating event network-vif-deleted:5bbba364-5186-4738-a18d-2dcff21518a1 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:14.328978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.334581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.336882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.354027 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f13544f0-5600-49d7-98e1-f050f4b97b32 req-d2a4f605-fc4a-437d-9b50-cafc8fc5516b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111172 Oct 10 10:49:14.358268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1186/2462] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:14.608938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:14.616992 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9916548e-f232-446e-85ad-b19445a8edfd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1266 microversion: 2.1 time: 0.315215 Oct 10 10:49:14.621124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-unplugged", "status": "completed", "tag": "5bbba364-5186-4738-a18d-2dcff21518a1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:14.621838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1277/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:14 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:14.650243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.652331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.652968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.681147 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] Creating event network-vif-unplugged:5bbba364-5186-4738-a18d-2dcff21518a1 for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:14.693885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:14.694661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:14.698190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2e7444c0-a5cf-4487-85e8-7c49c1fad222 req-fe181257-3f38-4e18-a6e2-18c45234d8b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081401 Oct 10 10:49:14.703561 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1187/2464] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:49:14.724215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.725621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.726185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.728167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.731444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.731984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.734981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:14.737496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:14.751778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.754288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.756437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:14.757401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:14.760151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:14.761560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:15.071331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:15.093354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:15.095939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:15.097963 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fee5d33-811d-440b-8722-679d749106e7 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.407622 Oct 10 10:49:15.103438 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1278/2465] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:14 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:49:15.117294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b58632be-2f15-4695-b422-2a36e26661ec tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca190d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:15.227585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b58632be-2f15-4695-b422-2a36e26661ec tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.122547 Oct 10 10:49:15.229708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1279/2466] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:15 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:15.571479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:15.584349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6241ab9-09b0-43ff-9c4e-3e1e5209cf62 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1496 microversion: 2.1 time: 0.854366 Oct 10 10:49:15.599458 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1188/2467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:14 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1496 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:15.651564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:15.652748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:15.664949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:15.667287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:15.667940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:15.671037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:15.672913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:15.679464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.016588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:16.031605 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d3a7ba5-ee60-402f-a648-ca12d8013bc6 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1272 microversion: 2.1 time: 0.385161 Oct 10 10:49:16.047832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1280/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:15 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:16.130974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:16.131614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:16.141572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.142029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.142465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.145245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.147277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.147879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.244438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d14e44a-76c2-4ad0-a432-564b0cbc80ff tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca190d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:16.328771 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d14e44a-76c2-4ad0-a432-564b0cbc80ff tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.088626 Oct 10 10:49:16.336801 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1281/2469] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:16 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:16.446884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:16.464988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:16.466694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:16.467974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97cff4ba-b090-4f65-a844-e67976ac8bce tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.340824 Oct 10 10:49:16.468582 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1189/2470] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:16 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:16.510414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}, {"server_uuid": "c12a2502-fc4f-4842-afda-6dbd8320a24d", "name": "network-vif-deleted", "tag": "92c413e4-9e62-4997-b57e-295b478d4a4e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:16.568213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.568923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.571328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.608828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:16.609422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:16.612872 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Creating event network-changed:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:49:16.613891 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] Creating event network-vif-deleted:92c413e4-9e62-4997-b57e-295b478d4a4e for instance c12a2502-fc4f-4842-afda-6dbd8320a24d on n-h2-860687-2 Oct 10 10:49:16.623525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.624037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.626471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.627796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.629162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.630897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.636190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fd535e5f-5b10-4786-af9c-e89fe3bd24ee req-321f75d9-1ac6-49d0-8738-c448abf6f084 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.140522 Oct 10 10:49:16.643673 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1282/2471] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:49:16.713824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:16.717742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:16.718456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:16.719337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lazy-loading 'fault' on Instance uuid c12a2502-fc4f-4842-afda-6dbd8320a24d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:49:17.055661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:17.056634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:17.077878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:17.086313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:17.086589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:17.088453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:17.088940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:17.089396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:17.143195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:17.165311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e28172f-667f-41a8-a3f3-a54e5589d521 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 200 len: 1303 microversion: 2.1 time: 0.560105 Oct 10 10:49:17.170739 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1190/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:16 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 1303 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:17.346216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1e090a3-3faf-48ba-8d8c-1b6f1d83d4a9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c3c50d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:17.459952 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1e090a3-3faf-48ba-8d8c-1b6f1d83d4a9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.119339 Oct 10 10:49:17.461035 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1191/2473] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:17 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:17.497714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:17.499413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:17.507420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:17.515971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:17.519336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:17.522029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:17.528281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:17.529768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:17.967769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:17.994222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:17.996217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:17.997641 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72391a17-032b-4d18-a35c-37d5daee3006 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.503951 Oct 10 10:49:18.031311 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1192/2474] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:17 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:18.197861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:18.198854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:18.211050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:18.215115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:18.216351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:18.217751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:18.218462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:18.223497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:18.245406 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d HTTP/1.1 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c12a2502-fc4f-4842-afda-6dbd8320a24d'} Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:18.264253 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:49:18.268250 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:18.272724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:18.273867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f58e00b-a483-4ca7-a85b-427515cd1466 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 404 len: 111 microversion: 2.1 time: 0.082067 Oct 10 10:49:18.278701 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1193/2475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:18 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:49:18.477475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e5eba08-0b36-4d92-9bde-a3619a87ab40 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d01550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:18.515457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:18.524828 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17e9f2cd-98dd-4f0a-bce8-006448737859 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 1.473522 Oct 10 10:49:18.542324 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e5eba08-0b36-4d92-9bde-a3619a87ab40 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.060423 Oct 10 10:49:18.542324 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1194/2476] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:18 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:18.543395 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1283/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:17 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:19.027067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:19.027674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:19.045347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:19.046099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:19.046690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:19.047630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:19.048240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:19.048824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:19.203589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:19.219758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:19.233279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:19.234828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e230f7c3-78d4-411f-80f7-41eea3f04cad tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1604 microversion: 2.42 time: 0.211663 Oct 10 10:49:19.235892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1195/2478] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:19 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:19.551876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-903176ec-03ba-4544-be8b-4a0026537898 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca30820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:19.555308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:19.556265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:19.570787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:19.577432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:19.577935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:19.578703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:19.584596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:19.586798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:19.644113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-903176ec-03ba-4544-be8b-4a0026537898 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.097707 Oct 10 10:49:19.646106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1284/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:19 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:19.657528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:20.126870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:20.139615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09e19e6e-0166-4b67-b381-79178dd59a39 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 0.588022 Oct 10 10:49:20.161966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1196/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:19 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:20.266840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:20.268243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:20.301535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:20.304305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:20.304926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:20.311951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:20.319623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:20.320331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:20.449320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:20.453930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:20.454688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:20.455475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lazy-loading 'fault' on Instance uuid e7fff432-7a1b-4740-af08-78b82d1fea83 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:49:20.663223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b7ca0d5-4d63-4ffd-8ac2-4faaf6021f1b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca8c9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:20.729887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b7ca0d5-4d63-4ffd-8ac2-4faaf6021f1b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.070489 Oct 10 10:49:20.742689 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1197/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:20 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:21.045376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:21.059201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:21.069659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3ca311c14814cb4b5ddab7eaacd5f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e361f65b2bc842e3877e342ef7397fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:21.076468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b01022a9-f0ba-47fb-8c27-ca3af452eaf5 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 200 len: 1371 microversion: 2.42 time: 0.814969 Oct 10 10:49:21.079739 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1285/2482] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:20 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 1371 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:21.165886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:21.166603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:21.187575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:21.192946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:21.194357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:21.201600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:21.202491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:21.206497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:21.746565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87823f62-6ba5-4356-963e-8b848ba72ba7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca19160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:21.817101 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87823f62-6ba5-4356-963e-8b848ba72ba7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.075051 Oct 10 10:49:21.817714 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1286/2483] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:21 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:21.892948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:21.904280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cb132aa-c4ee-4d25-b32e-9e6bb3a9a33b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 0.742233 Oct 10 10:49:21.921195 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1198/2484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:21 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:22.107145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:22.109719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:22.112260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:22.133124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:22.134498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:22.136599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:22.140270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:22.143949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:22.145446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:22.203767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] HTTP exception thrown: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Request method failure captured: Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 HTTP/1.1 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_cJhGKK9qTcNIlxM1IBkVimahhLTuEFWkzv0ojxyfDQFe_IjEStwsV9icy7t915C9o8Mb0Rcu4qGJzMV7Rk1_ddKrvxJrXF7lamOPmpZjMgr1RHrlYVT21Qosha0nNDMNR22oqAmO10wxb0xme-M26e4VZOiLoN0Me1AFkocaeIrvw Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e361f65b2bc842e3877e342ef7397fd1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e361f65b2bc842e3877e342ef7397fd1"}]}] Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c3ca311c14814cb4b5ddab7eaacd5f80 Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e7fff432-7a1b-4740-af08-78b82d1fea83'} Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:22.209230 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:22.214251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Returning 404 to user: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:22.219883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5578efe-5f6a-49b2-b18a-acf3b722fa91 tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 404 len: 111 microversion: 2.42 time: 0.114281 Oct 10 10:49:22.222928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1287/2485] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:22 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:49:22.231735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-674e3c1a-0579-483a-995b-07a590b5858e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '.version_select at 0x7f6780cd6550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:22.301068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-674e3c1a-0579-483a-995b-07a590b5858e tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514643785" status: 204 len: 0 microversion: 2.42 time: 0.069293 Oct 10 10:49:22.304202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1199/2486] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 10:49:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514643785 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:49:22.759264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c91c2ee-998d-498c-b2a4-0bcb3255c11a", "tag": "cdf3ca1d-f25f-424a-802c-09ed2b30291e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:22.787720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:22.788226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:22.788669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:22.821963 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] Creating event network-changed:cdf3ca1d-f25f-424a-802c-09ed2b30291e for instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a on n-h1-860687-2 Oct 10 10:49:22.829626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d058fdd0-dd58-40ba-af50-841f1b2313e5 req-d97ba775-2bf6-4831-be39-082018d19b36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074228 Oct 10 10:49:22.832883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f984718-134e-4fef-b045-0005ee82dd0d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cf6550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:22.834479 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1288/2487] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:22.909757 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f984718-134e-4fef-b045-0005ee82dd0d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.080680 Oct 10 10:49:22.917587 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1200/2488] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:22 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:22.932090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:22.932090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:22.942178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:22.942694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:22.943191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:22.943923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:22.944389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:22.944831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:23.278416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:23.920657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:23.930469 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4c3164d-900d-402f-b2fa-8e4bde1ff232 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 1.005117 Oct 10 10:49:23.947821 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1289/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:22 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:23.954160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d3f30b1-432e-4c93-9c77-3cf1cc52c2fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cf6040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:24.041801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d3f30b1-432e-4c93-9c77-3cf1cc52c2fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.104521 Oct 10 10:49:24.044585 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1201/2490] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:23 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:24.968058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:24.968784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:24.981233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:24.982414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:24.982878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:24.983660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:24.984123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:24.984558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:25.066484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-646d19d3-2134-49af-b5c6-922252b143a3 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cc7550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:25.163922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-646d19d3-2134-49af-b5c6-922252b143a3 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.104293 Oct 10 10:49:25.168032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1202/2491] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:25 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:25.511711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:25.526712 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-badd43e5-d01b-42f3-9179-901caf3facb5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 0.560851 Oct 10 10:49:25.527729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1290/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:24 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:26.046667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baefda7b-1d45-4642-a66d-ca872a5117b0"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:26.050361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:26.058080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:26.058763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:26.060533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:26.061524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:26.062305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:26.062875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:26.181816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-efbe7e28-c79a-46f1-993b-7cf612d0f20b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677cbdbb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:26.295150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-efbe7e28-c79a-46f1-993b-7cf612d0f20b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.115823 Oct 10 10:49:26.297868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1291/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:26 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:26.555732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:26.556400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:26.580302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:26.580811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:26.581263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:26.588387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:26.589527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:26.589937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:26.662121 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d053e83d-6ac2-4434-b5e7-ed88e5d72cd9 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "POST /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621430 Oct 10 10:49:26.663799 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1203/2494] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:49:26 2022] POST /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:27.320860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c40c4825-a486-4d6f-a8c4-bb5069cb95ce tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cea3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:27.405206 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c40c4825-a486-4d6f-a8c4-bb5069cb95ce tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.095919 Oct 10 10:49:27.405855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1204/2495] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:27 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:27.991197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:28.008432 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-433d2a69-caf6-433f-891f-69ff46676039 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 1.456908 Oct 10 10:49:28.018960 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1292/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:26 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:28.422648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ca97fe6-f23d-4eb1-87a4-6f02b9e440bc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cd6dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:28.502152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ca97fe6-f23d-4eb1-87a4-6f02b9e440bc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.084824 Oct 10 10:49:28.502815 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1205/2497] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:28 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:29.042031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:29.042662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:29.062946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:29.063490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:29.064137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:29.065035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:29.065663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:29.066295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:29.519069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccb827eb-296e-499b-91f3-319181dfd758 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cea550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:29.602490 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccb827eb-296e-499b-91f3-319181dfd758 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.088542 Oct 10 10:49:29.610282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1206/2498] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:29 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:29.791031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:29.806991 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e58919e-7ce8-41b4-8f98-340d08b59a79 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 0.767451 Oct 10 10:49:29.808883 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1293/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:29 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:29.984053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:29.984589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:29.996195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.002474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.005756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:30.009231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.011336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.013835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:30.040107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] HTTP exception thrown: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Request method failure captured: Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 HTTP/1.1 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_cJhGKK9qTcNIlxM1IBkVimahhLTuEFWkzv0ojxyfDQFe_IjEStwsV9icy7t915C9o8Mb0Rcu4qGJzMV7Rk1_ddKrvxJrXF7lamOPmpZjMgr1RHrlYVT21Qosha0nNDMNR22oqAmO10wxb0xme-M26e4VZOiLoN0Me1AFkocaeIrvw Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e361f65b2bc842e3877e342ef7397fd1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e361f65b2bc842e3877e342ef7397fd1"}]}] Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c3ca311c14814cb4b5ddab7eaacd5f80 Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e7fff432-7a1b-4740-af08-78b82d1fea83'} Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:30.042019 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.046463 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.048027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Returning 404 to user: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:30.055765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed777d86-cb88-46b3-be84-bdb86f4b348d tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 404 len: 111 microversion: 2.42 time: 0.077476 Oct 10 10:49:30.059814 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1207/2500] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:49:29 2022] DELETE /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:49:30.065760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:30.066383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] [instance: e7fff432-7a1b-4740-af08-78b82d1fea83] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:30.077184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.078069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.078667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:30.079594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.080242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.080821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:30.114472 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] HTTP exception thrown: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Request method failure captured: Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 HTTP/1.1 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_cJhGKK9qTcNIlxM1IBkVimahhLTuEFWkzv0ojxyfDQFe_IjEStwsV9icy7t915C9o8Mb0Rcu4qGJzMV7Rk1_ddKrvxJrXF7lamOPmpZjMgr1RHrlYVT21Qosha0nNDMNR22oqAmO10wxb0xme-M26e4VZOiLoN0Me1AFkocaeIrvw Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e361f65b2bc842e3877e342ef7397fd1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e361f65b2bc842e3877e342ef7397fd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e361f65b2bc842e3877e342ef7397fd1"}]}] Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e361f65b2bc842e3877e342ef7397fd1 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581092969 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c3ca311c14814cb4b5ddab7eaacd5f80 Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581092969-project Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e7fff432-7a1b-4740-af08-78b82d1fea83'} Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.117712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] Returning 404 to user: Instance e7fff432-7a1b-4740-af08-78b82d1fea83 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:30.122948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed5dd4c7-a6ef-4163-9127-78b1f99e4aee tempest-TaggedBootDevicesTest_v242-581092969 tempest-TaggedBootDevicesTest_v242-581092969-project] 10.222.0.16 "GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83" status: 404 len: 111 microversion: 2.42 time: 0.058410 Oct 10 10:49:30.133831 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1294/2501] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:30 2022] GET /compute/v2.1/servers/e7fff432-7a1b-4740-af08-78b82d1fea83 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:49:30.626038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed65c807-1afa-46b6-981f-742cbaff62d6 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c417550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:30.703824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed65c807-1afa-46b6-981f-742cbaff62d6 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.082313 Oct 10 10:49:30.708977 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1208/2502] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:30 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:30.833854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:30.836113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:30.864693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.865200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.865649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:30.866372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:30.866867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:30.867329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:31.723032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-128e220f-caec-4cb8-8bb2-e33acbcc6e4e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cc75e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:31.808461 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-128e220f-caec-4cb8-8bb2-e33acbcc6e4e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.090276 Oct 10 10:49:31.810046 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1209/2503] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:31 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:31.954725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c91c2ee-998d-498c-b2a4-0bcb3255c11a", "name": "network-vif-plugged", "status": "completed", "tag": "cdf3ca1d-f25f-424a-802c-09ed2b30291e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:31.978610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:31.980866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:31.982564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:32.012522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] Creating event network-vif-plugged:cdf3ca1d-f25f-424a-802c-09ed2b30291e for instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a on n-h1-860687-2 Oct 10 10:49:32.018585 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f4f6c5af-e76d-4dc6-9777-e721aae4981d req-ffff6933-5a59-4efd-9be4-6f006085cd58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072778 Oct 10 10:49:32.019710 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1210/2504] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:49:32.404587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:32.415290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ebd8c2f2-8ad2-4d05-80c3-9614e4a1f5bb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 1.585252 Oct 10 10:49:32.420412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1295/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:30 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:32.688684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1960616640", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "605c2d36-b39f-469a-946c-a8a71eeec49b"}, {"uuid": "6cfe892d-4dcf-40ca-a2ee-019967f95421"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:32.805634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] validate_networks() for [('605c2d36-b39f-469a-946c-a8a71eeec49b', None, None, None, None, None), ('6cfe892d-4dcf-40ca-a2ee-019967f95421', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:49:32.848993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29a69aae-3bdd-4d64-9a55-432aaf4b68bd tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f67779deb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:32.917717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29a69aae-3bdd-4d64-9a55-432aaf4b68bd tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.074278 Oct 10 10:49:32.919187 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1296/2506] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:32 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:33.444723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:33.445340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:33.458120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:33.458619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:33.459091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:33.459820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:33.460280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:33.482233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:34.537453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:34.547099 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eaa486eb-938d-442f-ba9e-51dd444d099f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1314 microversion: 2.1 time: 1.107643 Oct 10 10:49:34.568914 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1297/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:33 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:34.585294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed780c28-aeb7-44ad-9ee5-dff03dbe440e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f67779deb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:34.672184 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed780c28-aeb7-44ad-9ee5-dff03dbe440e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1424 microversion: 2.1 time: 0.101590 Oct 10 10:49:34.673071 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1298/2508] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:34 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:34.818800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:49:34.819480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:49:34.819807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:49:34.820474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:49:34.821098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:49:34.838621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:34.839401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:34.840008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:34.841687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:34.845414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:34.847294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:34.904800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Getting quotas for project 62d15ad837fe4274b7511c1d9c1971f5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:49:34.921895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Getting quotas for user f475c6af5cd7479cafdcb1e490119f04 and project 62d15ad837fe4274b7511c1d9c1971f5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:49:34.971550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:49:34.978352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:49:35.072694 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cae22d53-818d-45af-a864-7063328ebb0d tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390277 Oct 10 10:49:35.073671 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1211/2509] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:49:35.085467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e6527a38-28a7-4749-b667-8988b4800c54 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:35.086403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e6527a38-28a7-4749-b667-8988b4800c54 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:35.172700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6527a38-28a7-4749-b667-8988b4800c54 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:35.180166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e6527a38-28a7-4749-b667-8988b4800c54 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1213 microversion: 2.1 time: 0.098570 Oct 10 10:49:35.182645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1299/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:35 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:35.577697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:35.578624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:35.588754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:35.593751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:35.594428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:35.596653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:35.597293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:35.597909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:35.696698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-019e53fd-fa87-44d6-8fd2-f22a946eb9fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca50670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:35.784877 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-019e53fd-fa87-44d6-8fd2-f22a946eb9fe tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1433 microversion: 2.1 time: 0.100128 Oct 10 10:49:35.786281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1300/2511] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:35 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1433 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:35.816700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb72940d-17ba-48f5-856e-6bf86061503c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c84f790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:35.915170 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb72940d-17ba-48f5-856e-6bf86061503c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 200 len: 1433 microversion: 2.1 time: 0.112427 Oct 10 10:49:35.916137 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1301/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:35 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 1433 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:35.932195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:35.932818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:35.969086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:35.969580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:35.972566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:35.974372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:35.977062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:35.979675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:35.980055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:35.991288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c9646a4-8d06-4112-a03f-a326c0141125 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1463 microversion: 2.1 time: 0.417394 Oct 10 10:49:35.992755 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1212/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:35 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1463 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:36.065092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:36.507613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:36.522411 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-60a9f2bb-a4e9-41aa-ad3b-b7a5006404fc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1466 microversion: 2.1 time: 0.591423 Oct 10 10:49:36.530936 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1302/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:35 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1466 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:36.537030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:36.537975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:36.547714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:36.549954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:36.550443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:36.551221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:36.551927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:36.560968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:36.676316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:36.686658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44574255-720f-4969-b075-90b212fbd853 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1209 microversion: 2.1 time: 0.154426 Oct 10 10:49:36.688451 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1303/2515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:36 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:36.694227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd0d2d5b-c4f5-4c17-b0af-0e2de6fee0e2 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c84fa60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:36.766636 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd0d2d5b-c4f5-4c17-b0af-0e2de6fee0e2 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c" status: 200 len: 784 microversion: 2.1 time: 0.075748 Oct 10 10:49:36.768112 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1304/2516] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:36 2022] GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c => generated 784 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:36.831549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:36.838811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f919c2e7-05ae-40f4-91e5-c905bd6a2c5a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:36.842875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'deleted': False, 'project_id': '9d12446483b84e1c98665320a53234bb'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:36.876662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:36.879352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:36.884071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:36.885776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:36.889020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:36.889659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:36.899316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f919c2e7-05ae-40f4-91e5-c905bd6a2c5a tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.091008 Oct 10 10:49:36.908530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1305/2517] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:49:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:36.921991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1da9874-0333-4f87-9dc7-b188325eb501 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca50310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:37.254783 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c8fea90-a5dd-4d41-8ebf-0f9bc15a75d2 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.233472 Oct 10 10:49:37.268469 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1213/2518] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:49:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:49:37.281354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:37.289748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:37.296580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:37.297464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:37.298666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:37.300117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:37.300756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:37.301393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:37.578301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:49:37.922375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:37.922871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:37.936781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:38.405758 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1da9874-0333-4f87-9dc7-b188325eb501 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "DELETE /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 204 len: 0 microversion: 2.1 time: 1.495943 Oct 10 10:49:38.406612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1306/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:36 2022] DELETE /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 0 bytes in 1498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:49:38.412687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:38.413509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:38.443638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:38.455252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:38.455953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:38.456839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:38.458581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:38.460563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:38.687211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:38.700924 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1949491-9a90-4274-9479-78a4263a51cf tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1271 microversion: 2.1 time: 0.293148 Oct 10 10:49:38.708230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1307/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:38 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:38.714733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d2762cd-109c-4d6e-8626-9c265e5dfa01 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677cb568b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:38.750104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5d2762cd-109c-4d6e-8626-9c265e5dfa01 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] HTTP exception thrown: Image not found. Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d2762cd-109c-4d6e-8626-9c265e5dfa01 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Request method failure captured: Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 HTTP/1.1 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iErVIGQkilvnP5ix_-HT25KjrdUAgEKpIEHsju12ZPT4-jHORZlqzIDZqX7XTa6MLQtAgk9h3QdKcdmOok4bFPYPeF0vl2lAgPgVCH30NxyKZep8qS2Swj7o3wU3zd0j5r2A4hj-2HVkxlBQe1mmZmdMMuVco3p_E9zhACm2N8TJg Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59dd868a1eb44951b5aca992f87527cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59dd868a1eb44951b5aca992f87527cb"}]}] Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2ad413c40d2e45ce9fb7183d9afbbafe Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4a8df89f-2f71-42f3-b731-b7512bcb7d26'} Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4a8df89f-2f71-42f3-b731-b7512bcb7d26 Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:49:38.752245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a8df89f-2f71-42f3-b731-b7512bcb7d26 could not be found. Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d2762cd-109c-4d6e-8626-9c265e5dfa01 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d2762cd-109c-4d6e-8626-9c265e5dfa01 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 404 len: 62 microversion: 2.1 time: 0.044094 Oct 10 10:49:38.756166 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1308/2521] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:38 2022] GET /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:49:38.777078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-652284997"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:38.781502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:38.795869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:38.795983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:38.796485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:38.797295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:38.798039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:38.798622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.312808 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d706a8b3-0ab6-4fac-a517-8e59b3cd3b3e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "POST /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a/action" status: 202 len: 0 microversion: 2.1 time: 0.536470 Oct 10 10:49:39.316020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1309/2522] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:38 2022] POST /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 10 10:49:39.343968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e29d824d-3787-453f-be43-a6de0ef461a1 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c7de310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:39.440371 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e29d824d-3787-453f-be43-a6de0ef461a1 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.115466 Oct 10 10:49:39.445609 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1310/2523] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:39 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:39.564813 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f7f5f1f-4903-4ab4-8602-527c27f84613 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11525 microversion: 2.1 time: 2.288484 Oct 10 10:49:39.565833 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1214/2524] 10.222.0.16 () {58 vars in 1171 bytes} [Mon Oct 10 10:49:37 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11525 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:49:39.613193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:39.618686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'deleted': False, 'project_id': '9d12446483b84e1c98665320a53234bb'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:39.660531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:39.667709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.669572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.670327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.671390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.672642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.675564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.728559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:39.729314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:39.741891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.742539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.743260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.744197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.744878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.756033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.789417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2d7bf503-292e-49bc-8ba8-3868276f7b5c tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=beb8bd8b1ca54f8584cd48cff8a0a41b" status: 200 len: 15 microversion: 2.1 time: 0.183180 Oct 10 10:49:39.809238 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1311/2525] 10.222.0.16 () {58 vars in 1231 bytes} [Mon Oct 10 10:49:39 2022] GET /compute/v2.1/servers/detail?tenant_id=beb8bd8b1ca54f8584cd48cff8a0a41b => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:49:39.819858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:39.825884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'tenant_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'deleted': False} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:39.834147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.834638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.835101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.835834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:39.836289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:39.836717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:39.886571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:49:39.922539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:39.938488 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bd17d12-0cdc-4662-b4d9-1df74acbd880 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1271 microversion: 2.1 time: 0.213545 Oct 10 10:49:39.941991 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1215/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:39 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:40.018358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.018903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.021932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.451755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-unplugged", "status": "completed", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:40.478477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:40.488526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.497438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.502040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.533149 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55573efc-25c7-4f50-b7c8-50a7cb81a08a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=beb8bd8b1ca54f8584cd48cff8a0a41b" status: 200 len: 4825 microversion: 2.1 time: 0.719208 Oct 10 10:49:40.533922 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1312/2527] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 10:49:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=beb8bd8b1ca54f8584cd48cff8a0a41b => generated 4825 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:40.550938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-08a60ca8-78c0-4c0b-90b9-c55f965dfa06 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677d041c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:40.600018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] Creating event network-vif-unplugged:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:49:40.609240 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e23539fe-08dc-4225-b3fe-2eaed8b2a971 req-35faa38f-c8cb-4b0c-a07f-0b21554caf33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161970 Oct 10 10:49:40.615843 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1216/2528] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:49:40.623142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:40.632121 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-08a60ca8-78c0-4c0b-90b9-c55f965dfa06 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.097006 Oct 10 10:49:40.633798 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1313/2529] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:40 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:40.640310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'tenant_id': '9d12446483b84e1c98665320a53234bb', 'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:40.651151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.657554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.658540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.659634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.660267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.660856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.734956 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecb3b84f-6310-4c41-ba36-5f3ad4699adf tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9d12446483b84e1c98665320a53234bb" status: 200 len: 15 microversion: 2.1 time: 0.117311 Oct 10 10:49:40.737131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1217/2530] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 10:49:40 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9d12446483b84e1c98665320a53234bb => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:49:40.765460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-742ad14c-a2e4-4201-ad81-2c2c74e48504 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:40.773279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-742ad14c-a2e4-4201-ad81-2c2c74e48504 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012063 Oct 10 10:49:40.790128 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1314/2531] 10.222.0.16 () {58 vars in 1189 bytes} [Mon Oct 10 10:49:40 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:49:40.802154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:40.806184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:40.815901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.816406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.817016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.819034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.819679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.820313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.955280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1128c228-b847-4b2f-8fe1-b030d7f1d2a9 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 0 microversion: 2.1 time: 0.155532 Oct 10 10:49:40.956713 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1218/2532] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:40 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:49:40.966610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:40.970263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:40.972282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:40.976282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:40.981646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:40.985576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.986081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.990168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.991050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:40.991727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:40.993206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:40.998795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.001025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.001993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:41.005566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.006284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.007343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:41.075980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:49:41.144185 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0614bb88-641e-48ca-92d6-e2c0fa45258b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.182644 Oct 10 10:49:41.146528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1315/2533] 10.222.0.16 () {58 vars in 1150 bytes} [Mon Oct 10 10:49:40 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:41.165040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:41.169829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:41.188686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.193113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.196479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:41.198194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.200286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.202103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:41.348760 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9633417-1641-408d-99ce-ed6ade3f04e6 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 0 microversion: 2.1 time: 0.191518 Oct 10 10:49:41.349799 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1316/2534] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:41 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:49:41.486846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-148452308", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e07647a7-a96d-4d47-beb9-e48b01ce99f8"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:41.575705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] validate_networks() for [('e07647a7-a96d-4d47-beb9-e48b01ce99f8', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:49:41.793137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:41.803229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80691098-66ed-4ff0-81b8-b64f0da67c63 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1313 microversion: 2.1 time: 0.840332 Oct 10 10:49:41.806283 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1219/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:40 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:41.823447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:41.824074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:41.834411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.834980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.836571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:41.837300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:41.840205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:41.842846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:42.495603 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-325d74d3-7c7f-434a-a29b-92ad546503dd tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1614 microversion: 2.1 time: 0.688099 Oct 10 10:49:42.496197 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1220/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:41 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1614 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:42.521108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801ab956-1583-404c-a2c2-ed9c61ddd1e9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cf9940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:42.597684 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-801ab956-1583-404c-a2c2-ed9c61ddd1e9 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.081364 Oct 10 10:49:42.607343 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1221/2537] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:42 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:42.612222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:42.612848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:42.644829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:42.645323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:42.645760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:42.647139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:42.647786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:42.648359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:43.680387 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9651989f-fa66-44bb-aaba-22ef39dc6278 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1614 microversion: 2.1 time: 1.071869 Oct 10 10:49:43.681025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1222/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:42 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1614 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:43.699094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:43.700317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:43.710029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:43.711324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:43.711957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:43.716348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:43.717224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:43.720090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:43.736489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:49:43.737959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:49:43.738468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:49:43.738887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:49:43.739346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:49:43.761939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:43.765267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:43.766650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:43.769050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:43.770964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:43.772744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:43.805985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Getting quotas for project 1bf244d5a2104dca95e723a0f78f5ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:49:43.819567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Getting quotas for user ac08792ebf664fa5a83267f3625b7850 and project 1bf244d5a2104dca95e723a0f78f5ac5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:49:43.857393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Going to run 3 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:49:43.860142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:49:43.948505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=8a7f301d-a22e-4560-9409-00d1989945be,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:49:44.060092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=965f7d2d-6ba5-4f25-9379-8481012f1f27,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:49:44.269317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:44.283920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91fb6bf6-db98-4144-9006-5a7776bae329 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.928123 Oct 10 10:49:44.284822 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1317/2539] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:49:44.289465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96627877-016f-4677-8be8-bd2df4cfa813 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6777bb84c0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:44.321340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d4a8206-4a0f-49d2-bfe5-717d60934dac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.630422 Oct 10 10:49:44.322486 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1223/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:43 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:44.339112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:44.370177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'host': 'n-h1-860687-2', 'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:44.417744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:44.421244 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96627877-016f-4677-8be8-bd2df4cfa813 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.134999 Oct 10 10:49:44.429729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1318/2541] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:44 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:44.429894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:44.429894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:44.429894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:44.429894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:44.429894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:44.434694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:44.464571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:44.465832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:44.533508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:44.534066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:44.534454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:44.550240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:44.550856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:44.551349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:44.617461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:49:44.623648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f657f101-93be-4e8b-856c-c8b26ad4c5e6 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.199425 Oct 10 10:49:44.635435 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1319/2542] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:49:44 2022] GET /compute/v2.1/servers => generated 1015 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:44.656358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2fa1059-0c3c-4ace-8806-a4d5b99be8f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:44.657121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2fa1059-0c3c-4ace-8806-a4d5b99be8f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:44.869643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e2fa1059-0c3c-4ace-8806-a4d5b99be8f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:44.879434 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e2fa1059-0c3c-4ace-8806-a4d5b99be8f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1222 microversion: 2.1 time: 0.242681 Oct 10 10:49:44.884317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1320/2543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:44 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:45.285488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:45.303476 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc3b73e4-2242-43a0-90e6-c5531055361f tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-860687-2&all_tenants=1" status: 200 len: 992 microversion: 2.1 time: 0.979579 Oct 10 10:49:45.303989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1224/2544] 10.222.0.16 () {58 vars in 1190 bytes} [Mon Oct 10 10:49:44 2022] GET /compute/v2.1/servers?host=n-h1-860687-2&all_tenants=1 => generated 992 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:45.317193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:45.326645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:49:45.353797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:45.354636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:45.365010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.376293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.376293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:45.376963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.377420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.377844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:45.427364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.435305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.437190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:45.440489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.443649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.446779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:45.793176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6131c522-2130-46d6-af1b-b1b904a7d730 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.476995 Oct 10 10:49:45.798846 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1321/2545] 10.222.0.16 () {58 vars in 1196 bytes} [Mon Oct 10 10:49:45 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:49:45.807661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1adb53e8-cb6f-44bc-bea5-f150f2ab664c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca503a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:45.918210 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1adb53e8-cb6f-44bc-bea5-f150f2ab664c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.117405 Oct 10 10:49:45.920795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1322/2546] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:45 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:45.931796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:45.944079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:45.962021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.964568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.965112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:45.968995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:45.969831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:45.971061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.115654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:46.138958 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e185e4ca-0289-4d22-88a4-fb5859c9404f tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.788915 Oct 10 10:49:46.139606 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1225/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:45 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:46.172454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46c77be0-8863-40d9-8e62-41d8399cf945 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:46.173240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46c77be0-8863-40d9-8e62-41d8399cf945 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:46.182266 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1378d48f-82dd-492b-9bba-b3eacaad22ad tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 0 microversion: 2.1 time: 0.260164 Oct 10 10:49:46.186769 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1323/2548] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:45 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:49:46.203781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "tag": "00be7ac5-7f4b-4eaf-8819-abf6a4462027"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:46.238002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.240578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.241988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.260102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] Creating event network-changed:00be7ac5-7f4b-4eaf-8819-abf6a4462027 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:49:46.268819 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bbd57126-9787-499a-8a5e-46fd82379362 req-f8c5650c-f232-42ee-8260-253c8b44478f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079280 Oct 10 10:49:46.270167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1324/2549] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:46.276566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:46.284387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:46.295640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.296491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.297175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.300394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.301956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.302629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.348343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46c77be0-8863-40d9-8e62-41d8399cf945 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:46.357095 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46c77be0-8863-40d9-8e62-41d8399cf945 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1222 microversion: 2.1 time: 0.193190 Oct 10 10:49:46.362357 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1226/2550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:46 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:46.386832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:46.391327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:46.421020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.424667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.427669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.431475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.434754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.437719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.532297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:49:46.532796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:49:46.535906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:49:46.538415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:49:46.540789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:49:46.584213 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31a285de-fac1-49e7-9cfe-3d62f995aa18 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/ips" status: 200 len: 150 microversion: 2.20 time: 0.211620 Oct 10 10:49:46.586652 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1227/2551] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 10 10:49:46 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/ips => generated 150 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:49:46.697226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:46.775415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:46.816101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.821605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.823316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.824185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:46.829429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:46.830242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:46.938505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc65f860-b05c-448a-8516-fd7171161a6c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d01b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:46.976927 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8531c08-d5e3-416a-a680-acdec6003c6b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 1067 microversion: 2.1 time: 0.702589 Oct 10 10:49:46.998029 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1325/2552] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:49:46 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 1067 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 10:49:47.025163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:47.025906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:47.069912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:47.073214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:47.076827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:47.079368 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc65f860-b05c-448a-8516-fd7171161a6c tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.144054 Oct 10 10:49:47.083451 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1228/2553] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:46 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:47.091653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:47.092632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:47.093431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:47.165282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:47.166413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:47.180938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:47.181989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:47.182844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:47.187371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:47.189955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:47.190647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:48.122227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:48.149449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-062cdd32-ca3b-4e98-a514-652cd5f44364 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 1.149523 Oct 10 10:49:48.171447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1326/2554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:46 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:48.177430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:48.180492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:48.197473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:48.198893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:48.201815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:48.204197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:48.207167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:48.207802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.070170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:49.083602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b09e7c45-1c20-473b-9e35-06c983095dcd tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1274 microversion: 2.1 time: 0.908799 Oct 10 10:49:49.085194 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1327/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:48 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1274 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:49.115106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:49.117834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:49.142636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.160102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.160102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.160102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.160102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.160102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.263877 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12bc1004-9394-42d3-8585-615d72e3bb75 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174145 Oct 10 10:49:49.278924 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1328/2556] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:49:49 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:49.299138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-947216a8-c6ec-4c85-bfcf-d9fc13707123 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6777af5ee0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:49.376135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-947216a8-c6ec-4c85-bfcf-d9fc13707123 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.093368 Oct 10 10:49:49.377168 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1329/2557] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:49 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:49.386817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:49.391853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:49.403967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.404883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.405585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.406637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.407398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.410201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.485338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:49.493366 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0c7713d-de30-49f9-b6ec-c8ae446597ac tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 2.333443 Oct 10 10:49:49.493965 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1229/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:47 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:49:49.504100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:49.504603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:49.544878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.545708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.546755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.556599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:49.557274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:49.557721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:49.845977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lazy-loading 'services' on Instance uuid 0357bf0a-70fd-4e63-b187-29a3df63575a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:49:50.064622 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcd9554c-fb86-466b-ac85-b552f3e41a7d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments/baefda7b-1d45-4642-a66d-ca872a5117b0" status: 202 len: 0 microversion: 2.1 time: 0.566060 Oct 10 10:49:50.067487 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1230/2559] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:49:49 2022] DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments/baefda7b-1d45-4642-a66d-ca872a5117b0 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:49:50.087671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-plugged", "status": "completed", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:50.150967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:50.151460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:50.151893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:50.205781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] Creating event network-vif-plugged:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:49:50.226008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-158fe08f-ca3b-4f17-8918-88c3dd83f64c req-b0f7ecb4-567c-42b0-802f-a76031852c5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157062 Oct 10 10:49:50.233857 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1231/2560] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:50.249383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:50.250123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:50.280468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:50.280969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:50.287319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:50.290624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:50.295057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:50.295763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:51.035026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:51.036305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5d2e543-5058-40fd-9700-d43c7513c781 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1280 microversion: 2.1 time: 0.801088 Oct 10 10:49:51.039147 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1232/2561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:50 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1280 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:51.061043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf2fb82b-468b-4e1d-9d19-b0bebf1857ae tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d50790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:51.071046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:51.107426 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e0c38c6-eb29-4881-b5f3-4dc9b10175c0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 1.728584 Oct 10 10:49:51.109439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1330/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:49 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:51.136424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:51.141679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:51.174933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:51.176573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:51.178637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:51.187116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:51.188282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:51.190845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:51.194557 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf2fb82b-468b-4e1d-9d19-b0bebf1857ae tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.153970 Oct 10 10:49:51.195726 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1233/2563] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:51 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:51.518042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:51.518591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:51.541722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:51.542296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:51.542763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:51.543916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:51.544106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:51.544543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:51.651366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'flavor' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:49:52.287661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:52.311234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-adf02384-bbb1-450a-a3f1-884c5735688e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 1.189324 Oct 10 10:49:52.328257 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1331/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:51 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:52.348581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:52.349547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:52.370503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:52.375688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:52.376384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:52.377498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:52.379691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:52.384726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:52.537464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afa164c9-9b9e-42ae-b731-847759460be6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/action" status: 202 len: 0 microversion: 2.20 time: 1.024757 Oct 10 10:49:52.543907 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1234/2565] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:49:51 2022] POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/action => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:49:52.578173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:52.580864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:52.618752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:52.627940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:52.628546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:52.629547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:52.632126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:52.632820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:52.834207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:52.862874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-009be4fe-c41a-4092-9683-688797657476 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1280 microversion: 2.1 time: 0.533185 Oct 10 10:49:52.863533 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1332/2566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:52 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1280 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:52.894901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-18a66ae0-910c-449e-9707-1a0663bcc86b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677cb99940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:52.985796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-18a66ae0-910c-449e-9707-1a0663bcc86b tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.097033 Oct 10 10:49:52.986397 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1333/2567] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:52 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:52.998197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:53.007377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:53.035573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.036190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.036512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.037241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.037706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.038137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.331764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:53.352200 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a917dc9e-7289-4870-9495-193325cabde1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 0.802271 Oct 10 10:49:53.352788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1235/2568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:52 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:53.372832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:53.373722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:53.384638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.389053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.392640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.393603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.394221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.394812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.679914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:53.697783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:53.699293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:53.701069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8f5b830-1cae-4fda-a2ef-80e9fb7f986e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.707876 Oct 10 10:49:53.701645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1334/2569] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:52 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:53.730279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "tag": "8f7cbf2f-f273-46c7-ab81-b79abb978923"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:53.778457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.783721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.784413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.836881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] Creating event network-changed:8f7cbf2f-f273-46c7-ab81-b79abb978923 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:49:53.848243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-aaccd1a9-353f-432b-98f1-640f02000d86 req-a7c3180f-c603-4f9d-98b0-cee72b29dba6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145175 Oct 10 10:49:53.851366 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1335/2570] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:53.888310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:53.889554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:53.903044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.903643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.906414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:53.907294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:53.908016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:53.909717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:54.435595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:54.447061 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-650d5d40-4ee0-4d4b-bafc-f119842f4045 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1280 microversion: 2.1 time: 0.564794 Oct 10 10:49:54.451142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1336/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:53 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1280 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:54.457910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9074243-5a08-4287-968f-13aad7eb30e5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677d118c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:54.515756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:54.555964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9074243-5a08-4287-968f-13aad7eb30e5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.103457 Oct 10 10:49:54.557145 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1337/2572] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:54 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:54.569223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:54.570178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:54.584684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:54.587024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:54.589692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:54.593551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:54.594322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:54.599616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:54.874446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:55.140810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.162342 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3fc5f4a3-9c93-46c0-8699-0676afc9d4c5 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 0.602373 Oct 10 10:49:55.175594 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1338/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:54 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:55.188997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:55.189673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:55.217606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:55.217606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:55.219297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:55.219297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:55.219511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:55.221377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:55.253858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.272658 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-208fb487-d415-43f3-a390-3099a0cf043b tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 1.915969 Oct 10 10:49:55.274192 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1236/2574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:53 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:55.471161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:55.471726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:55.490931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:55.491486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:55.491936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:55.492688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:55.493153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:55.493583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:55.604500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:55.750819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.768491 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e873936b-1930-49fe-b625-d35bb07fc835 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1280 microversion: 2.1 time: 0.301283 Oct 10 10:49:55.771418 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1237/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:55 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:55.785242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79d712c0-f84d-423a-abb4-30b3eea176f7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d0f670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:55.863756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.877555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.879127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:55.880351 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84cf92c1-6ad3-4008-b2e8-2c16b9a5e12c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.703680 Oct 10 10:49:55.905768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1339/2576] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:55 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:55.957660 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79d712c0-f84d-423a-abb4-30b3eea176f7 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.183832 Oct 10 10:49:55.969965 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1238/2577] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:55 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:56.197175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:56.197784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:56.209674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:56.210177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:56.210623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:56.211384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:56.227676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:56.228395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:56.297365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:56.297992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:56.319118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:56.319721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:56.320182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:56.320939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:56.321408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:56.321846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:56.412757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:49:57.686522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:57.701582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41a59f5e-908a-4d80-a3ba-1c1914898438 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 1.514565 Oct 10 10:49:57.705256 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1340/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:56 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:57.718580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:57.720580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:57.741288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:57.742775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:57.744835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:57.747257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:57.750603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:57.751363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:57.924802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:57.933808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4026ac49-1695-41ac-b855-fdd159255b05 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 1.640994 Oct 10 10:49:57.952541 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1239/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:56 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:57.968050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:57.968926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:57.986762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:57.987569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:57.988172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:57.989074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:57.989694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:57.990297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:58.086306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:58.100293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f56e145-a540-4ba2-b6ae-bde956774055 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.392259 Oct 10 10:49:58.104290 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1341/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:57 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:58.116029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00b01b08-6e5c-4ecd-aee9-2fb8a03a7408 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677cb38670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:58.235629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00b01b08-6e5c-4ecd-aee9-2fb8a03a7408 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.130028 Oct 10 10:49:58.236673 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1342/2581] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:49:58 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:58.253113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7f301d-a22e-4560-9409-00d1989945be", "tag": "cd52b689-5938-4c18-95a2-52fcae59abd1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:49:58.271520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:58.283025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:58.284370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:58.310729 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] Creating event network-changed:cd52b689-5938-4c18-95a2-52fcae59abd1 for instance 8a7f301d-a22e-4560-9409-00d1989945be on n-h1-860687-2 Oct 10 10:49:58.322869 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2c0205eb-8ddd-43f1-9ffc-e211d3ce7b64 req-8413905a-a69e-479a-82f1-c8ca67b18745 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084943 Oct 10 10:49:58.326075 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1343/2582] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:49:58.660905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:58.671427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:58.672900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:58.684739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69df50bc-35d0-405d-ad08-f0521680aa54 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.730124 Oct 10 10:49:58.711401 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1240/2583] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:49:57 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:49:58.732722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:58.734191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:58.746440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:58.747801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:58.754197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:58.755190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:58.755892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:58.756541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:58.963980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:58.964707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:58.984726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:58.985325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:58.985842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:58.986625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:58.987190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:58.987832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:59.254589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:49:59.279458 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccac3c59-2c0b-4dbb-9edb-f5ad41df3b40 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 0.548231 Oct 10 10:49:59.280291 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1344/2584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:58 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:49:59.287889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:49:59.292048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:49:59.305690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:59.308973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:59.310795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:49:59.311780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:49:59.326264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:49:59.330023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.008411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:00.043650 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c01e9822-90a1-4494-86ab-7a4dc5404ecc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 1.062430 Oct 10 10:50:00.063496 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1241/2585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:58 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:00.071533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52f88098-0c21-404b-8a0a-443e63ad91e0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780cc7040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:00.157482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52f88098-0c21-404b-8a0a-443e63ad91e0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.092427 Oct 10 10:50:00.158198 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1242/2586] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:00 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:00.301450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965f7d2d-6ba5-4f25-9379-8481012f1f27", "tag": "c61ff0c1-651f-4758-be53-bf45e1a11766"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:00.322728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:00.323561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:00.324853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.351464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] Creating event network-changed:c61ff0c1-651f-4758-be53-bf45e1a11766 for instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 on n-h2-860687-2 Oct 10 10:50:00.370622 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eda7cd1f-b093-4d8a-8c47-7fd3635befa9 req-fa8013f0-58b6-4538-98c2-495d12fc61c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209114 Oct 10 10:50:00.372429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1243/2587] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:00.392611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:00.393564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:00.409014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:00.409828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:00.413562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.414570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:00.415315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:00.417094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.436422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:00.445549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5a55180-54d2-4cab-a54f-f9881adba61f tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 1.163942 Oct 10 10:50:00.446147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1345/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:49:59 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:00.466400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:00.495884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:00.520399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:00.542695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:00.547979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.548774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:00.549260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:00.562893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:00.987652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:00.994698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:00.997893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:01.007802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:01.009214 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e19e62f-9409-482a-93fc-0f1f771d57e2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.635422 Oct 10 10:50:01.016492 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1244/2589] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:00 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:01.077574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:01.079133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:01.089177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.091499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.092343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.094495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.095192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.096658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.113630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:01.129491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-51129b61-0992-4aa3-b6ad-067ff5271fc0 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 0.682140 Oct 10 10:50:01.142319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1346/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:00 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:01.175973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9baf7e41-1610-4e19-b4b4-73501c9dbd67 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677d1180d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:01.264145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9baf7e41-1610-4e19-b4b4-73501c9dbd67 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.092590 Oct 10 10:50:01.272881 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1347/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:01 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:01.475803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:01.480343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:01.494440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.495670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.496592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.497501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.498310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.498925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.507352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:01.672697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:01.681746 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4473be79-e8e2-4659-9c5a-5d5fa59df07e tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.608179 Oct 10 10:50:01.691813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1245/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:01 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:01.697039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:01.700411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:01.719336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.723782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.724570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.725568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.726304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.726984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.793984 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-209c7f41-4403-4dda-8b0f-8889b9a15dd6 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100660 Oct 10 10:50:01.801057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1246/2593] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:50:01 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:01.904641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:01.907266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:01.924226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.924801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.925319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.926606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:01.927184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:01.931029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:01.991181 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-678da2a0-1979-46f9-8e44-75c19f2ef679 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090877 Oct 10 10:50:01.997981 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1247/2594] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:50:01 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:02.046990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:02.047668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:02.055122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:02.059999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:02.060591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:02.061415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:02.062068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:02.062665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:02.706618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:02.723802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed278ee6-0ce7-444d-b44f-ac301a832a65 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 1.252572 Oct 10 10:50:02.733470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1348/2595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:01 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:02.744227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:02.745323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:02.763839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:02.764340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:02.764805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:02.765508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:02.765972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:02.766400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:02.838476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:02.972182 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d25539e-940a-4082-8b6c-95a633771463 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 204 len: 0 microversion: 2.1 time: 0.235012 Oct 10 10:50:02.983655 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1349/2596] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:02 2022] DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:02.991237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:02.992193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:03.001436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.002289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.003506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.004469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.005669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.006320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.478562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:03.492779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:03.494972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:03.497017 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82bda534-b37b-4d9a-bebf-e2c0db12bff6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 1.453943 Oct 10 10:50:03.497948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1248/2597] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:02 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:50:03.503037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04f349bd-1595-4afe-8742-287c42ea5b16 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d77310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:03.587182 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04f349bd-1595-4afe-8742-287c42ea5b16 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.087522 Oct 10 10:50:03.587960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1249/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:03 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:03.600104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2637734c-fbd1-456f-9da2-73c5c7638264", "tag": "4e46de01-f80b-43c1-826b-aca8e9d69e1d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:03.628922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.629564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.630105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.656300 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] Creating event network-changed:4e46de01-f80b-43c1-826b-aca8e9d69e1d for instance 2637734c-fbd1-456f-9da2-73c5c7638264 on n-h1-860687-2 Oct 10 10:50:03.662054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:03.670419 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d78c7d88-6428-411b-88d5-cb0f8939eaae req-125ebaa4-b31b-4f1a-bbce-27cfc840ac3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081058 Oct 10 10:50:03.670671 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-785de081-3614-416f-9dc4-83ac973ba0d1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1471 microversion: 2.1 time: 0.685618 Oct 10 10:50:03.673328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1250/2599] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:03.680968 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1350/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:02 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1471 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:03.702004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:03.703138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:03.703492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:03.704125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:03.706172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:03.728871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.729540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.732733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.733737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.734470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.735186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.758649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.768270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.769002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:03.770036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:03.770717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:03.782574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:04.613222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:04.622326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e29a1485-6bd1-4827-bccb-ada62b50b6d1 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1680 microversion: 2.1 time: 0.940183 Oct 10 10:50:04.628059 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1351/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:03 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1680 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:04.633030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:04.643800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:04.664621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:04.665428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:04.666084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:04.667685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:04.669133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:04.669780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:04.988838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:05.002243 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb812106-c380-4312-8b36-e758ecf66480 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 1.327552 Oct 10 10:50:05.012256 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1251/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:03 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:05.022851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:05.026443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:05.039030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.044610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.045203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:05.046080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.051173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.051777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:05.724394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:05.743858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54424bec-d881-4b5c-a03a-e4c7b4d93ab9 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 1.105512 Oct 10 10:50:05.744972 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1352/2603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:04 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:05.759666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b878cbd6-74e1-4c94-b392-93fb1ce3457d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677ca303a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:05.861517 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b878cbd6-74e1-4c94-b392-93fb1ce3457d tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1428 microversion: 2.1 time: 0.115326 Oct 10 10:50:05.863898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1353/2604] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:05 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:05.874809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:05.876092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:05.880364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:05.890504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:05.897259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:05.904765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74d9b6c6-eb0b-4be5-929d-bada3302205b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1742 microversion: 2.20 time: 0.891242 Oct 10 10:50:05.905680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.906877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.918499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:05.919482 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1252/2605] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:05 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1742 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:05.920193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.920693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.921139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:05.929916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:05.930831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:05.937463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.938262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.938914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:05.939893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:05.940549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:05.941160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:06.274872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:06.285451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:06.300424 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56071188-f1db-46d4-8b01-bacc915acd0d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1680 microversion: 2.1 time: 0.379224 Oct 10 10:50:06.303126 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e80708e4-c7b6-4672-baaa-8598f6919ed3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.429527 Oct 10 10:50:06.304295 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1253/2606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:05 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1680 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:06.305851 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1354/2607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:05 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:06.314199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:06.323204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:06.338063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:06.338820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:06.339485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:06.342723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:06.343231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:06.343679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:06.670606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:06.684638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6297352-f040-46b1-9827-ea7290b96d6c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.379064 Oct 10 10:50:06.686475 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1254/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:06 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:06.769906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:06.770677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:06.786823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:06.787470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:06.790035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:06.791620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:06.794598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:06.795801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:06.880736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce898484-4939-48fb-b710-c863c36bcefc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d8b8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:07.101755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.110543 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa60c393-5b01-4c22-810f-8d1807a7c55b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.344238 Oct 10 10:50:07.127505 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1355/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:06 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:07.132512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:07.133139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:07.146359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.146862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.151383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.152239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.152726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.155547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.481960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.490402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.492929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.494774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34f344ab-f32f-4470-b396-aa5a539139b3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.366168 Oct 10 10:50:07.495376 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1356/2610] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:07 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:07.511046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:07.512737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:07.527965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.528394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.528840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.529561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.530026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.530458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.680615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.691537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-665f38c0-a2a3-43a4-8779-a6a86d1d6ddb tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1612 microversion: 2.1 time: 0.190038 Oct 10 10:50:07.700138 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1357/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:07 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1612 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:07.709181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:07.709818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:07.731403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.734093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.739974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.741042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.743541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.744268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:07.962299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:07.981018 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67e56746-fb99-401c-ba88-caa23df016a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.279006 Oct 10 10:50:07.982205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1358/2612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:07 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:07.988682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:07.989515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:07.997265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:07.998479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:07.999862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:08.001288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:08.001912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:08.002502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:08.317948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:08.326326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5041b738-fce2-431a-abbc-ed88d857d99a tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.342725 Oct 10 10:50:08.327110 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1359/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:07 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:08.342658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:08.349137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:08.368239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:08.368967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:08.371420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:08.372215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:08.373858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:08.375419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:08.725757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:08.744835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f60f35d0-0960-47ba-b0a6-3bbcc57aa9fa tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.412470 Oct 10 10:50:08.746298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1360/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:08 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:08.756642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:08.757562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:08.780644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:08.781434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:08.784632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:08.785599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:08.786226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:08.786815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:09.133381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:09.157431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:09.166281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:09.172650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9736f4f7-fe66-4611-a159-d6d11ecf6823 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.422291 Oct 10 10:50:09.174408 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1361/2615] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:08 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:09.185292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "name": "network-vif-plugged", "status": "completed", "tag": "8f7cbf2f-f273-46c7-ab81-b79abb978923"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:09.220744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:09.221510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:09.223963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:09.261325 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] Creating event network-vif-plugged:8f7cbf2f-f273-46c7-ab81-b79abb978923 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:50:09.278446 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-868f7549-b190-470a-9fff-8a35ca33c471 req-cb9f9664-6cdf-4bbf-98eb-8efc8814f3ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100532 Oct 10 10:50:09.280770 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1362/2616] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:09.298133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:09.299808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:09.318166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:09.318861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:09.319471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:09.320344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:09.320959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:09.321533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:09.424427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a383aae34c946f89d28d7d784685dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aca1a275c5c431dbce978ab85f072e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:09.444367 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32cb41ed-5a74-4ff9-bc04-2a95a18aa93d tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 200 len: 1612 microversion: 2.1 time: 0.160320 Oct 10 10:50:09.446168 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1363/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:09 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 1612 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:09.453398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:09.456288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:09.468483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:09.468992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:09.469433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:09.470147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:09.470604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:09.471053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:10.425695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:10.434710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:10.444128 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6abfd6e7-a8c5-4e72-8a84-47f9d926d14d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.995192 Oct 10 10:50:10.445774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1364/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:09 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:10.456769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:10.459644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:10.478554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:10.479148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:10.479662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:10.481105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:10.488971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:10.492160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:11.170566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:11.190600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33a4d290-6f82-4e06-8cdf-466e1093fe72 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.743557 Oct 10 10:50:11.194335 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1365/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:10 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:11.209149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:11.211232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:11.236549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:11.238476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:11.241285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:11.244265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:11.245540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:11.247420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:12.422183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:12.433740 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b29dd30-f006-4760-a3f0-e8572d11e5f5 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 1.235305 Oct 10 10:50:12.434331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1366/2620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:11 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:12.455671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0357bf0a-70fd-4e63-b187-29a3df63575a", "name": "network-vif-deleted", "tag": "790da0de-4219-41e7-8879-198f90a35111"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:12.483339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:12.485359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:12.487053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:12.530459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] Creating event network-vif-deleted:790da0de-4219-41e7-8879-198f90a35111 for instance 0357bf0a-70fd-4e63-b187-29a3df63575a on n-h2-860687-2 Oct 10 10:50:12.546740 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-19996ed7-c49c-4ad5-976e-b120efada72a req-41d58e02-43e2-4ebb-97d9-a7e3b368e4e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103108 Oct 10 10:50:12.548095 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1367/2621] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:12.556268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:12.557270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:12.565377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:12.566238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:12.566888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:12.567871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:12.568544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:12.569184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.010248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce898484-4939-48fb-b710-c863c36bcefc tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1437 microversion: 2.1 time: 6.136270 Oct 10 10:50:13.011181 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1255/2622] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:06 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1437 bytes in 6138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:13.019457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:13.020070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:13.037911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=70 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:13.043017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.043547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.044000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.060214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.061280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.061739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.068179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:13.085683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:13.087309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:13.088528 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e72a352-3831-4f54-ade8-074f92173d04 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.537354 Oct 10 10:50:13.097897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1368/2623] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:12 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] HTTP exception thrown: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Request method failure captured: Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a HTTP/1.1 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_g8uIMv4C1g9Q96CKTX8a1I9pFNP-kMuPOiVFxHZgyUPqNJWSbnoETVvayv8v5y7IN8wZEuVUkxL88K2mUxUabavxZeY_0NOT31apQjbpR5smK8ab6ufI0-NJ2RcwOm1Wzt3boK9hdcv1KMjUurzeSxGhjs9TheJ2ScxzXa8TrCgkY Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7aca1a275c5c431dbce978ab85f072e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7aca1a275c5c431dbce978ab85f072e0"}]}] Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 0a383aae34c946f89d28d7d784685dd8 Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0357bf0a-70fd-4e63-b187-29a3df63575a'} Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:13.111337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Returning 404 to user: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee34dc8a-0759-4d48-adcf-eabced48d0f5 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 404 len: 111 microversion: 2.1 time: 0.089583 Oct 10 10:50:13.121836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1256/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:13 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:13.123028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7f301d-a22e-4560-9409-00d1989945be", "name": "network-vif-plugged", "status": "completed", "tag": "cd52b689-5938-4c18-95a2-52fcae59abd1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:13.137637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:13.140802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:13.143767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.144259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.144762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.151379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.152781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.153667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.175164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.177381 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] Creating event network-vif-plugged:cd52b689-5938-4c18-95a2-52fcae59abd1 for instance 8a7f301d-a22e-4560-9409-00d1989945be on n-h1-860687-2 Oct 10 10:50:13.177781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.178403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.185747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d14da04e-2ea1-4416-9e90-5203f7680aa2 req-740f6e7c-657a-43ad-89e8-a956b383984c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068082 Oct 10 10:50:13.191359 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1257/2625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:13.197240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:13.197954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:13.217644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.218392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.235337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.236566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:13.237092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:13.237538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:13.791245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:13.803674 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-898b6b7c-f9ee-4025-9caf-7ee3d3f2bbd6 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.610979 Oct 10 10:50:13.804276 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1258/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:13 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:13.814599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8034089-8ce4-4a13-8316-5c3fa5b2bd47 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d50d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:13.877673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:13.904549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f17b81f-0449-4feb-a241-0c7e2693d0e7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.779766 Oct 10 10:50:13.908184 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1369/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:13 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:13.927082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-094cabcf-cb58-4c1c-8fc0-896a8606f481 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '.version_select at 0x7f677ee08af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:13.941518 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8034089-8ce4-4a13-8316-5c3fa5b2bd47 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 200 len: 1437 microversion: 2.1 time: 0.130059 Oct 10 10:50:13.963338 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1259/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:50:13 2022] GET /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:13.997840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:14.001335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:14.010373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.013297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.013883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:14.014737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.015423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.022378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:14.103719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-094cabcf-cb58-4c1c-8fc0-896a8606f481 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702138466" status: 202 len: 0 microversion: 2.1 time: 0.193977 Oct 10 10:50:14.104666 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1370/2629] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702138466 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:50:14.112794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:14.113741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:14.131722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.138616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.139549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:14.140535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.144110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.158704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:14.612415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:14.628250 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a60335ec-7362-4774-aa67-065fa454114f tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1466 microversion: 2.1 time: 0.521542 Oct 10 10:50:14.636081 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1371/2630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:14 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1466 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:14.650242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:14.656149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:14.657115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:14.667665 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-244e277e-1d42-4ab6-8323-c5cd576f4d78 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.698255 Oct 10 10:50:14.670172 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1260/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:13 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:14.673620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.675803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.676506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:14.678243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19ca45a9-1218-41d7-8efe-e5450d3e8850 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f6780d8baf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:14.678732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:14.682732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:14.684022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.006482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:15.019791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:15.023507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:15.024751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ef9da1e-3a9f-4511-bc21-f8da5b16414b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.384773 Oct 10 10:50:15.025317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1372/2632] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:14 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:15.041197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:15.050253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:15.064671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.065181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.065625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.066343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.066806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.067270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.444387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:15.452801 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e7b68603-e5c1-4936-9665-49ddef8d7793 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.420316 Oct 10 10:50:15.458546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1373/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:15 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:15.465131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:15.465745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:15.491079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.491882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.492495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.494275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.496497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.497297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.886930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:15.904575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bdf783f7-28f9-4389-8e83-d550705a5e80 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.444698 Oct 10 10:50:15.906072 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1374/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:15 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:15.913258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "name": "network-vif-plugged", "status": "completed", "tag": "00be7ac5-7f4b-4eaf-8819-abf6a4462027"}, {"server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "name": "network-vif-plugged", "status": "completed", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:15.934053 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19ca45a9-1218-41d7-8efe-e5450d3e8850 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "DELETE /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc" status: 204 len: 0 microversion: 2.1 time: 1.258702 Oct 10 10:50:15.943219 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1261/2635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:14 2022] DELETE /compute/v2.1/images/74f3a736-2d3a-4860-958a-c1cf09b967fc => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:15.952284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.953842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:15.954487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:15.955217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.956134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.976947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.977441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.977873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:15.985864 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Creating event network-vif-plugged:00be7ac5-7f4b-4eaf-8819-abf6a4462027 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:50:15.986150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:15.986786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] Creating event network-vif-plugged:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:50:15.986935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:15.987538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:16.003178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-97dd2686-8e0e-412f-880d-28f348363049 req-5d659756-880f-4885-a4a6-d78773b498f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095568 Oct 10 10:50:16.006063 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1375/2636] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:16.013286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-588ada28-b649-4bd8-b86e-96464181f8de tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '.version_select at 0x7f677c08c5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:16.072322 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-588ada28-b649-4bd8-b86e-96464181f8de tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] HTTP exception thrown: Image not found. Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-588ada28-b649-4bd8-b86e-96464181f8de tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Request method failure captured: Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 HTTP/1.1 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iErVIGQkilvnP5ix_-HT25KjrdUAgEKpIEHsju12ZPT4-jHORZlqzIDZqX7XTa6MLQtAgk9h3QdKcdmOok4bFPYPeF0vl2lAgPgVCH30NxyKZep8qS2Swj7o3wU3zd0j5r2A4hj-2HVkxlBQe1mmZmdMMuVco3p_E9zhACm2N8TJg Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59dd868a1eb44951b5aca992f87527cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59dd868a1eb44951b5aca992f87527cb"}]}] Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2ad413c40d2e45ce9fb7183d9afbbafe Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4a8df89f-2f71-42f3-b731-b7512bcb7d26'} Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4a8df89f-2f71-42f3-b731-b7512bcb7d26 to delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a8df89f-2f71-42f3-b731-b7512bcb7d26 could not be found. Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.081298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:50:16.086532 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:16.092253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-588ada28-b649-4bd8-b86e-96464181f8de tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:16.093368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-588ada28-b649-4bd8-b86e-96464181f8de tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "DELETE /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26" status: 404 len: 62 microversion: 2.1 time: 0.085711 Oct 10 10:50:16.097541 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1376/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:16 2022] DELETE /compute/v2.1/images/4a8df89f-2f71-42f3-b731-b7512bcb7d26 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:50:16.103697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:16.104776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:16.114773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:16.115577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:16.116264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:16.117355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:16.118069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:16.118768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:16.976026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:16.999894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26675937-372a-4a45-a59b-c4087185d413 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 1.046741 Oct 10 10:50:17.002984 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1262/2638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:15 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:17.026524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:17.027125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:17.038178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.049556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.051049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.052417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74a5403d-3193-4ecd-9647-e1f0c6699393 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.953552 Oct 10 10:50:17.053343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1377/2639] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:16 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:17.063800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.064296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.064734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.065441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.065784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:17.065938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.066309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.066873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:17.075100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.075604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.076482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.077221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.077752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.078195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.147179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:17.281572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.292978 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fdbd4bae-1ae6-490a-9cfc-d2c29fcb326c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1334 microversion: 2.1 time: 0.238259 Oct 10 10:50:17.303629 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1378/2640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:17 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:17.326773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:17.328080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:17.340413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.341557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.342597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.344400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.345299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.345964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.363548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f25aabf-844d-4116-b089-7488d5f9cab5 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 204 len: 0 microversion: 2.1 time: 0.358925 Oct 10 10:50:17.364182 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1263/2641] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:17 2022] DELETE /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:17.373592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:17.374301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:17.412772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.413279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.413723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.414440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:17.414898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:17.415737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:17.765400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.778520 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ffa7c10-85ed-4d73-a86a-975fb61a9c9e tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1472 microversion: 2.1 time: 0.409612 Oct 10 10:50:17.783920 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1264/2642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:17 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:17.815113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:17.827423 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3edbf04b-80b9-4aed-8995-e62b103d163a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 0.521830 Oct 10 10:50:17.828147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1379/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:17 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:18.029030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:18.032457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:18.064553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.066072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.066788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.067749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.068979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.069664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.081146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:18.081759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:18.099764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.100518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.101145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.102074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.102713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.106481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.367588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:18.376285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:18.380497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff75cfb6-a677-4cb5-bb3b-b927df5048ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.358393 Oct 10 10:50:18.388944 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1265/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:18 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:18.394166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f186-3cf1-4caa-93e7-67caef14166b", "name": "network-vif-plugged", "status": "completed", "tag": "ba2c123e-7d3f-4b48-baf2-3262b0eadc0d"}, {"server_uuid": "965f7d2d-6ba5-4f25-9379-8481012f1f27", "name": "network-vif-plugged", "status": "completed", "tag": "c61ff0c1-651f-4758-be53-bf45e1a11766"}, {"server_uuid": "2637734c-fbd1-456f-9da2-73c5c7638264", "name": "network-vif-plugged", "status": "completed", "tag": "4e46de01-f80b-43c1-826b-aca8e9d69e1d"}, {"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-unplugged", "status": "completed", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:18.432839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.436671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.437229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.486610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Creating event network-vif-plugged:ba2c123e-7d3f-4b48-baf2-3262b0eadc0d for instance 13d8f186-3cf1-4caa-93e7-67caef14166b on n-h1-860687-2 Oct 10 10:50:18.486610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Creating event network-vif-plugged:c61ff0c1-651f-4758-be53-bf45e1a11766 for instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 on n-h2-860687-2 Oct 10 10:50:18.488107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Creating event network-vif-plugged:4e46de01-f80b-43c1-826b-aca8e9d69e1d for instance 2637734c-fbd1-456f-9da2-73c5c7638264 on n-h1-860687-2 Oct 10 10:50:18.491783 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] Creating event network-vif-unplugged:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:50:18.536677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-48b13ee0-3303-472b-97fd-5d8b40251fea req-0770510b-9876-4000-aa51-48276ec01f32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.126932 Oct 10 10:50:18.539360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1266/2645] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:18.553951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:18.556993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:18.567783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.569003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.569639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.570528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.571320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.572310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.837014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:18.855259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:18.868356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:18.872731 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e6d3a26-e830-4cfb-a5a6-fb56471e2c92 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.794022 Oct 10 10:50:18.904280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1380/2646] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:18 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:18.919466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:18.924333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:18.931756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.943961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.944240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:18.947498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:18.948020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:18.948466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:19.602558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:19.615323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e64fc51-00e4-46da-bb11-4c5eb94f9fa8 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1669 microversion: 2.1 time: 1.072845 Oct 10 10:50:19.617942 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1267/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:18 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1669 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:19.628840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:19.632037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:19.656352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:19.656860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:19.663485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:19.664265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:19.664743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:19.672592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:19.691384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:19.706433 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f09864d9-2f72-4609-ab73-b304399e7811 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1472 microversion: 2.1 time: 0.800840 Oct 10 10:50:19.707570 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1381/2648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:18 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1472 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:19.725868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:19.726658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:19.736027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:19.739624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:19.740812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:19.752755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:19.753368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:19.753917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:20.584645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:20.600145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7bb3facd-2bbe-4b8c-934d-9da253ed782b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1322 microversion: 2.1 time: 0.891404 Oct 10 10:50:20.601195 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1382/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:19 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1322 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:20.612114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:20.612725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:20.630773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:20.631649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:20.633011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:20.634216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:20.635160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:20.635934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:20.703844 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea338920-8fbf-4854-8846-2f33a6fd5cb5 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d/ips" status: 200 len: 179 microversion: 2.1 time: 0.101420 Oct 10 10:50:20.708611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1383/2650] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:50:20 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d/ips => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:20.717696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:20.722304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:20.739413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:20.739832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:20.740268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:20.742922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:20.744720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:20.745166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.126033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:21.143700 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2e4e78f-3006-49a5-972c-483c7cf977b7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1477 microversion: 2.1 time: 1.524475 Oct 10 10:50:21.175145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1268/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:19 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1477 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:21.189537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:21.194768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:21.222691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.224054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.224525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.228300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.232569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.234083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.362888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:21.582033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93c48991-d258-4e4c-96aa-290ee3891047 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 204 len: 0 microversion: 2.1 time: 0.403465 Oct 10 10:50:21.585368 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1269/2652] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:21 2022] DELETE /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:21.602496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:21.609292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:21.610205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:21.613300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:21.618576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.619535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.620140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.621425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:21.621841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.623094 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e402abe-303e-4a24-906f-77fb676c1d08 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.913426 Oct 10 10:50:21.623461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.624144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.624793 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1384/2653] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:20 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:21.649039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:21.662510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:21.680957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.681461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.681905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.682656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:21.683745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:21.684361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:21.689095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:22.093385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad413c40d2e45ce9fb7183d9afbbafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd868a1eb44951b5aca992f87527cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:22.117983 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30c978bf-928f-4b9c-a9e3-72e4fc3632f0 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 200 len: 1430 microversion: 2.1 time: 0.529764 Oct 10 10:50:22.134128 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1270/2654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:21 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 1430 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:22.177529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:22.182725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:22.208825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:22.217285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:22.230799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:22.231388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:22.232289 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-71375962-2cc0-47a8-baa7-51efc3c70204 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1675 microversion: 2.1 time: 0.593568 Oct 10 10:50:22.233384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1385/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:21 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1675 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:22.235297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:22.235804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:22.236244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:22.239506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:22.240662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:22.292052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:22.296605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:22.299205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:22.300406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:22.302670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:22.306509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:22.927525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:22.953929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e7002d5-45cc-4b28-aa9c-1293b9787db1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1463 microversion: 2.1 time: 0.705142 Oct 10 10:50:22.956159 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1386/2656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:22 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1463 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:22.970617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2742bcf1-03fb-412d-b7c4-5ffbb98aa92a", "name": "network-vif-deleted", "tag": "5c2f5334-54fe-4edb-9af4-fce8e300e6f7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:23.011689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:23.017184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:23.018438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:23.107809 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] Creating event network-vif-deleted:5c2f5334-54fe-4edb-9af4-fce8e300e6f7 for instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a on n-h1-860687-2 Oct 10 10:50:23.119584 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-025c0200-96d2-4597-ba3c-0e9022a378d3 req-e20dc0cc-ad5e-49dd-8d67-c48cb15cd663 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160980 Oct 10 10:50:23.121959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1387/2657] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:23.131267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:23.143024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:23.144121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:23.148143 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75947fb6-35f0-4de3-94cc-e8ba727f7832 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 200 len: 1514 microversion: 2.1 time: 1.010645 Oct 10 10:50:23.149513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1271/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:22 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 1514 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:23.161649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:23.164722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:23.197192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:23.199233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:23.202372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:23.203836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:23.204190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:23.204599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:23.206836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:23.207504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:23.208396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:23.209744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:23.211127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:23.211811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.131286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.149638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.154288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.156231 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-15babd6d-ec19-4e6b-95d0-a9a9e058370c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 1.026471 Oct 10 10:50:24.158818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1388/2659] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:23 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:24.170694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:24.174167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] [instance: 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.188590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.189107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.190887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.192551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.194028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.195408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.196637 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81b2ff03-85d0-4ce1-b7eb-4658b49bcdfc tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1463 microversion: 2.1 time: 1.044972 Oct 10 10:50:24.197220 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1272/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:23 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1463 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:24.211234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.223753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:24.225284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.231955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.232888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.233021 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] HTTP exception thrown: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. Oct 10 10:50:24.233670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.235333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.236017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.236732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Request method failure captured: Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a HTTP/1.1 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iErVIGQkilvnP5ix_-HT25KjrdUAgEKpIEHsju12ZPT4-jHORZlqzIDZqX7XTa6MLQtAgk9h3QdKcdmOok4bFPYPeF0vl2lAgPgVCH30NxyKZep8qS2Swj7o3wU3zd0j5r2A4hj-2HVkxlBQe1mmZmdMMuVco3p_E9zhACm2N8TJg Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_59dd868a1eb44951b5aca992f87527cb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/59dd868a1eb44951b5aca992f87527cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/59dd868a1eb44951b5aca992f87527cb"}]}] Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 59dd868a1eb44951b5aca992f87527cb Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1814717636 Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2ad413c40d2e45ce9fb7183d9afbbafe Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerTestJSON-1814717636-project Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2742bcf1-03fb-412d-b7c4-5ffbb98aa92a'} Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:24.237714 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.241658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] Returning 404 to user: Instance 2742bcf1-03fb-412d-b7c4-5ffbb98aa92a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:24.242185 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc29d5e7-221e-41f7-ac21-3d9c6f58a122 tempest-ImagesOneServerTestJSON-1814717636 tempest-ImagesOneServerTestJSON-1814717636-project] 10.222.0.16 "GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a" status: 404 len: 111 microversion: 2.1 time: 0.080846 Oct 10 10:50:24.246615 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1389/2661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:24 2022] GET /compute/v2.1/servers/2742bcf1-03fb-412d-b7c4-5ffbb98aa92a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:24.265963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:24.274713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.289293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.294038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.295252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.296135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.296612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.297047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.657400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.666338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-39bc733a-9e2e-42ec-931a-6c63e9a97c76 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1654 microversion: 2.1 time: 0.418187 Oct 10 10:50:24.679315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1390/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:24 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1654 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:24.679434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:24.689136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:24.698193 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-459f5d5c-1792-4c39-aa73-0b04a78c7bd2 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 200 len: 1513 microversion: 2.1 time: 0.476306 Oct 10 10:50:24.712446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.712961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1273/2663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:24 2022] GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:24.723086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:24.725552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.725786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.727578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.741993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.744374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.744880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.745431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.751215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.751719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.752162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.752887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.753349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.753782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.797335 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] HTTP exception thrown: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Request method failure captured: Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a HTTP/1.1 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_g8uIMv4C1g9Q96CKTX8a1I9pFNP-kMuPOiVFxHZgyUPqNJWSbnoETVvayv8v5y7IN8wZEuVUkxL88K2mUxUabavxZeY_0NOT31apQjbpR5smK8ab6ufI0-NJ2RcwOm1Wzt3boK9hdcv1KMjUurzeSxGhjs9TheJ2ScxzXa8TrCgkY Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7aca1a275c5c431dbce978ab85f072e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7aca1a275c5c431dbce978ab85f072e0"}]}] Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 0a383aae34c946f89d28d7d784685dd8 Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0357bf0a-70fd-4e63-b187-29a3df63575a'} Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:24.799096 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Returning 404 to user: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dfcb2e1-a98f-4a7a-a51f-2f8485461dbf tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 404 len: 111 microversion: 2.1 time: 0.095013 Oct 10 10:50:24.802830 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1274/2664] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:24 2022] DELETE /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:24.817157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:24.817798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:24.847494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.848474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.864150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.870942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:24.875247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:24.876630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:24.944972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:50:24.947554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:50:24.948275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:50:24.949008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:50:24.951319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:50:25.175280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:25.202638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.203371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.208886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.209881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.210370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.212839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.322354 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9448b99-a16d-431b-87e9-ac36a02cfdb7 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 1067 microversion: 2.1 time: 0.645512 Oct 10 10:50:25.323085 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1391/2665] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:50:24 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 1067 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 10:50:25.351364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:25.352029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] [instance: 0357bf0a-70fd-4e63-b187-29a3df63575a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:25.369869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.370421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.370871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.372978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.373390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.375569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.412434 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] HTTP exception thrown: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Request method failure captured: Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a HTTP/1.1 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_g8uIMv4C1g9Q96CKTX8a1I9pFNP-kMuPOiVFxHZgyUPqNJWSbnoETVvayv8v5y7IN8wZEuVUkxL88K2mUxUabavxZeY_0NOT31apQjbpR5smK8ab6ufI0-NJ2RcwOm1Wzt3boK9hdcv1KMjUurzeSxGhjs9TheJ2ScxzXa8TrCgkY Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7aca1a275c5c431dbce978ab85f072e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7aca1a275c5c431dbce978ab85f072e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7aca1a275c5c431dbce978ab85f072e0"}]}] Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 7aca1a275c5c431dbce978ab85f072e0 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-334412802 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 0a383aae34c946f89d28d7d784685dd8 Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-334412802-project Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0357bf0a-70fd-4e63-b187-29a3df63575a'} Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:25.414155 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] Returning 404 to user: Instance 0357bf0a-70fd-4e63-b187-29a3df63575a could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:25.419014 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-974ffd7e-9be3-42b7-a99c-945db750ec71 tempest-AttachSCSIVolumeTestJSON-334412802 tempest-AttachSCSIVolumeTestJSON-334412802-project] 10.222.0.16 "GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a" status: 404 len: 111 microversion: 2.1 time: 0.089149 Oct 10 10:50:25.419756 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1392/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:25 2022] GET /compute/v2.1/servers/0357bf0a-70fd-4e63-b187-29a3df63575a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:25.426766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "name": "network-vif-deleted", "tag": "00be7ac5-7f4b-4eaf-8819-abf6a4462027"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:25.451088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.451496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.451930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.486105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] Creating event network-vif-deleted:00be7ac5-7f4b-4eaf-8819-abf6a4462027 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:50:25.491966 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d64bac4d-d5b3-48a1-9092-29eb7d75ab7e req-0db503d8-d46d-4d76-917d-c64c097d812a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070993 Oct 10 10:50:25.492956 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1393/2667] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:25.498732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:25.499771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:25.513679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.514464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.515373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.516311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.516932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.517537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.553206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:25.567268 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cda4a341-2f85-4cab-911c-24fb64a15558 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 200 len: 1513 microversion: 2.1 time: 0.762644 Oct 10 10:50:25.569820 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1275/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:24 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 1513 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:25.608864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:25.609954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:25.627769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.628735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.629416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.630342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:25.631028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:25.631701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:25.966155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:25.977191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:25.978643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:25.991526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56518321-c7d3-452f-909a-313dfda4db9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.497283 Oct 10 10:50:26.007050 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1394/2669] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:25 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:26.007050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:26.007050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:26.022596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.023283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.023853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.026218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.026940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.033967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.094378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:26.123098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:26.131038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c150a7fc-1c3e-43e6-bcb4-fd2438c71a42 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.544513 Oct 10 10:50:26.131609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1276/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:25 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:26.141263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:26.150634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:26.163897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.166914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.167722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.169646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.170340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.173658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.246053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e2f8e116-8485-4e4c-bf18-e86faf89cd5c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 204 len: 0 microversion: 2.1 time: 0.252188 Oct 10 10:50:26.249473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1395/2671] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:25 2022] DELETE /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:26.275683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:26.278206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:26.293061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.295143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.295825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.296742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:26.303287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:26.303989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:26.444328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:26.454077 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a0ab5c0-a6cf-465b-bcfc-5c866da8e949 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1496 microversion: 2.1 time: 0.316553 Oct 10 10:50:26.456690 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1277/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:26 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1496 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:26.571089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:26.586961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e159c88e-1682-4634-88be-c600f6520a3c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 200 len: 1519 microversion: 2.1 time: 0.333790 Oct 10 10:50:26.587804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1396/2673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:26 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:27.023294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:27.023914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:27.039785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.040568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.041039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.041965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.043206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.043648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.157595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:27.158489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:27.169951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:27.189762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.191803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.192620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.195355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.196136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.197489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.436304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:27.451862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:27.456106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:27.457541 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b509d91-47be-4aca-922e-f94880109c9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.438888 Oct 10 10:50:27.460551 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1278/2674] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:27 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:27.484020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:27.484963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:27.522575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.524215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.524686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.525414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.525930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.526397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.587506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:27.605606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93eb7ef7-7d58-460b-a97d-6887c9d0b9b8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.449959 Oct 10 10:50:27.623440 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1397/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:27 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:27.627171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:27.629921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:27.641416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.645331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.646168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.647172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:27.650030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:27.650936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:27.661217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:27.670361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ee311f0-2b89-4688-a02d-ec168bc7d83c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1454 microversion: 2.1 time: 0.192223 Oct 10 10:50:27.680057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1279/2676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:27 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1454 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:28.107749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfeaa47-ce43-4d1c-a441-820051c3644d", "name": "network-vif-deleted", "tag": "8f7cbf2f-f273-46c7-ab81-b79abb978923"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:28.120389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:28.146575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6322ec39-2f16-4d2b-b24b-1ed4adeb9336 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 200 len: 1519 microversion: 2.1 time: 0.525374 Oct 10 10:50:28.148011 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1398/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:27 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:28.178340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:28.179091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:28.180473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:28.209698 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] Creating event network-vif-deleted:8f7cbf2f-f273-46c7-ab81-b79abb978923 for instance 1bfeaa47-ce43-4d1c-a441-820051c3644d on n-h2-860687-2 Oct 10 10:50:28.220220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b3109553-ea43-4281-8c23-bcc971906bcd req-f6fb9ee4-1da3-4e08-8d6b-7956e35612c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122560 Oct 10 10:50:28.221611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1280/2678] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:28.493939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:28.494569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:28.508961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:28.509474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:28.509925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:28.510665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:28.511259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:28.511700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:28.635273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:28.636562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:28.659941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:28.661668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:28.663519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:28.665392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:28.668197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:28.669143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.362700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.374836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.378676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.383149 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4103e742-4732-4d47-b369-9abe56c9683a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.893171 Oct 10 10:50:29.384167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1399/2679] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:28 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:29.394404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:29.398631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:29.411153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.416186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.418004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.420415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.422433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.424117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.518555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.519726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.521912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.523766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lazy-loading 'fault' on Instance uuid 1bfeaa47-ce43-4d1c-a441-820051c3644d {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:50:29.536316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:29.626577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f475c6af5cd7479cafdcb1e490119f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d15ad837fe4274b7511c1d9c1971f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.637531 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-15bedfb2-c586-4c61-9f2c-7e34361b91aa tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 200 len: 1303 microversion: 2.1 time: 0.246186 Oct 10 10:50:29.640424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1400/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:29 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:29.648122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.670535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93b7f87d-1697-4caf-9499-8d8728b71933 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 1.041050 Oct 10 10:50:29.670786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:29.671762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:29.674589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1281/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:28 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:29.679664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7f301d-a22e-4560-9409-00d1989945be", "name": "network-vif-deleted", "tag": "cd52b689-5938-4c18-95a2-52fcae59abd1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:29.695119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.698165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.699262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.706130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.706966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.708238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.728960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:29.737153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:29.738136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:29.789179 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] Creating event network-vif-deleted:cd52b689-5938-4c18-95a2-52fcae59abd1 for instance 8a7f301d-a22e-4560-9409-00d1989945be on n-h1-860687-2 Oct 10 10:50:29.814155 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a8fc5d5c-31e2-4050-b6d9-7760b19f64b9 req-9b437675-e325-47ac-acc0-a16c777771b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135670 Oct 10 10:50:29.816589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1282/2682] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:29.951281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:29.951281 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-463f9e28-a827-4432-984a-9cebf0475736 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 200 len: 1307 microversion: 2.1 time: 0.291337 Oct 10 10:50:29.951281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1401/2683] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:29 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:30.416048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:30.419416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:30.430565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.431825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.432492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:30.436322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.437231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.437920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:30.478029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:30.666311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:30.666950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:30.690480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.691101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.692701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:30.693634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.694118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.695877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:30.732887 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d HTTP/1.1 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1bfeaa47-ce43-4d1c-a441-820051c3644d'} Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:30.735607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:30.741852 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:30.745014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:30.750500 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4543be4a-2294-4c76-90b0-684367d5cfa1 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 404 len: 111 microversion: 2.1 time: 0.089330 Oct 10 10:50:30.757826 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1402/2684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:30 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:30.766562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:30.768316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:30.777687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.778666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.779599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:30.781088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:30.781945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:30.782576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.384945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.399544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.408609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.421889 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b9e96df-4406-437b-93c1-27c6f36908a6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 1.011632 Oct 10 10:50:31.422792 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1283/2685] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:30 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:31.446596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:31.456429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:31.476449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.477399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.478849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.481557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.482032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.487802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.531892 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] HTTP exception thrown: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be HTTP/1.1 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8a7f301d-a22e-4560-9409-00d1989945be'} Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.540901 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:31.547095 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.555157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 404 to user: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:31.556492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78a42232-b216-4060-bbe7-9e13d9ca4a89 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 404 len: 111 microversion: 2.1 time: 0.132576 Oct 10 10:50:31.557593 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1284/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:31 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:31.572248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:31.573740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.583461 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-094378e5-aa33-4863-be46-db6bdc063a95 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.823878 Oct 10 10:50:31.588596 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1403/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:30 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:31.619298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.623608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:31.647344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.649795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.654757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.655801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.662702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.665211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.791766 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e856746-6d4b-4de0-81e8-482959ba38f4 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.228692 Oct 10 10:50:31.793544 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1285/2688] 10.222.0.16 () {58 vars in 1230 bytes} [Mon Oct 10 10:50:31 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:31.806287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3716f3f8-fb28-43ba-8ab6-f184ec6150f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3716f3f8-fb28-43ba-8ab6-f184ec6150f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 10:50:31.812873 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 10:50:31.817879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:31.820100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3716f3f8-fb28-43ba-8ab6-f184ec6150f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:31.822989 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3716f3f8-fb28-43ba-8ab6-f184ec6150f1 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.021174 Oct 10 10:50:31.827816 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1404/2689] 10.222.0.16 () {58 vars in 1182 bytes} [Mon Oct 10 10:50:31 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:50:31.833541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:31.840229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.841241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:31.847139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.847906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.848552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.849522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.850189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.850820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.886931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:50:31.923407 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bff18f21-62da-4bbe-b0d6-eab77ca7a6bc tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.093844 Oct 10 10:50:31.935154 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1286/2690] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:50:31 2022] GET /compute/v2.1/servers => generated 681 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:31.940782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:31.952737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:31.955398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.servers [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Removing options 'limit' from query {{(pid=128800) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 10:50:31.956477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:31.978232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.979329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.980020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:31.980961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:31.981644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:31.982264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.042565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:50:32.101183 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b08c6e4-5cb1-4666-bec3-163605cce688 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.168609 Oct 10 10:50:32.110907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1405/2691] 10.222.0.16 () {58 vars in 1144 bytes} [Mon Oct 10 10:50:31 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:32.118232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e0dc835-02eb-4311-887c-9c2f14089a3d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e0dc835-02eb-4311-887c-9c2f14089a3d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: action_args: {} Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '-1' Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 10:50:32.123866 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e0dc835-02eb-4311-887c-9c2f14089a3d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e0dc835-02eb-4311-887c-9c2f14089a3d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.012054 Oct 10 10:50:32.128517 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1287/2692] 10.222.0.16 () {58 vars in 1142 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:50:32.147493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb612dc3-ef41-48b0-a9d1-76176d614dea tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb612dc3-ef41-48b0-a9d1-76176d614dea tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: action_args: {} Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'testing' Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 10:50:32.153529 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb612dc3-ef41-48b0-a9d1-76176d614dea tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:32.157701 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb612dc3-ef41-48b0-a9d1-76176d614dea tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022786 Oct 10 10:50:32.160644 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1406/2693] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:50:32.168402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7537ef94-c14a-40f9-b207-eecd4983e56c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.179822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7537ef94-c14a-40f9-b207-eecd4983e56c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:32.180450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7537ef94-c14a-40f9-b207-eecd4983e56c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:32.199436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.servers [None req-7537ef94-c14a-40f9-b207-eecd4983e56c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Flavor 'non_existing_flavor' could not be found {{(pid=128801) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 10 10:50:32.203124 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7537ef94-c14a-40f9-b207-eecd4983e56c tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039238 Oct 10 10:50:32.203747 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1288/2694] 10.222.0.16 () {58 vars in 1178 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:50:32.223652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.231155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:32.231950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:32.252020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.252580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.253562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.254907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.255912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.256656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.418634 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-925ad896-0d73-4e3e-afde-4bf278305b28 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.205145 Oct 10 10:50:32.429008 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1407/2695] 10.222.0.16 () {58 vars in 1174 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:32.435780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.451541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:32.454759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:32.465529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.466925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:32.475895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.477599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.477747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.477747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.478108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.478732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.478870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.479322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.480132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.480320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.483077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.483576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.720600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cbb74a1-6840-4dd9-be85-5ab482bcd575 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.289288 Oct 10 10:50:32.732466 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1289/2696] 10.222.0.16 () {58 vars in 1184 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:32.737794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:32.738418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:32.754878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.757091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.757714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:32.758625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:32.759643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:32.760274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:33.083868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.112037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.122413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.128986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b604fec4-54e8-403c-99a4-c32af1a897ab tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1737 microversion: 2.20 time: 0.679246 Oct 10 10:50:33.136148 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1408/2697] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1737 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:33.146685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:33.156543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.157842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:33.184472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:33.184984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:33.185429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:33.186189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:33.186640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:33.187098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:33.269377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:50:33.312071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.319394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:33.320023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:33.320552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:33.825740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:33.840510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdc95626-fc7f-4f1c-839d-ad593853f572 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 1.106835 Oct 10 10:50:33.855038 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1290/2698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:32 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:34.114545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4acbe114-630b-421b-907a-bf18b4557b07 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 0.976969 Oct 10 10:50:34.116872 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1409/2699] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:50:33 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:34.152048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc45ed92-32e7-4257-a647-154135058f20 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.157596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc45ed92-32e7-4257-a647-154135058f20 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:34.157853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.158403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:34.159456 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc45ed92-32e7-4257-a647-154135058f20 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017705 Oct 10 10:50:34.161078 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1291/2700] 10.222.0.16 () {58 vars in 1178 bytes} [Mon Oct 10 10:50:34 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:50:34.177854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.182063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.182063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.182063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.182063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.182063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.183152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.192475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:34.193171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Searching by: {'deleted': False, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:50:34.217952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.233449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.234123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.234975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.238863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.240768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.312681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:50:34.402608 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4407790-c51f-4ffe-847c-1d4122ec49ef tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.232853 Oct 10 10:50:34.403813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1292/2701] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:50:34 2022] GET /compute/v2.1/servers => generated 681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:34.418142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.419124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:34.426534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.427444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.428110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.429111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.429800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.430452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.452314 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] HTTP exception thrown: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be HTTP/1.1 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8a7f301d-a22e-4560-9409-00d1989945be'} Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:34.454920 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:34.458627 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:34.461070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 404 to user: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:34.462207 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcb0d5e2-2618-4c48-af63-8f5cf16f0d4b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 404 len: 111 microversion: 2.1 time: 0.048329 Oct 10 10:50:34.467802 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1293/2702] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:34 2022] DELETE /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:34.474079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.474944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:34.483661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.484542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.485253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.486209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.486895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.488064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.530274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:34.699791 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51fe69d9-3620-46e4-8e9d-be92b3c8a36e tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "DELETE /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 204 len: 0 microversion: 2.1 time: 0.230047 Oct 10 10:50:34.706093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1294/2703] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:34 2022] DELETE /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:34.715376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.716513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:34.736809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.737640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.738488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.739426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.741959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.742641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.789031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:50:34.906268 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e47f17a8-91c4-4f4d-aa21-a37350de4724 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 204 len: 0 microversion: 2.1 time: 0.195714 Oct 10 10:50:34.906943 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1295/2704] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:34 2022] DELETE /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:34.918785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:34.923905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:34.940778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.941897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.943348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:34.947534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:34.948813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:34.949438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.161926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:35.177062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:35.179046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:35.180658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5660e799-a210-4a42-b6fc-da810c4c8150 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1719 microversion: 2.20 time: 1.027465 Oct 10 10:50:35.192832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1410/2705] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:34 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1719 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:35.199510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:35.200252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 8a7f301d-a22e-4560-9409-00d1989945be] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:35.206702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:35.207324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:35.207852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.208756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:35.209525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:35.210132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.228372 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] HTTP exception thrown: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be HTTP/1.1 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '8a7f301d-a22e-4560-9409-00d1989945be'} Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:35.230610 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 404 to user: Instance 8a7f301d-a22e-4560-9409-00d1989945be could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:35.234549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a68c56fa-1f0d-402e-80cf-4c66ea4f25f8 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be" status: 404 len: 111 microversion: 2.1 time: 0.038271 Oct 10 10:50:35.236428 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1411/2706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:35 2022] GET /compute/v2.1/servers/8a7f301d-a22e-4560-9409-00d1989945be => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:35.241729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:35.242512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:35.249000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:35.249835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:35.250427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.251338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:35.251946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:35.252588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.650540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:35.672452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a7063b5-1cfe-4b58-9f42-ab68bbb2fd76 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.759624 Oct 10 10:50:35.673781 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1296/2707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:34 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:35.680081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "name": "network-vif-unplugged", "status": "completed", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:35.701508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:35.703912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:35.705557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:35.736153 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] Creating event network-vif-unplugged:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:50:35.744501 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-29331976-5f87-4aa2-b362-f1b1eca18eb5 req-b37c4bdd-908d-414c-a9b1-dcfc2f40ea3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068458 Oct 10 10:50:35.750403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1297/2708] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:35.888339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:35.899500 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-404fb1f0-4e6b-46db-94d9-5eca2d9ac59a tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 200 len: 1519 microversion: 2.1 time: 0.661526 Oct 10 10:50:35.900755 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1412/2709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:35 2022] GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 1519 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:36.212450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:36.213283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:36.220410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:36.265108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:36.265628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:36.266188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:36.266909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:36.267488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:36.267916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:36.696452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:36.698551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:36.711179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:36.712599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:36.713232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:36.715837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:36.717959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:36.718731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:37.077212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:37.089176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:37.091875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:37.093415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07510d7d-7b80-48df-9960-852d55e64552 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1719 microversion: 2.20 time: 0.886896 Oct 10 10:50:37.112933 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1298/2710] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:36 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1719 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:37.120866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:37.121716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:37.133037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:37.133537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:37.133977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:37.134689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:37.145731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:37.146479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:37.888361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:37.896686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-184c6cc6-014e-49cc-ab45-fee0462bacf1 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 1.204485 Oct 10 10:50:37.897304 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1413/2711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:36 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:38.125073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:38.125700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:38.132155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:38.148590 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de67cf88-9564-4301-abf5-527fe1a3bc2b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 200 len: 1519 microversion: 2.1 time: 1.032815 Oct 10 10:50:38.149225 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1299/2712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:37 2022] GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 1519 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.163096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.227190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2637734c-fbd1-456f-9da2-73c5c7638264", "name": "network-vif-deleted", "tag": "4e46de01-f80b-43c1-826b-aca8e9d69e1d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:38.249205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.249697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.250131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.288610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] Creating event network-vif-deleted:4e46de01-f80b-43c1-826b-aca8e9d69e1d for instance 2637734c-fbd1-456f-9da2-73c5c7638264 on n-h1-860687-2 Oct 10 10:50:38.294467 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-59cf9b44-9720-44db-b14c-556b6bb4232e req-f9161ecc-2ef3-4a1f-a5e1-c533eed52bab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072298 Oct 10 10:50:38.296465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1300/2713] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:50:38.623548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:38.640901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:38.642535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:38.644086 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eec54abb-3657-4fc1-b568-ab018a1e6ccb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1662 microversion: 2.20 time: 0.522969 Oct 10 10:50:38.646288 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1414/2714] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:38 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1662 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:50:38.671601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d8c74a5-1f28-4031-a3a2-d5265414aea6"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:38.674649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:38.681997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.683729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.684384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.685346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.686054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.686695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.922697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:38.923734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:38.936501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.938338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.939054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.940837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:38.942042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:38.943973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:38.982955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:39.267925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-781d253c-c2a9-4518-863d-56d7895426fe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.600134 Oct 10 10:50:39.270367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1301/2715] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 10 10:50:38 2022] POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 188 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:50:39.317975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:39.319706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.334600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.337581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.338087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.340715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.342643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.344916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.592151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac08792ebf664fa5a83267f3625b7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf244d5a2104dca95e723a0f78f5ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:39.609273 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1909dc3b-54da-4203-a7b3-c1717f3f5905 tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 200 len: 1477 microversion: 2.1 time: 0.314290 Oct 10 10:50:39.611032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1302/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:39 2022] GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:39.622490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965f7d2d-6ba5-4f25-9379-8481012f1f27", "name": "network-vif-deleted", "tag": "c61ff0c1-651f-4758-be53-bf45e1a11766"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:39.640865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.641573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.642230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.663619 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] Creating event network-vif-deleted:c61ff0c1-651f-4758-be53-bf45e1a11766 for instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 on n-h2-860687-2 Oct 10 10:50:39.669377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d96e232a-c154-4d41-a77e-d30cfff12f59 req-9d465ffe-3ba6-485a-8b4a-7ec579a91539 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053819 Oct 10 10:50:39.670230 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1303/2717] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:39.675477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:39.676285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.685657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.686336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.686946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.687920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.688706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.689299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.706691 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d HTTP/1.1 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1bfeaa47-ce43-4d1c-a441-820051c3644d'} Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:39.710244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.715098 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.717342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:39.719171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9ca7d20-5242-44c0-8267-1695867a9e98 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 404 len: 111 microversion: 2.1 time: 0.047274 Oct 10 10:50:39.720788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1304/2718] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:39 2022] DELETE /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:39.726198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:39.727089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.735409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.736418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.737729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.738644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.739293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.739886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.773349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:39.799348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 10:50:39.799765 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1fd6ec33-5c2f-4fba-9987-bd186aff76ea tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.880156 Oct 10 10:50:39.825313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1415/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:38 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:39.842894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:39.851911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: 1bfeaa47-ce43-4d1c-a441-820051c3644d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.858974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.859507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.859946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.860649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.861103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.861529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.900073 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d HTTP/1.1 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1bfeaa47-ce43-4d1c-a441-820051c3644d'} Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:39.903738 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. Oct 10 10:50:39.907607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:39.909907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance 1bfeaa47-ce43-4d1c-a441-820051c3644d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:39.911035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8ec1154-8875-4906-add3-69e88c7b65fc tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d" status: 404 len: 111 microversion: 2.1 time: 0.083854 Oct 10 10:50:39.912156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1416/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:39 2022] GET /compute/v2.1/servers/1bfeaa47-ce43-4d1c-a441-820051c3644d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:39.921061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:39.921853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.933042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0094a588-cd22-4ab2-9c4b-947f3c354b29 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/action" status: 202 len: 0 microversion: 2.20 time: 0.210391 Oct 10 10:50:39.934077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1305/2721] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:50:39 2022] POST /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:50:39.941658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.942210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:39.942839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:39.950778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.953071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.954769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.957997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.960383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.962585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.963112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.964103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.966343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:39.966836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:39.967304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:39.997493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d HTTP/1.1 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c12a2502-fc4f-4842-afda-6dbd8320a24d'} Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:40.001027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.004961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.008097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:40.009364 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-349cf544-94e1-4537-bca1-fdd230410b4c tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 404 len: 111 microversion: 2.1 time: 0.093029 Oct 10 10:50:40.010204 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1417/2722] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:50:39 2022] DELETE /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:40.018902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:40.020005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] [instance: c12a2502-fc4f-4842-afda-6dbd8320a24d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:40.027185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.028153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.028832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.029775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.030454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.032815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.054871 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] HTTP exception thrown: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Request method failure captured: Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d HTTP/1.1 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_hrcgfRaQ0yAOLkwzkY7pkz8shwMghN7fPyHmcIHD30UX60aFIEcoaPzu-5p_O8CTbvll0hITYLGqVUQY9lYW9ypGxPog2iD16sgbd6pkEheyX-0myfwC8tZe1XTVewpPT6b3PVEV6kvwwKF0wlJWP3osTDGUIBYVGG9bIMF8NWitA Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62d15ad837fe4274b7511c1d9c1971f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62d15ad837fe4274b7511c1d9c1971f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62d15ad837fe4274b7511c1d9c1971f5"}]}] Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 62d15ad837fe4274b7511c1d9c1971f5 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestMultiNic-1887369084 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f475c6af5cd7479cafdcb1e490119f04 Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestMultiNic-1887369084-project Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c12a2502-fc4f-4842-afda-6dbd8320a24d'} Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.056926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. Oct 10 10:50:40.062275 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.064497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] Returning 404 to user: Instance c12a2502-fc4f-4842-afda-6dbd8320a24d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:40.065626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba54f5f6-e80c-4206-98ac-8b12f9c6f934 tempest-ServersTestMultiNic-1887369084 tempest-ServersTestMultiNic-1887369084-project] 10.222.0.16 "GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d" status: 404 len: 111 microversion: 2.1 time: 0.051312 Oct 10 10:50:40.066758 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1418/2723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:40 2022] GET /compute/v2.1/servers/c12a2502-fc4f-4842-afda-6dbd8320a24d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:40.558871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:40.570193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:40.572503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:40.574863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c972acc-c7e2-41bd-a179-1a254ef32699 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1748 microversion: 2.20 time: 0.636566 Oct 10 10:50:40.576241 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1306/2724] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:39 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1748 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:50:40.633913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:40.634533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 965f7d2d-6ba5-4f25-9379-8481012f1f27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:40.642442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.643386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.644064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.645587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.646252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.646911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.672902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] HTTP exception thrown: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 HTTP/1.1 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '965f7d2d-6ba5-4f25-9379-8481012f1f27'} Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.675051 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 404 to user: Instance 965f7d2d-6ba5-4f25-9379-8481012f1f27 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:40.678877 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ac22f7a-ee99-4d0c-8217-b924caf7c14b tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27" status: 404 len: 111 microversion: 2.1 time: 0.046600 Oct 10 10:50:40.680743 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1419/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:40 2022] GET /compute/v2.1/servers/965f7d2d-6ba5-4f25-9379-8481012f1f27 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:40.687103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:40.688560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] [instance: 2637734c-fbd1-456f-9da2-73c5c7638264] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:40.695771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.696602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.697264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.698952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.699743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.700832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.717027 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] HTTP exception thrown: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Request method failure captured: Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 HTTP/1.1 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_jEu66hskNKNSfAG4-JnhN7hS1n2nxZFIUJ2o-2uheZehqdSIeTaG6tfcfTJrnqSkD_EVWjEboMoscru1nqY1Qv3m4XFN2nxUzXdhoj12GQsOsQRI687llZDBgJA4MwO2Vijea3V7KOWXpf1k-lZnLzr3FVpmXTgF5cCg-VxLIJJKY Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1bf244d5a2104dca95e723a0f78f5ac5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1bf244d5a2104dca95e723a0f78f5ac5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1bf244d5a2104dca95e723a0f78f5ac5"}]}] Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1bf244d5a2104dca95e723a0f78f5ac5 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-499101484 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ac08792ebf664fa5a83267f3625b7850 Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-499101484-project Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2637734c-fbd1-456f-9da2-73c5c7638264'} Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.718841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. Oct 10 10:50:40.722672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:50:40.725413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] Returning 404 to user: Instance 2637734c-fbd1-456f-9da2-73c5c7638264 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:50:40.726495 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b20348a9-780d-4c16-af60-979307cc4f9d tempest-ListServersNegativeTestJSON-499101484 tempest-ListServersNegativeTestJSON-499101484-project] 10.222.0.16 "GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264" status: 404 len: 111 microversion: 2.1 time: 0.044283 Oct 10 10:50:40.731080 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1307/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:40 2022] GET /compute/v2.1/servers/2637734c-fbd1-456f-9da2-73c5c7638264 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:50:40.834040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:40.834814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:40.861504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.862008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.862456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:40.863206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:40.863878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:40.864475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:41.241838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:41.255055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5746b0c2-90e6-4ed3-8a38-70638ca7e503 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.429217 Oct 10 10:50:41.255979 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1420/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:40 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:41.601905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:41.603707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:41.622765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:41.628426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:41.630639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:41.636645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:41.638261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:41.639657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:42.284359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:42.284886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:42.292706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:42.293209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:42.293764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:42.294488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:42.294948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:42.295540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:42.335672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:42.360913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:42.367581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:42.370151 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfb79803-f748-428b-b78f-7c12b48e6326 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1748 microversion: 2.20 time: 0.771237 Oct 10 10:50:42.373462 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1308/2728] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:41 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1748 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:43.000418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:43.013050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9fa5731-41c5-4b0a-8ad8-44bc331f335d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.735754 Oct 10 10:50:43.016913 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1421/2729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:42 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:43.409257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:43.410968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:43.434443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:43.436456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:43.437530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:43.439862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:43.441981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:43.451708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:44.043968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:44.044600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:44.058427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:44.064145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:44.066256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:44.067508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:44.068156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:44.069647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:44.070277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:44.070937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:44.276558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:44.749849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:44.756527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:44.764934 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93402ae0-2a53-4458-9b5f-0c38cd59682f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.726443 Oct 10 10:50:44.771592 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1422/2730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:44 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:45.060200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1659342170", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "83ac550b-56ca-4869-90c4-64164905ffa9"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:45.192243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] validate_networks() for [('83ac550b-56ca-4869-90c4-64164905ffa9', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:50:45.332340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:45.349229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:45.352393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:45.358571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78265261-abe1-48bd-b856-5e994124ce37 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1750 microversion: 2.20 time: 1.961659 Oct 10 10:50:45.379403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1309/2731] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:43 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1750 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:45.794966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:45.796879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:45.810326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:45.810829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:45.811303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:45.812026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:45.812487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:45.812918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:46.487594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:46.502558 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a59a8b0-b825-4e4c-8aac-7d3cc9a8247f tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.712167 Oct 10 10:50:46.503867 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1310/2732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:45 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:46.514790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:46.515734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:46.533196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:46.535610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:46.537637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:46.538651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:46.541663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:46.542527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:47.113889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:50:47.115036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:50:47.115800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:50:47.116396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:50:47.116967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:50:47.142331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:47.143126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:47.144703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:47.145691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:47.149672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:47.154949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:47.214398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:50:47.228777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for user 42455b03876445a8851d343d88b72953 and project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:50:47.274167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:50:47.289684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:50:47.407511 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb49d0cc-1476-499a-b21c-1b1d77bf763d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.631124 Oct 10 10:50:47.410351 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1423/2733] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:50:47.413471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:47.419886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12e243ce-6263-4a14-906d-7a5092145085 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:47.421976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12e243ce-6263-4a14-906d-7a5092145085 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:47.433492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:47.459932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:47.465522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b638ef9b-482a-4e43-951b-fe459ed27ba0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1750 microversion: 2.20 time: 0.960331 Oct 10 10:50:47.501163 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1311/2734] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:46 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1750 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:47.526726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:47.537945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:47.583530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:47.583968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:47.584416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:47.585164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:47.585610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:47.586046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:47.732389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-12e243ce-6263-4a14-906d-7a5092145085 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:47.739494 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12e243ce-6263-4a14-906d-7a5092145085 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1225 microversion: 2.1 time: 0.323659 Oct 10 10:50:47.740082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1424/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:47 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1225 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:48.517120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:48.532568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:48.533201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:48.551177 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a97be3db-17df-4543-a1ec-cfaa13601ccd tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 1.028524 Oct 10 10:50:48.564024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:48.564024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:48.564388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:48.565094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:48.566355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1312/2736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:47 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:48.579568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:48.584042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:48.766827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:48.767482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:48.790690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:48.791236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:48.791725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:48.792527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:48.792993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:48.803340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:49.127035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:49.136707 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0d1269b-3f14-42e8-b3d0-3829884ca828 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1229 microversion: 2.1 time: 0.373962 Oct 10 10:50:49.142420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1313/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:48 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1229 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:49.577265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:49.577902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:49.600670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:49.601174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:49.601614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:49.623674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:49.625038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:49.626228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:49.703868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:49.736307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:49.741449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:49.743023 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e31a59b8-5dca-4b52-a8f3-174a2103af11 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1750 microversion: 2.20 time: 1.232765 Oct 10 10:50:49.760201 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1425/2738] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:48 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1750 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:50:50.172679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:50.173773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:50.187978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:50.188477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:50.194225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:50.195106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:50.195770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:50.196366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:50.410909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:50.427056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2848550f-e3ee-48ca-b9d9-04e5afe544a2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1283 microversion: 2.1 time: 0.266565 Oct 10 10:50:50.428476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1426/2739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:50 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:50.519636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:50.537897 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd95e851-5928-46bf-9c36-b8e8ca437a3a tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.958560 Oct 10 10:50:50.538857 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1314/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:49 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:50.776432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:50.777609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:50.795422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:50.796094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:50.796651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:50.797488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:50.798064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:50.798610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:51.453798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:51.454583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:51.462074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:51.462607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:51.463888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:51.464841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:51.465520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:51.466451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:51.552226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:51.579324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:51.596017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:51.621390 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c78e9f54-ef2e-4c66-b818-9947d547d5f4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1750 microversion: 2.20 time: 0.845853 Oct 10 10:50:51.627427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1427/2741] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:50 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1750 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:51.644095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:51.645566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:51.667683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:51.668181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:51.668620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:51.669479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:51.669944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:51.670372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:51.706484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:51.722301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5c2ae56-a7c3-4585-a99f-dbe96b75a8bc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1283 microversion: 2.1 time: 0.265523 Oct 10 10:50:51.722948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1315/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:51 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1283 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:52.137955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:52.146915 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bfb3642-279b-4aba-84aa-9feac1c3856d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1472 microversion: 2.1 time: 0.518443 Oct 10 10:50:52.150119 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1428/2743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:51 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:52.658759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:52.659419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:52.673419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:52.673909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:52.676990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:52.691616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:52.693494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:52.699507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:52.759576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:52.762972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:52.773244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:52.774205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:52.775115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:52.777918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:52.780347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:52.781516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:53.025033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:53.042990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6437219d-ea8e-4b6a-8e15-c80ddfcf4d84 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1283 microversion: 2.1 time: 0.298647 Oct 10 10:50:53.045654 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1429/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:52 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1283 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:50:53.297644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-550940118", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:53.421451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:50:53.440797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:53.454129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:53.455954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:53.459294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47f509ab-a33f-46a7-b3a9-bafa4d29b040 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1750 microversion: 2.20 time: 0.806412 Oct 10 10:50:53.463958 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1316/2745] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:52 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1750 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:53.475095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:53.475794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:53.493824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:53.495973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:53.496863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:53.498523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:53.522079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:53.525063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:54.411348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:54.435701 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e68424e5-9dbc-4547-9aa4-5df46959c0f3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1478 microversion: 2.1 time: 0.968165 Oct 10 10:50:54.438459 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1317/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:53 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1478 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:54.444178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:54.445152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:54.458463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:54.460343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:54.465408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:54.466768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:54.468244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:54.469061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:54.480162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:55.513357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:50:55.514486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:50:55.515236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:50:55.515842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:50:55.516479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:50:55.533597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.534367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.535030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:55.537865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.540014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.540631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:55.592351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:50:55.605658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:55.606532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:50:55.616320 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54e34b29-9798-4058-8e56-4e1970adb619 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 1.176378 Oct 10 10:50:55.618096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1318/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:54 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:55.625427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:55.627659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:55.634443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:50:55.636474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.637085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.637410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:50:55.637795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:55.638916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.639566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.642365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:55.725859 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1c95956-4c43-4d56-ae46-34f3705f8bf1 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.679107 Oct 10 10:50:55.737322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1430/2748] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:50:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:50:55.748946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:55.749778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:55.765908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.766593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.767238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:55.768111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:55.768727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:55.769315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:56.560993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:56.574232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:56.577709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:56.580152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69d5842f-e1ba-4770-882f-dc20e1eac5fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.959924 Oct 10 10:50:56.581541 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1319/2749] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:55 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:56.587886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:56.589312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:56.597682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:56.598537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:56.599171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:56.600441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:56.601491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:56.602534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.008762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:57.024247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:57.037804 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e34d419-1847-4474-8073-3f7235a0671f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1188 microversion: 2.1 time: 0.454680 Oct 10 10:50:57.038395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32f93e5c-75c1-4fe2-948d-5bc5a24b824b tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1463 microversion: 2.1 time: 1.293360 Oct 10 10:50:57.039243 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1431/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:55 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1463 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:57.055300 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1320/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:56 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1188 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:57.055300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87aeb77a-172e-4a78-94d0-2d2131ab79fc", "tag": "4e605f61-87e2-4c17-8a46-0f29f5570fa4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:57.069664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:57.076259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:57.085485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:50:57.087655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.088496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.089821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.090649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.091745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.092253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.097217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.098582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.099073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.126220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] Creating event network-changed:4e605f61-87e2-4c17-8a46-0f29f5570fa4 for instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc on n-h2-860687-2 Oct 10 10:50:57.136425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-50da8ea0-de69-404a-9a38-6c98e619d451 req-865cf10f-4ed4-481d-ac8d-ba3fd10809e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092169 Oct 10 10:50:57.138515 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1321/2752] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:50:57.214083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:57.223545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:57.239285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.242183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.243426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.248181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.248347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.248863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.446832 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7d7ad75-d367-4ea6-a9f5-eb981af652cc tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 0 microversion: 2.1 time: 0.306935 Oct 10 10:50:57.450974 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1322/2753] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:50:57 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:50:57.461584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:57.462219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:57.480017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.480522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.480964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.481693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.482157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.482586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.656917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:57.657316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:57.657760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:57.658221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lazy-loading 'fault' on Instance uuid 13d8f186-3cf1-4caa-93e7-67caef14166b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:50:58.070422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:58.085467 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-603794db-c92f-4de0-858b-c301391ed896 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 1.028729 Oct 10 10:50:58.086078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1432/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:57 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:58.108758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:58.123938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:58.134001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.161851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:58.162419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:58.169103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.169817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:58.170322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:58.453449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10b00ae4-8e68-43f5-b410-7834dc5b2d3a tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1597 microversion: 2.1 time: 1.001259 Oct 10 10:50:58.459582 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1323/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:57 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1597 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:58.477542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:58.479842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:58.505664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.506420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:58.507069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:58.508440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.509143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:58.509776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:58.915300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:58.932232 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55672e25-7c10-4157-9254-bc5f9f4b877b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1250 microversion: 2.1 time: 0.468696 Oct 10 10:50:58.937702 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1324/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:58 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1250 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:50:58.952176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:50:58.966204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:58.987072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.992527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:58.993230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:58.997461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:58.998423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:58.998564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:59.005873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:59.023252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:59.030717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:50:59.036884 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c5fb2f2-09b7-45d8-9c15-9a9a7c9e2341 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.929779 Oct 10 10:50:59.062019 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1433/2757] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:50:58 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:50:59.114004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:59.114993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:59.138737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:59.141927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:59.144302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:59.149328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:59.154850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:59.156445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:59.332761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f5e2323-114c-4b25-ba57-a62c68161947 tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action" status: 202 len: 0 microversion: 2.1 time: 0.392166 Oct 10 10:50:59.334246 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1325/2758] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:50:58 2022] POST /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:50:59.349026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:50:59.355172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:50:59.377911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:59.378822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:59.383556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:50:59.388796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:50:59.390589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:50:59.403985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:00.176906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b88aea5a-663e-4d90-a153-8b7c36305a9d tempest-ServersAdminTestJSON-1659740763 tempest-ServersAdminTestJSON-1659740763-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1614 microversion: 2.1 time: 0.838960 Oct 10 10:51:00.177573 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1326/2759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:59 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1614 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:00.194993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:00.200657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:00.207681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:00.224509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc1c0a09-1444-4945-88aa-57dd7e2e905a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 1.113221 Oct 10 10:51:00.228594 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1434/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:50:59 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:00.239342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:00.239800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:00.241764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:00.260767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:00.263085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:00.269722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:00.272481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:00.273042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:00.300994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:00.301501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:00.301949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:00.302705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:00.311401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:00.311943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:01.715403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:01.734696 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1cbe7ce-1036-4939-b0a4-e29b7736ca2d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1250 microversion: 2.1 time: 1.548218 Oct 10 10:51:01.761951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1327/2761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:00 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1250 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:01.767922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:01.769038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:01.784003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:01.784815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:01.785523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:01.786601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:01.787362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:01.788084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:01.835070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:51:02.114454 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b7adc31-a479-4676-b14f-ceba5f7ae711 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 204 len: 0 microversion: 2.1 time: 0.350755 Oct 10 10:51:02.121522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1328/2762] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:01 2022] DELETE /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:02.133867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:02.135692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:02.149383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:02.152264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:02.152735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:02.155782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:02.156293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:02.156739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:03.429881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:03.461970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32cc2cfc-e9fe-43f3-9b9f-102a0890f4db tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 1.339050 Oct 10 10:51:03.462580 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1329/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:02 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:03.489863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:03.492199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:03.520923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:03.521440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:03.521891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:03.522619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:03.523115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:03.523554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:03.581337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:04.551060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:04.578583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:04.584552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:04.589920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ad3ce102-a71c-401f-81b6-6f62ff42c8df tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 4.358138 Oct 10 10:51:04.593022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1435/2764] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:00 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 4363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:04.599617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:04.621032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:04.638750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:04.640790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:04.641368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:04.645761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:04.646279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:04.648283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:05.559061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:05.561906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:05.576335 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-632335f0-65d9-4a7f-a01c-a11bdba435f9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1469 microversion: 2.1 time: 2.112414 Oct 10 10:51:05.597846 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1330/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:03 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1469 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:05.608502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f186-3cf1-4caa-93e7-67caef14166b", "name": "network-vif-plugged", "status": "completed", "tag": "ba2c123e-7d3f-4b48-baf2-3262b0eadc0d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:05.615370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=14 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:05.638268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:05.639383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:05.640203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:05.678240 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] Creating event network-vif-plugged:ba2c123e-7d3f-4b48-baf2-3262b0eadc0d for instance 13d8f186-3cf1-4caa-93e7-67caef14166b on n-h1-860687-2 Oct 10 10:51:05.693252 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c69c8bfa-bcbd-4103-aa01-ee03e74f671b req-378c1cab-d523-4f93-8081-0c6a88ee3ce7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093634 Oct 10 10:51:05.695555 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1331/2766] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:05.703269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:05.704381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:05.716577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:05.731659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-459e639d-c485-4938-9cea-a30303c03b6f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 1.136113 Oct 10 10:51:05.750589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:05.751519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:05.753547 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1436/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:04 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:05.755315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:05.757306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:05.759443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:05.761696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:05.767554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:05.771357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:05.801064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:05.803013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:05.803710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:05.804790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:05.807706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:05.808484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:06.545536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:06.565706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e14df1a8-53d6-4427-81ac-06064189462e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 0.868078 Oct 10 10:51:06.569774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1332/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:05 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:06.602215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:06.602900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:06.605659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:06.624989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:06.627162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:06.627732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:06.628487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:06.630959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:06.631438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:06.675361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:06.694021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:06.707826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:06.710603 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0125fa64-a4ad-4640-b012-0d0c874b67e0 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.955749 Oct 10 10:51:06.718228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1437/2769] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:05 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:06.762972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:06.764122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:06.771401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:06.774209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:06.774837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:06.779312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:06.780190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:06.780920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:07.997288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:08.011184 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70217667-711c-47d0-89e3-42f83e58347d tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 200 len: 1469 microversion: 2.1 time: 1.408973 Oct 10 10:51:08.023268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1333/2770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:06 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 1469 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:08.023268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:08.023268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:08.042823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:08.044775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:08.045237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:08.047907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:08.050650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:08.051787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:08.541623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:08.562767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1aca49a3-d697-446c-98fa-b3da59419f68 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 1.804993 Oct 10 10:51:08.564616 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1438/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:06 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:08.584464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:08.586449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:08.605121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:08.605911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:08.606518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:08.608217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:08.608998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:08.609575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:08.951906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:08.968569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-802a670c-6236-4eb5-b7d1-48847ee84d1b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 0.952255 Oct 10 10:51:08.985796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1334/2772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:08 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:08.991700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c91c2ee-998d-498c-b2a4-0bcb3255c11a", "name": "network-vif-deleted", "tag": "cdf3ca1d-f25f-424a-802c-09ed2b30291e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:09.003101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.004310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.004909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.019561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] Creating event network-vif-deleted:cdf3ca1d-f25f-424a-802c-09ed2b30291e for instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a on n-h1-860687-2 Oct 10 10:51:09.029101 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8e32ba62-07b8-41c3-aa26-3eebfb5895ea req-8cb5ade0-abc7-47b9-a13f-b372e813cadd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041376 Oct 10 10:51:09.030870 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1335/2773] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:09.042228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:09.043772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 4c91c2ee-998d-498c-b2a4-0bcb3255c11a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:09.051679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.052737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.053344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.054214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.055222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.055878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.081023 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] HTTP exception thrown: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Request method failure captured: Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a HTTP/1.1 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_iIqX3gsTWyPQr4QDjtGzw4AbJ6ioX3T2TdG-GP7w_hVmsAStzyA7SxSGKiMtQ_VMVQg6prWyQdE6mvnEKpa6Gk_Klt17SKr9Z0Scxvg4_HhyQgjojINLhuRzttpsOUrmVb5X-arHO8gBrv4450nCGYAcjRoV5-2Wj0jfnGak2qq8I Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beb8bd8b1ca54f8584cd48cff8a0a41b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}] Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 26acf3a710d548238d3fc19da3cc2376 Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4c91c2ee-998d-498c-b2a4-0bcb3255c11a'} Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:09.083778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. Oct 10 10:51:09.089281 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:09.091448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Returning 404 to user: Instance 4c91c2ee-998d-498c-b2a4-0bcb3255c11a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:09.092881 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31f9385f-848f-4aeb-8cf8-b24d664f3a13 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a" status: 404 len: 111 microversion: 2.1 time: 0.057454 Oct 10 10:51:09.094809 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1336/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:09 2022] GET /compute/v2.1/servers/4c91c2ee-998d-498c-b2a4-0bcb3255c11a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:51:09.107058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:09.108059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:09.122234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.123095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.123702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.125188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.125973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.126644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.176582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:09.191744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:09.202535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:09.206755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:51:09.213686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42511102-b50d-4a7a-869f-f44d9593c77d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.645919 Oct 10 10:51:09.218670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1439/2775] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:08 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:09.365046 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-593f3d48-6938-4c2e-a97f-0b6f6bdd9e97 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 204 len: 0 microversion: 2.1 time: 0.264631 Oct 10 10:51:09.369395 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1337/2776] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:09 2022] DELETE /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:09.375518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:09.376157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:09.389446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.389955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.390408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.391243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.391715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.392152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.592880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:09.593900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:09.616336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.622453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.624666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:09.625478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:09.629418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:09.629943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:10.701423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:10.724887 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5aa50343-cca3-4e38-99e5-872c139bf285 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1469 microversion: 2.1 time: 1.353651 Oct 10 10:51:10.732516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1440/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:09 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1469 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:10.741030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f890705-6704-4e1e-8adf-52bbc6ca73c4", "tag": "e2f7e7a9-b612-4d3b-96a8-086d4d959c74"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:10.787479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:10.789487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:10.790123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:10.846390 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] Creating event network-changed:e2f7e7a9-b612-4d3b-96a8-086d4d959c74 for instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 on n-h1-860687-2 Oct 10 10:51:10.864232 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b6ff7428-958e-4013-bcbe-606475962094 req-b91e9584-6220-4ea5-b932-2450e306bf25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125017 Oct 10 10:51:10.866870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1441/2778] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:10.886119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:10.890626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:10.912034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:10.914271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:10.915061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:10.918007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:10.919929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:10.921443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:11.005893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:11.051451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:11.070784 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-122a853c-035e-4eeb-a90b-368cff24a62e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 1.481468 Oct 10 10:51:11.091753 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1338/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:09 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:11.114043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:11.116864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:11.149952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:11.153092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:11.153636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:11.156442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:11.157004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:11.161707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:11.494587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:11.508368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fe9cde2-5085-4ff7-aa79-216ec5e19a92 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 0.637785 Oct 10 10:51:11.523044 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1442/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:10 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:11.761478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:11.762188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:11.783860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:11.797049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:11.803437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:11.807342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:11.809120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:11.810506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:11.811797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:11.813755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:11.820857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:11.826009 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50ee6c29-37e9-4b74-baeb-4255aa379d5d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.731564 Oct 10 10:51:11.831117 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1339/2781] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:11 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:12.108521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:12.109230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:12.131586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.131997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.132443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:12.136316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.138440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.140039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:12.418138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:12.436718 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4cc2e4f-7515-4cfa-b7ae-dc05e4a546b9 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1469 microversion: 2.1 time: 0.681848 Oct 10 10:51:12.454346 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1443/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:11 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1469 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:12.523301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:12.537215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:12.537829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:12.547898 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-435b517e-a1a9-4d0b-b7f4-e886795ea937 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.445884 Oct 10 10:51:12.548500 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1340/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:12 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:12.550175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.550858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.551485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:12.552672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.553439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.554024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:12.711550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:12.721901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c3fafdbc-841f-4b3f-9bc4-e8f5a9e8d850 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 0.189691 Oct 10 10:51:12.723619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1444/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:12 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:12.857482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:12.858525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:12.865552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.866375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.867251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:12.868191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:12.869407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:12.870055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:13.267703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:13.323943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:13.331386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aeb77a-172e-4a78-94d0-2d2131ab79fc", "name": "network-vif-plugged", "status": "completed", "tag": "4e605f61-87e2-4c17-8a46-0f29f5570fa4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:13.345586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:13.347281 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85632bc7-dba6-4567-994b-c5d3b8b7092c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.494575 Oct 10 10:51:13.352462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:13.354405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:13.355095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:13.387109 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1341/2785] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:12 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:13.396687 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] Creating event network-vif-plugged:4e605f61-87e2-4c17-8a46-0f29f5570fa4 for instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc on n-h2-860687-2 Oct 10 10:51:13.404772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9e06c922-e822-4788-a55b-86bf58f241a7 req-979be327-8708-4606-983b-6e51bf3398e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088081 Oct 10 10:51:13.405538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1445/2786] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:13.464543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:13.465491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:13.477069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:13.479436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:13.482559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:13.487212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:13.489901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:13.490369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:13.572717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:13.573878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:13.581880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:13.582839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:13.583536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:13.584503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:13.585170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:13.585804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:14.067845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:14.078308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94926318-5f76-459e-aa9f-ae624701dbcb tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1469 microversion: 2.1 time: 0.621113 Oct 10 10:51:14.079227 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1342/2787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:13 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1469 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:14.101407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:14.102580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:14.109380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:14.110151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:14.110757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:14.112226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:14.112842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:14.113613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:14.293752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:14.313481 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db4ad2c5-f0f2-41aa-acd8-406394d7feb6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.739978 Oct 10 10:51:14.315428 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1446/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:13 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:14.390681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:14.395574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:14.420377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:14.420879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:14.421321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:14.422033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:14.422487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:14.422912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:14.826050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:14.834409 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5d3b7ea-efab-467b-b732-350646acb0c5 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1325 microversion: 2.1 time: 0.741345 Oct 10 10:51:14.860674 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1343/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:14 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1325 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:15.109017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:15.110144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:15.132108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.134551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.135872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.136888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.144489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.148148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.489746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:15.500656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:15.503876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:15.507814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d495fb3-d32f-4f8b-a158-7f5ed49ce2c1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 1.122437 Oct 10 10:51:15.527699 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1447/2790] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:14 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:15.536029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:15.537723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:15.546881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.547434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.548089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.548966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.549587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.550173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.592585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:15.605895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9668954e-90f5-4e41-abbf-2d1552283699 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 200 len: 1427 microversion: 2.1 time: 0.498552 Oct 10 10:51:15.606925 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1344/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:15 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 1427 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:15.639705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4de5790-f609-4d97-85eb-67dd74576ca9", "name": "network-vif-deleted", "tag": "6b378f05-1810-4387-9fe6-ce011c572782"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:15.657426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.658361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.659143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.676629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] Creating event network-vif-deleted:6b378f05-1810-4387-9fe6-ce011c572782 for instance d4de5790-f609-4d97-85eb-67dd74576ca9 on n-h2-860687-2 Oct 10 10:51:15.696927 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b1dd7866-f287-4137-952a-c485b6731eb6 req-1e80c7c1-3d94-41c5-b1b8-1d8f83295614 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088395 Oct 10 10:51:15.700663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1345/2792] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:15.706356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4de5790-f609-4d97-85eb-67dd74576ca9", "name": "network-vif-unplugged", "status": "completed", "tag": "6b378f05-1810-4387-9fe6-ce011c572782"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:15.722288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.723205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.724124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.738815 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] Creating event network-vif-unplugged:6b378f05-1810-4387-9fe6-ce011c572782 for instance d4de5790-f609-4d97-85eb-67dd74576ca9 on n-h2-860687-2 Oct 10 10:51:15.745899 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5d957ff2-2c83-472d-9cc2-213d42cc5f6c req-236d470f-dbc8-48d3-b366-fb2318eed7ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043644 Oct 10 10:51:15.747501 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1346/2793] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:15.885232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:15.885988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:15.898158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.899401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.900129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:15.901538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:15.902246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:15.902899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:16.036025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:16.046538 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93b3fadf-24fe-41ad-9d20-5208af678266 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.517443 Oct 10 10:51:16.047347 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1448/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:15 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:16.444059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:16.459610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f822f6ea-c8e3-4432-8391-e8c5301df2fe tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.577538 Oct 10 10:51:16.476880 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1347/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:15 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:16.489130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:16.489672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:16.499342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:16.500097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:16.500259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:16.503118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:16.503765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:16.505312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:16.544606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:16.545480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:16.561014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:16.561741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:16.562351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:16.563323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:16.563966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:16.564550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.120647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:17.125380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:17.143058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:17.145519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:17.152215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8719ac5-fdf5-4c6b-8269-78732bd54ae6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.612268 Oct 10 10:51:17.154989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1348/2796] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:16 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:51:17.169963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:17.184020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: d4de5790-f609-4d97-85eb-67dd74576ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:17.199411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.211758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.212418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.213968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.214723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.215435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.236132 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] HTTP exception thrown: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Request method failure captured: Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 HTTP/1.1 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_iIqX3gsTWyPQr4QDjtGzw4AbJ6ioX3T2TdG-GP7w_hVmsAStzyA7SxSGKiMtQ_VMVQg6prWyQdE6mvnEKpa6Gk_Klt17SKr9Z0Scxvg4_HhyQgjojINLhuRzttpsOUrmVb5X-arHO8gBrv4450nCGYAcjRoV5-2Wj0jfnGak2qq8I Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beb8bd8b1ca54f8584cd48cff8a0a41b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}] Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 26acf3a710d548238d3fc19da3cc2376 Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd4de5790-f609-4d97-85eb-67dd74576ca9'} Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:17.248885 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. Oct 10 10:51:17.254478 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.258694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Returning 404 to user: Instance d4de5790-f609-4d97-85eb-67dd74576ca9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:17.265627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-775290d0-1ed6-4b8b-92b7-5d0aa53b9d99 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9" status: 404 len: 111 microversion: 2.1 time: 0.104267 Oct 10 10:51:17.267172 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1349/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:17 2022] GET /compute/v2.1/servers/d4de5790-f609-4d97-85eb-67dd74576ca9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:51:17.283721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:17.284750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:17.296944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.297509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.297956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.298682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.299166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.299780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.385369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:17.397897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1f49708-5343-423d-a5b0-0e5c2ff6c52f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.911724 Oct 10 10:51:17.403192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1449/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:16 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:17.412853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:17.413809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:17.435660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.438646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.440928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.444377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.445085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.449119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.522213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:51:17.719163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ccb5527-d19e-4552-8259-fd1d1d732a82 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 204 len: 0 microversion: 2.1 time: 0.314320 Oct 10 10:51:17.722755 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1450/2799] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:17 2022] DELETE /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:17.725464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6561cf8-1dd6-4b56-9976-3aa6f9dec9f3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-272860940", "metadata": {"": ""}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6561cf8-1dd6-4b56-9976-3aa6f9dec9f3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action HTTP/1.1 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 106 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-272860940", "metadata": {"": ""}}} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-272860940', 'metadata': {'': ''}}}} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'': ''} Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:51:17.739046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6561cf8-1dd6-4b56-9976-3aa6f9dec9f3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6561cf8-1dd6-4b56-9976-3aa6f9dec9f3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action" status: 400 len: 170 microversion: 2.1 time: 0.019596 Oct 10 10:51:17.748301 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1451/2800] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Oct 10 10:51:17 2022] POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:51:17.754529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:17.755307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:17.789231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.789741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.790185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.790982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:17.791467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:17.791901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:17.943037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:17.954584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bba37770-9aae-43e4-853a-af23828c005b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.685941 Oct 10 10:51:17.959988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1350/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:17 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:17.965703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:17.975657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:18.007709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.008540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.010855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:18.012546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.013747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.015495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:18.423470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:18.432456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a0c478f-1780-47b0-bbbc-6f3aee993ab8 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1469 microversion: 2.1 time: 0.684073 Oct 10 10:51:18.437730 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1452/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:17 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1469 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:18.443742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:18.449825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:18.461334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.464479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.465116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:18.469814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.470543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.471205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:18.714986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:18.732534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de5c626f-9392-44d2-8c7f-e6cebe3339ad tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.771193 Oct 10 10:51:18.733681 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1351/2803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:17 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:18.758270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:18.759091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:18.770190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.772449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.773961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:18.775783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:18.776425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:18.777114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.059346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:19.072717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:19.074492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:19.076349 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-862823c5-d45d-434a-a28b-dddfa89c8168 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.636933 Oct 10 10:51:19.092883 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1453/2804] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:18 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:19.103657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:19.104632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:19.113284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.114022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.114682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.116779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.117689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.119583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.370962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:19.411657 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc1f61d9-2bb7-478c-82ba-c7706594471f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.657380 Oct 10 10:51:19.412561 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1352/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:18 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:19.442381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d911621f-ccfa-4812-a741-aab0e716bd70 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1833857654", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d911621f-ccfa-4812-a741-aab0e716bd70 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action HTTP/1.1 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 619 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1833857654", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1833857654', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:51:19.451778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 10:51:19.454875 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:19.461821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d911621f-ccfa-4812-a741-aab0e716bd70 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:19.461821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d911621f-ccfa-4812-a741-aab0e716bd70 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action" status: 400 len: 938 microversion: 2.1 time: 0.018253 Oct 10 10:51:19.461821 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1353/2806] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Oct 10 10:51:19 2022] POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:51:19.473143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:19.474014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:19.492965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.496640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.505722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.508786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.513003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.515378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.555720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:19.565135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc84f95b-4c20-4ad8-bd85-51a910df68bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.470819 Oct 10 10:51:19.589540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1454/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:19 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:19.606493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:19.607395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:19.615583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.616608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.617364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:19.618375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:19.621406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:19.622151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:21.115224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:21.125122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7463830-9abf-4636-9424-fe200fc0d99a tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 1.664273 Oct 10 10:51:21.137380 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1354/2808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:19 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:21.151436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:21.159711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:21.176931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:21.182341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:21.189830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:21.191153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:21.191849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:21.192414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:21.397217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26acf3a710d548238d3fc19da3cc2376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb8bd8b1ca54f8584cd48cff8a0a41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:21.413837 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46d06f9b-eecf-4e18-bac0-dac0b6feb5a3 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 200 len: 1469 microversion: 2.1 time: 1.822772 Oct 10 10:51:21.419576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1455/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:19 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 1469 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:21.427113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:21.438694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:21.451568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:21.458295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:21.458875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:21.460091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:21.460819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:21.469998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:22.036274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:22.057685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:22.062500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:22.064888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fd7c358-4b26-4acd-a4ee-f31e1bd84488 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.926057 Oct 10 10:51:22.069185 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1355/2810] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:21 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:22.082950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:22.084560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:22.109450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:22.111559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:22.112306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:22.113585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:22.119294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:22.120181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:22.739260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:22.772374 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56222a8b-65b6-48e0-af74-5c01b5527895 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 1.351202 Oct 10 10:51:22.773005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1456/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:21 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:22.817218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d8f186-3cf1-4caa-93e7-67caef14166b", "name": "network-vif-deleted", "tag": "ba2c123e-7d3f-4b48-baf2-3262b0eadc0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:22.876962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:22.879692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:22.880168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:22.941141 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] Creating event network-vif-deleted:ba2c123e-7d3f-4b48-baf2-3262b0eadc0d for instance 13d8f186-3cf1-4caa-93e7-67caef14166b on n-h1-860687-2 Oct 10 10:51:22.967082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-238f2221-3c01-44ce-a436-fdcc6e039d8e req-476e8e53-41a2-431b-8ba7-f0147e9255c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189867 Oct 10 10:51:22.968355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1457/2812] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:22.984050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:22.992006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] [instance: 13d8f186-3cf1-4caa-93e7-67caef14166b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:23.012498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.014429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.015715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.016481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.016955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.023028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.085954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] HTTP exception thrown: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Request method failure captured: Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b HTTP/1.1 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iIqX3gsTWyPQr4QDjtGzw4AbJ6ioX3T2TdG-GP7w_hVmsAStzyA7SxSGKiMtQ_VMVQg6prWyQdE6mvnEKpa6Gk_Klt17SKr9Z0Scxvg4_HhyQgjojINLhuRzttpsOUrmVb5X-arHO8gBrv4450nCGYAcjRoV5-2Wj0jfnGak2qq8I Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_beb8bd8b1ca54f8584cd48cff8a0a41b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/beb8bd8b1ca54f8584cd48cff8a0a41b"}]}] Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: beb8bd8b1ca54f8584cd48cff8a0a41b Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminTestJSON-351063672 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 26acf3a710d548238d3fc19da3cc2376 Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminTestJSON-351063672-project Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '13d8f186-3cf1-4caa-93e7-67caef14166b'} Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:23.089949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. Oct 10 10:51:23.096298 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.098391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] Returning 404 to user: Instance 13d8f186-3cf1-4caa-93e7-67caef14166b could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:23.099546 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7c658e1-85ec-4863-933b-67c867d0c370 tempest-ServersAdminTestJSON-351063672 tempest-ServersAdminTestJSON-351063672-project] 10.222.0.16 "GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b" status: 404 len: 111 microversion: 2.1 time: 0.129231 Oct 10 10:51:23.105835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1458/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:22 2022] GET /compute/v2.1/servers/13d8f186-3cf1-4caa-93e7-67caef14166b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:51:23.128123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:23.131896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:23.143877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.144709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.145333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.152322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.153483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.154733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.520467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:23.542769 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70a30c79-beea-4669-8299-98b9d7237bd0 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 1.472110 Oct 10 10:51:23.543621 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1356/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:22 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:23.572513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0f2ec0c-1f8b-490b-9e4a-600f38324df8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0f2ec0c-1f8b-490b-9e4a-600f38324df8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action HTTP/1.1 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 285 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.577058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:51:23.581073 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:51:23.591979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0f2ec0c-1f8b-490b-9e4a-600f38324df8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:23.593661 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0f2ec0c-1f8b-490b-9e4a-600f38324df8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action" status: 400 len: 619 microversion: 2.1 time: 0.026100 Oct 10 10:51:23.597441 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1357/2815] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Oct 10 10:51:23 2022] POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:51:23.603093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:23.605762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:23.621247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.626234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.626883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.627795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.628391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.629961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.727437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:23.741096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:23.746531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:23.755762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a3057e2-0280-4fb3-86ce-2b4931d849fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.648562 Oct 10 10:51:23.756599 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1459/2816] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:23 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:23.799491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:23.800343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:23.812349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.813126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.813747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.816147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:23.816810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:23.817931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:23.855101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:24.615457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:24.645374 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a0858dc-c483-4d87-ac79-4fb7775b35d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 1.046335 Oct 10 10:51:24.647419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1358/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:23 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:24.663537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f890705-6704-4e1e-8adf-52bbc6ca73c4", "name": "network-vif-plugged", "status": "completed", "tag": "e2f7e7a9-b612-4d3b-96a8-086d4d959c74"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:24.725226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:24.725709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:24.726183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:24.759502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] Creating event network-vif-plugged:e2f7e7a9-b612-4d3b-96a8-086d4d959c74 for instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 on n-h1-860687-2 Oct 10 10:51:24.781853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:24.783175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c4b82d53-033d-41da-8b7e-3161f9767404 req-f6733700-bb1c-45d7-bf73-589d894f9767 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127478 Oct 10 10:51:24.784992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1359/2818] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:24.791166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3e580d2-3db8-4083-a7bc-0f3078861cd6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1292 microversion: 2.1 time: 0.994780 Oct 10 10:51:24.795648 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1460/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:23 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1292 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:24.806602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:24.809761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:24.829941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:24.835733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:24.840342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:24.841624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:24.842270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:24.842882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:25.180438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1615225237", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:25.300644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] validate_networks() for [('3862d372-cf60-4344-b196-50210b6e2996', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:25.599443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:25.621010 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7bae3ba4-2a9f-4728-8887-42a125abd289 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.820364 Oct 10 10:51:25.636476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1461/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:24 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:25.656182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:25.656809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:25.676665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:25.677416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:25.678464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:25.679391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:25.680012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:25.680725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:26.475278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:26.486797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:26.488312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:26.489523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09864a03-c271-49b1-abdb-6e99ae84d46d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.851934 Oct 10 10:51:26.514891 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1462/2821] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:25 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:27.046643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] Calling method '.version_select at 0x7f677cb38e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:27.257850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f could not be found", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:51:27.260599 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] HTTP exception thrown: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] Request method failure captured: Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-floating-ips/2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f HTTP/1.1 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_ktue9APbah5WwVAwOBt64tpUn3Pa7XjgZ_wKbbbEURmfPS6nKsdt3ehqkFTVoUdhbVqDJp6FS54TXetnsOnsEdCyHLA55i5LvRFENj8i_U23bUEL0vl9ajA3Bzk06Vnn5ImZeU_Q2_9rudobZg3Uf8BIGdPOIRsalqaSOddmodLcU Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3ca4f98ab31641529dc2c87d6c91fd6a Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1650287637 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ca4f98ab31641529dc2c87d6c91fd6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ca4f98ab31641529dc2c87d6c91fd6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ca4f98ab31641529dc2c87d6c91fd6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ca4f98ab31641529dc2c87d6c91fd6a"}]}] Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1650287637 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3ca4f98ab31641529dc2c87d6c91fd6a Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1650287637 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 1fc0680b657241509550c3674645462d Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: exception: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f'} Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:51:27.282054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f could not be found Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-609b0f88-7aed-40f4-9600-412a79cfd597'] Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f. Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f Oct 10 10:51:27.286599 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:27.294958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] Returning 404 to user: Floating IP not found for ID 2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:27.296262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd524db5-171c-4a35-9546-66ab5dabc035 tempest-FloatingIPDetailsNegativeTestJSON-1650287637 tempest-FloatingIPDetailsNegativeTestJSON-1650287637-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f" status: 404 len: 111 microversion: 2.1 time: 0.780175 Oct 10 10:51:27.298020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1463/2822] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 10:51:26 2022] GET /compute/v2.1/os-floating-ips/2cf65cc7-4ab5-45d2-9fd6-fbd4cb04041f => generated 111 bytes in 783 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:51:27.310460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-644513632"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:27.324120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:27.336409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:27.338480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:27.340106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:27.340729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:27.341574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:27.342243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:27.352121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.353343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.360863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.361647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.362139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.362584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.365301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.369197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.373160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.375170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.375879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.378640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.444312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:27.458969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for user 8f6c75faee37446a96834935a3933cd8 and project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:27.496832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:27.499775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:27.621787 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07a18fc7-c831-4375-82ba-f890b8dd2427 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.832930 Oct 10 10:51:27.629282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1360/2823] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:27.665067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:27.698046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:27.712780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.716829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.719275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.720934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.722089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.724187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.803102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c03681f-db8f-4ac8-8137-484e351d8ba2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action" status: 202 len: 0 microversion: 2.1 time: 0.503327 Oct 10 10:51:27.806543 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1464/2824] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:51:27 2022] POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:51:27.824633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "name": "network-vif-plugged", "status": "completed", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:27.844266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.846373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.847019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.864865 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] Creating event network-vif-plugged:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:51:27.872716 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4fe52242-5233-4320-9b20-3a44635f1437 req-0fa350e0-4ec2-4026-9814-d333d314d73f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063251 Oct 10 10:51:27.873927 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1465/2825] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:27.881890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:27.883072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:27.892990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.893743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.894695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:27.895692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:27.897513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:27.898127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:28.664647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:28.675571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0f6d9bf-244c-456f-bec4-e444a3a1cd5c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1473 microversion: 2.1 time: 1.045013 Oct 10 10:51:28.679708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1361/2826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:27 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1473 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:28.695557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:28.697128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:28.708866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:28.714193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:28.715308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:28.716548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:28.717491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:28.718669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:28.756616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:28.772566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:28.777935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:28.780600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1f25136-cd9e-47e3-ad7a-f61aeb503c2e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 0.904457 Oct 10 10:51:28.782953 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1466/2827] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:27 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:28.802645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-650694847"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:28.820530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:28.856884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:28.859194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:28.864178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:28.865469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:28.869495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:28.872125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:28.937220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:28.946516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efdfde0b-cc1e-4e00-a9bb-86dd9c971422 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1226 microversion: 2.1 time: 0.259144 Oct 10 10:51:28.951058 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1362/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:28 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1226 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:28.972070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1443208767", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:29.033523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Cannot 'createImage' instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc while it is in task_state image_snapshot Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action HTTP/1.1 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 84 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-650694847"}} Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'createImage' instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc while it is in task_state image_snapshot Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-650694847'}}} Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:51:29.035898 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc while it is in task_state image_snapshot Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc while it is in task_state image_snapshot Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:29.040676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 409 to user: Cannot 'createImage' instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc while it is in task_state image_snapshot {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:29.051083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c25be55-b83d-43a6-af1b-8bf1e7323a02 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action" status: 409 len: 159 microversion: 2.1 time: 0.252644 Oct 10 10:51:29.057022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1467/2829] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:51:28 2022] POST /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc/action => generated 159 bytes in 273 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:29.071173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07b79c41-7c60-4c02-ac77-61f96bad4394 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f6780c41af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:29.103571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:29.428305 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07b79c41-7c60-4c02-ac77-61f96bad4394 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/images/2eabed7b-788a-453b-82b3-bdc65305d380" status: 204 len: 0 microversion: 2.1 time: 0.366653 Oct 10 10:51:29.434202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1468/2830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:29 2022] DELETE /compute/v2.1/images/2eabed7b-788a-453b-82b3-bdc65305d380 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:29.449958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1665387066", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:29.578063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] validate_networks() for [('3862d372-cf60-4344-b196-50210b6e2996', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:30.591495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:30.592899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:30.594883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:30.595744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:30.596489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:30.622052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:30.622788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:30.625448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:30.630089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:30.631591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:30.632502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:30.702002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:30.722048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for user 8f6c75faee37446a96834935a3933cd8 and project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:30.778352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:30.785305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:30.875800 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba01fff5-9e3d-466d-a3c8-295b144e212f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.439796 Oct 10 10:51:30.877254 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1469/2831] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:30.883150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:30.884604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:30.894166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:30.896324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:30.897221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:30.898319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:30.899304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:30.900304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:31.187257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:31.190805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:31.192492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:31.193233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:31.197760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:31.231900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:31.244187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:31.248816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:31.250506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:31.252658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:31.253463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:31.303398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:31.311041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:31.328486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:31.331610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:31.528086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9f8680c-a85c-4c63-bd49-2983fe117bbc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.571254 Oct 10 10:51:31.529591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1363/2832] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:32.025628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1574332779", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "83b4380d-603f-4590-b49d-99b71035f3ea"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:32.046471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:32.054763 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4880709d-135e-4008-874e-fcc0ad6bd342 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1540 microversion: 2.1 time: 1.176012 Oct 10 10:51:32.060804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1470/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:30 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1540 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:32.075317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:32.079715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:32.116927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:32.117436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:32.117880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:32.118682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:32.119179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:32.119615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:32.184897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] validate_networks() for [('83b4380d-603f-4590-b49d-99b71035f3ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:33.717116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:33.727138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:33.729358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:33.730727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2bd3873-54d4-43c7-a172-374881cff12f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1806 microversion: 2.20 time: 1.668608 Oct 10 10:51:33.731541 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1471/2834] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:32 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1806 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:33.756176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:33.757073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:33.765519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:33.766434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:33.766986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:33.767960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:33.768660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:33.769448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:33.936655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:33.963823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a877067-7903-44fa-ab52-955fb2aa206f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1280 microversion: 2.1 time: 0.215889 Oct 10 10:51:33.967062 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1472/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:33 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:33.989951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:33.990798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:34.004378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:34.005931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:34.009521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:34.013531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:34.013987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:34.014433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:34.045425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:51:34.185309 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed8c2a4d-a7ff-4e59-8730-50a7a0ca373f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 204 len: 0 microversion: 2.1 time: 0.215078 Oct 10 10:51:34.186578 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1473/2836] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:33 2022] DELETE /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:34.193179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1166f8e2-81ce-4c8e-963d-9ae7ad715d3b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cb38670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:34.257676 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1166f8e2-81ce-4c8e-963d-9ae7ad715d3b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce" status: 200 len: 662 microversion: 2.1 time: 0.069509 Oct 10 10:51:34.258564 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1474/2837] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:34 2022] GET /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:34.272042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:34.273962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:34.296925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:34.304217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:34.304935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:34.306552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:34.307263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:34.307904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:34.982833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:34.991113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb7b4586-318e-4489-b2eb-093fb8e402e3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1522 microversion: 2.1 time: 0.726336 Oct 10 10:51:34.991689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1475/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:34 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1522 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:35.017662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e5873-8bb0-495a-80c8-ce1b71859e61", "tag": "078f09bc-6b65-4943-b53e-3c27f60906d3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:35.041083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.041798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.042388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.068944 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] Creating event network-changed:078f09bc-6b65-4943-b53e-3c27f60906d3 for instance b69e5873-8bb0-495a-80c8-ce1b71859e61 on n-h2-860687-2 Oct 10 10:51:35.075473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0da91c6f-a56e-4826-83fc-abb9f2e60dd2 req-055f793f-8f2f-4833-955c-4ff2bdbc2286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082435 Oct 10 10:51:35.076775 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1476/2839] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:35.085305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:35.086273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:35.095787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.096664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.097345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.098593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.099469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.100099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.280897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:35.289358 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fce266e9-a53c-406e-86e8-28e9864b1939 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1267 microversion: 2.1 time: 0.211083 Oct 10 10:51:35.294446 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1477/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:35 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:35.308916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c9a005c-589e-4ed5-8108-0b9e8e889bd5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ca483a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:35.339458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:35.339963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:35.340352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:35.340767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:35.341435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:35.365395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.366122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.366723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.367786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.368963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.369476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.402303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c9a005c-589e-4ed5-8108-0b9e8e889bd5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce" status: 200 len: 662 microversion: 2.1 time: 0.106687 Oct 10 10:51:35.406974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1478/2841] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:35 2022] GET /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:35.412668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:35.417446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:35.418273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:35.431031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for user 129b6fe8d95645568c521e13faa798c2 and project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:35.436163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.436899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.437414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.438202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.438603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:35.438796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.439297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.472573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:35.475072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:35.578801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c67a9591-c2d5-442a-80a1-f9e3dcb9996f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.048007 Oct 10 10:51:35.587899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1364/2842] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:35.593238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:35.602336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:35.618706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.619536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.620178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.621061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.622258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.623283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.816601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:35.828160 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9002e74-8175-4813-818c-96696695de44 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1280 microversion: 2.1 time: 0.238846 Oct 10 10:51:35.828783 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1365/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:35 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:35.845736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:35.845736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:35.862767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.863368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.864019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.864528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:35.864996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:35.865426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:35.916518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:51:35.974570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:35.989126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:35.990742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:36.000624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-734d034c-c6d7-4a4e-99e4-b6be58a2736a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1793 microversion: 2.20 time: 0.591310 Oct 10 10:51:36.004502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1479/2844] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:51:35 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1793 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:51:36.044283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aeb77a-172e-4a78-94d0-2d2131ab79fc", "name": "network-vif-plugged", "status": "completed", "tag": "4e605f61-87e2-4c17-8a46-0f29f5570fa4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:36.103666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c2c1526-89e3-472d-9484-215b0ab0d9b8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 204 len: 0 microversion: 2.1 time: 0.272784 Oct 10 10:51:36.104918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1366/2845] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:35 2022] DELETE /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:51:36.107901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:36.108527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:36.108986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:36.117430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfcfbdf2-ecbb-4e1c-a37c-d87f99c561c8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:36.120929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfcfbdf2-ecbb-4e1c-a37c-d87f99c561c8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:36.126802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:36.165277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] Creating event network-vif-plugged:4e605f61-87e2-4c17-8a46-0f29f5570fa4 for instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc on n-h2-860687-2 Oct 10 10:51:36.190789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-df9b720e-b0c3-4d15-89cf-040f58e220d7 req-f09b8c75-b987-4d3d-98fc-257e8a1f10db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172491 Oct 10 10:51:36.193708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1480/2846] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:36.223113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfcfbdf2-ecbb-4e1c-a37c-d87f99c561c8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:36.224939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:36.225929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:36.232919 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfcfbdf2-ecbb-4e1c-a37c-d87f99c561c8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1218 microversion: 2.1 time: 0.125832 Oct 10 10:51:36.234313 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1367/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:36 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:36.242501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:36.243898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:36.244650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:36.245563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:36.246182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:36.246790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:36.319668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:36.320457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:36.334751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:36.336411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:36.337881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:36.343277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:36.345118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:36.345815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:37.150770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:37.174188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef885719-e28e-49b4-812b-daa3bec98234 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1528 microversion: 2.1 time: 0.976561 Oct 10 10:51:37.181335 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1481/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:36 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1528 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:37.214398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:37.215325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:37.235400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:37.236580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:37.241582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:37.245028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:37.249255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:37.252105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:37.265430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:37.278007 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-749ca565-a387-44d0-b026-cf944924319b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1309 microversion: 2.1 time: 0.961358 Oct 10 10:51:37.279556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1368/2849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:36 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1309 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:37.288352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:37.297575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:37.325001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:37.326783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:37.332159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:37.333079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:37.337390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:37.338779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:38.115963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:38.134781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c149ef70-d7f2-4b19-b06c-885c2b6199b7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1222 microversion: 2.1 time: 0.845708 Oct 10 10:51:38.140641 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1369/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:37 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1222 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:38.152283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e06c340-7b98-400c-a668-916b1e684712 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ca91e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:38.231275 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e06c340-7b98-400c-a668-916b1e684712 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592" status: 200 len: 661 microversion: 2.1 time: 0.087945 Oct 10 10:51:38.246380 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1370/2851] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:38 2022] GET /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:38.264617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:38.264617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:38.310958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:38.313657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:38.315588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:38.316563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:38.317754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:38.319517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:38.336115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:38.507683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:38.523625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c70c7e3-351a-4d2c-9480-9457860cfafd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 1.330497 Oct 10 10:51:38.540569 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1482/2852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:37 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:38.546632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aeb77a-172e-4a78-94d0-2d2131ab79fc", "name": "network-vif-unplugged", "status": "completed", "tag": "4e605f61-87e2-4c17-8a46-0f29f5570fa4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:38.568107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:38.569059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:38.569956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:38.593379 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] Creating event network-vif-unplugged:4e605f61-87e2-4c17-8a46-0f29f5570fa4 for instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc on n-h2-860687-2 Oct 10 10:51:38.603509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fbe13b17-82aa-43ba-a374-bfde2e10aed8 req-a15bc5c3-c81a-42fd-ad9e-c294f4fcd10b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060348 Oct 10 10:51:38.604870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1483/2853] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:38.610265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fddfb0a6-4e58-4387-9390-310e404b909e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777944040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:38.677868 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fddfb0a6-4e58-4387-9390-310e404b909e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592" status: 200 len: 661 microversion: 2.1 time: 0.069976 Oct 10 10:51:38.678455 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1484/2854] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:38 2022] GET /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592 => generated 661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:38.689161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:38.689778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:38.704357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:38.705334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:38.705996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:38.706951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:38.707702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:38.708757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.002931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:39.017641 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8225e905-c5e6-4551-8ca5-42a856bb32da tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1528 microversion: 2.1 time: 0.770029 Oct 10 10:51:39.018864 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1371/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:38 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1528 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:39.170802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:39.172206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:39.185087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:39.186676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:39.187347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.189632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:39.190274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:39.190869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.364036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:39.373651 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd38ddc7-fd55-4a3d-aa58-58147795cc70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1276 microversion: 2.1 time: 0.210489 Oct 10 10:51:39.393497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1372/2856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:39 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:39.428182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:39.442894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ab09d06-7c09-4dcf-9f89-f02aeeff7c6d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1309 microversion: 2.1 time: 0.762648 Oct 10 10:51:39.451842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1485/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:38 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1309 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:39.547316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:39.548039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:39.558833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:39.562590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:39.563422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.564414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:39.567688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:39.568378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.585553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90158b28-c0c6-4d71-b74c-7e86176af903", "tag": "0e07de35-1d43-4cb0-a42c-598e8c1eaf22"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:39.602190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:39.603360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:39.603778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:39.635316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] Creating event network-changed:0e07de35-1d43-4cb0-a42c-598e8c1eaf22 for instance 90158b28-c0c6-4d71-b74c-7e86176af903 on n-h1-860687-2 Oct 10 10:51:39.642914 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b1ef178e-fb4a-45be-b97d-4570fd3eb120 req-75b43463-f492-4e77-9bd5-662cc33b79a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060856 Oct 10 10:51:39.645835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1486/2858] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:51:40.042845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:40.043855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:40.050240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.050733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.051224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:40.051923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.052387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.052994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:40.347961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:40.369899 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf16f9ad-9d07-44f5-b867-36f82e651560 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.826349 Oct 10 10:51:40.395812 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1373/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:39 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:40.403163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93a826c7-f8eb-4689-94f0-72fa03116d67 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cd938b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:40.480159 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93a826c7-f8eb-4689-94f0-72fa03116d67 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690" status: 200 len: 661 microversion: 2.1 time: 0.082253 Oct 10 10:51:40.482990 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1374/2860] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:40 2022] GET /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:40.489615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:40.490581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:40.499984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.501018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.502618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:40.503545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.504161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.504742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:40.660749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:40.739410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:40.747875 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-153d675f-18e9-4b51-a06d-a1739ac44c57 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 200 len: 1528 microversion: 2.1 time: 0.710069 Oct 10 10:51:40.748473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1487/2861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:40 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 1528 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:40.753441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:40.754064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:40.768404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:40.779011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.779527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.779975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:40.783683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:40.784388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:40.785248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:41.097016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:41.107079 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-842b56dc-5af5-405f-865a-bb691e68661b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.622080 Oct 10 10:51:41.125452 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1375/2862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:40 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:41.131181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-338ba38c-b71d-4453-b6d5-ba46734271e7 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c8b2280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:41.213347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-338ba38c-b71d-4453-b6d5-ba46734271e7 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690" status: 200 len: 661 microversion: 2.1 time: 0.086380 Oct 10 10:51:41.214352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1376/2863] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:51:41 2022] GET /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690 => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:41.235951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e5873-8bb0-495a-80c8-ce1b71859e61", "name": "network-vif-plugged", "status": "completed", "tag": "078f09bc-6b65-4943-b53e-3c27f60906d3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:41.258213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:41.259945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:41.260391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:41.294617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] Creating event network-vif-plugged:078f09bc-6b65-4943-b53e-3c27f60906d3 for instance b69e5873-8bb0-495a-80c8-ce1b71859e61 on n-h2-860687-2 Oct 10 10:51:41.307497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8a6c37be-c0af-4ca0-9016-ffabd6ddef14 req-6fef4a36-d2d0-4d1f-9a61-244006fe713f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090129 Oct 10 10:51:41.308360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1377/2864] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:41.314983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aeb77a-172e-4a78-94d0-2d2131ab79fc", "name": "network-vif-deleted", "tag": "4e605f61-87e2-4c17-8a46-0f29f5570fa4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:41.348188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:41.349396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:41.360639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:41.384430 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] Creating event network-vif-deleted:4e605f61-87e2-4c17-8a46-0f29f5570fa4 for instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc on n-h2-860687-2 Oct 10 10:51:41.390005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a4c9543e-b588-4498-8679-044c580cfff0 req-7ac7dcc9-170b-42e9-9379-9bcead8a3e45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080061 Oct 10 10:51:41.391257 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1378/2865] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:41.397355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-780219074", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:41.478450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:41.603410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:41.615550 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf90fac7-1781-4a9c-9b67-c5b7d21481bc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1253 microversion: 2.1 time: 0.865445 Oct 10 10:51:41.616186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1488/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:40 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1253 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:41.620724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:41.621584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:41.628810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:41.629555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:41.630187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:41.631112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:41.631796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:41.632425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.493823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:42.511441 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b9e499a-ead0-43cb-ab52-3fa1e99364e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.894135 Oct 10 10:51:42.534039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1489/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:41 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:42.541707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:42.544056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:42.549256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:42.549934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:42.550654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:42.551255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:42.552276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:42.559033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.560945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.561614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.562755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.563669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.564268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.578074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.579320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.579900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.580771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.581166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc HTTP/1.1 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc'} Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:42.583049 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:51:42.587801 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:42.588307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.588307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.591819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:42.592949 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccdb3fd9-b8f1-4699-9f8f-91a3fffaa58b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 404 len: 111 microversion: 2.1 time: 0.057473 Oct 10 10:51:42.593535 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1490/2868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:42 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:51:42.599976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:42.599976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:42.606682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.607519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.608181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.609111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.610061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.610855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.627553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Getting quotas for project d52c9284c44f4f6ab6e782cf2b294bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:42.643377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Getting quotas for user 7ebc20917b184775bf16d3031f597e13 and project d52c9284c44f4f6ab6e782cf2b294bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:42.669356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:42.672744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:42.756538 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eabde8cc-2acf-4827-a41a-570afa3bea8b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363849 Oct 10 10:51:42.765483 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1379/2869] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:42.770581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bedd302-c68d-41e5-a711-72dc65a73465 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'create', calling method: .version_select at 0x7f677d1a4ca0>, body: {"keypair": {"name": "tempest-keypair-1811554130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIm4LcedRhizdIod71s/QO9yUwT44G5BCIHTTjSr4uY6If3OQHnyJAmeSAHZNJvXcF9ZYHs2xrEZiEc7fCq1ASknpEEbFQuBm0Rj4UMmSGdIAhunGsMFDhgRoweiD8Lmg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:42.815551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6bedd302-c68d-41e5-a711-72dc65a73465 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for project b24ce776c5874bd4b87760c3954fc50f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:42.827378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6bedd302-c68d-41e5-a711-72dc65a73465 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for user 42455b03876445a8851d343d88b72953 and project b24ce776c5874bd4b87760c3954fc50f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:42.884605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bedd302-c68d-41e5-a711-72dc65a73465 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117678 Oct 10 10:51:42.886024 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1380/2870] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:42.892309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:42.893712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:42.904101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.905117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.906269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:42.907232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:42.909025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:42.909689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.058493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:43.070310 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-865b51e1-ff33-40ea-9528-04977ff8d484 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.474421 Oct 10 10:51:43.071758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:43.080197 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfb73150-8846-4409-9054-a8eb180faa38 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1211 microversion: 2.1 time: 0.192745 Oct 10 10:51:43.080772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1381/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:42 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:43.084382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1491/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:42 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:43.091542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1835304889", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:43.188011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:43.538554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:43.539330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:43.557946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.558451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.558894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.559643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.560105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.574973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.852630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:43.853163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:43.853540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:43.853957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:43.854144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:43.854408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:43.862415 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c53649f-6299-40c1-9794-54682e3869ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.327728 Oct 10 10:51:43.875020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1492/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:43 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:43.875249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.875249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.875249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.875249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.875654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2510fae-68a5-4540-beb0-4a596ff96a50", "tag": "03f94d7e-a415-45b4-ada4-e9ef72817eba"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:43.875767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.875767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.882580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.883040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.884063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.892267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Getting quotas for project d52c9284c44f4f6ab6e782cf2b294bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:43.897283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Getting quotas for user 7ebc20917b184775bf16d3031f597e13 and project d52c9284c44f4f6ab6e782cf2b294bcd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:43.898151 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] Creating event network-changed:03f94d7e-a415-45b4-ada4-e9ef72817eba for instance e2510fae-68a5-4540-beb0-4a596ff96a50 on n-h1-860687-2 Oct 10 10:51:43.905998 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ff80a75f-0b58-412b-acc0-faa9a8a76cff req-dff9ec9c-4452-4a4f-9595-2f3ffb2767f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040992 Oct 10 10:51:43.908065 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1493/2874] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:43.913291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:43.915448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90158b28-c0c6-4d71-b74c-7e86176af903", "name": "network-vif-deleted", "tag": "0e07de35-1d43-4cb0-a42c-598e8c1eaf22"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:43.917111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:43.926674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:43.927189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:43.927623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:43.940033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_external_events [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] Unable to find a host for instance 90158b28-c0c6-4d71-b74c-7e86176af903. Dropping event network-vif-deleted {{(pid=128800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 10:51:43.940941 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-38fa09b3-bbc8-4660-a65a-a6186c1a3246 req-082aa017-de8e-41a1-98cb-f57d2c23082a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031243 Oct 10 10:51:43.941538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1494/2875] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 10:51:43.965575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64a359ff-c5b6-4f73-9c1c-17ab1be11436 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880795 Oct 10 10:51:43.966892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1382/2876] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:43.978130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2466b0b2-eea1-4120-b18a-cc6d2ba4b969 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:43.979209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2466b0b2-eea1-4120-b18a-cc6d2ba4b969 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:44.054423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2466b0b2-eea1-4120-b18a-cc6d2ba4b969 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:44.075938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2466b0b2-eea1-4120-b18a-cc6d2ba4b969 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1218 microversion: 2.1 time: 0.100551 Oct 10 10:51:44.077146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1495/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:43 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:44.096973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:44.097870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:44.107786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.108478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:44.108948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.109601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:44.109994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:44.110966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.111890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.112765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:44.122540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.125867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.129930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:44.131753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.136226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.137730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:44.251364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:44.273118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93a24380-ef46-4d59-b34b-0c70cf798d4a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1211 microversion: 2.1 time: 0.172780 Oct 10 10:51:44.278459 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1496/2878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:44 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1211 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:44.535209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:44.556746 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd82566d-6802-429b-8adb-f95ca4f3c9d3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.463456 Oct 10 10:51:44.574833 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1383/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:44 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:44.888700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:44.889879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:44.906581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.907120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.907570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:44.908287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:44.908750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:44.909182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.103226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:45.105124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:45.121244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.122044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.122715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.123727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.124400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.125065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.262189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:45.276453 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cfe061a3-fd72-480b-b4ba-d956b87feb1b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1214 microversion: 2.1 time: 0.179558 Oct 10 10:51:45.277772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1384/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:45 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:45.307771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:45.308566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:45.338447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.339392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.340011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.341361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.342936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.343579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.376443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:45.389100 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a848811e-268a-4cae-a48d-c005cb7951e0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.505305 Oct 10 10:51:45.389693 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1497/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:44 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:45.583449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:45.584073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:45.602790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.603330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.603780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.604492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:45.604952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:45.605379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:45.773924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:45.792243 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e4838dc-308e-4d58-b94a-a6bed5d6a55c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 200 len: 1211 microversion: 2.1 time: 0.492565 Oct 10 10:51:45.793508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1385/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:45 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 1211 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:46.032036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db26c176-1196-40eb-b7d7-70833826274c", "tag": "8078630b-fccc-4706-9e28-798783f3f178"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:46.047385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.047859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.056462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.088893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] Creating event network-changed:8078630b-fccc-4706-9e28-798783f3f178 for instance db26c176-1196-40eb-b7d7-70833826274c on n-h2-860687-2 Oct 10 10:51:46.097877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8ea27381-12af-4495-a2b2-f99cb63d9c83 req-0709f825-0133-4543-a898-87bace32241e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069448 Oct 10 10:51:46.102960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1386/2883] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:46.336891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:46.347750 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7583ecfc-e0d5-4776-b1d5-47682f0a1024 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.767799 Oct 10 10:51:46.392096 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1498/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:45 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:46.399122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.400527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:46.409952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.410452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.410934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.411723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.412183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.412664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.435672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-238012df-31c2-4a78-afcf-164b770c37d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.233160 Oct 10 10:51:46.438059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1387/2885] 10.222.0.16 () {58 vars in 1128 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 10 10:51:46.448478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.449859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:46.458329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.459784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.462152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.463155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.464079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.464692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.541501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:46.550606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82cd6f64-c8df-4e6c-bd4e-4c7ef62e34aa tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1276 microversion: 2.1 time: 0.157082 Oct 10 10:51:46.551361 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1499/2886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:46 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:46.556810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b2c2d4f-4c31-4e1f-ba28-f76b1bcb0efe tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Calling method '.version_select at 0x7f67778c0700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.583251 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9b2c2d4f-4c31-4e1f-ba28-f76b1bcb0efe tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] HTTP exception thrown: Image not found. Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b2c2d4f-4c31-4e1f-ba28-f76b1bcb0efe tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Request method failure captured: Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_lCpswa1uCHE19FAnR6bahYNKr7x091gwg-_XjJ5V27xxMtoWKkNuaZWOydk4Ny6k-xBKxGF1pfMosbYOD6Wn_ICd7KBvuUgcc1RWOyYHuqVHZH65_ES5V9a-240zhIDnok7huUIedDqu4ejZ1wTrMjHsDpsPAeZtIj06QmfqtQUm4 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a455b53ee043e29679c7721fee0bab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a455b53ee043e29679c7721fee0bab"}]}] Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e3a4b45932d1498cb42c94248848b177 Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '-1'} Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.585893 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b2c2d4f-4c31-4e1f-ba28-f76b1bcb0efe tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.592027 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b2c2d4f-4c31-4e1f-ba28-f76b1bcb0efe tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034739 Oct 10 10:51:46.598908 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1500/2887] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:46.599932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-661f6619-0cdd-4291-9128-2be718ae0e4d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Calling method '.version_select at 0x7f67778c03a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.637759 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-661f6619-0cdd-4291-9128-2be718ae0e4d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] HTTP exception thrown: Image not found. Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-661f6619-0cdd-4291-9128-2be718ae0e4d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Request method failure captured: Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/e1b9cc85-a362-4fe0-8e55-dc9e784800cj HTTP/1.1 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_lCpswa1uCHE19FAnR6bahYNKr7x091gwg-_XjJ5V27xxMtoWKkNuaZWOydk4Ny6k-xBKxGF1pfMosbYOD6Wn_ICd7KBvuUgcc1RWOyYHuqVHZH65_ES5V9a-240zhIDnok7huUIedDqu4ejZ1wTrMjHsDpsPAeZtIj06QmfqtQUm4 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a455b53ee043e29679c7721fee0bab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a455b53ee043e29679c7721fee0bab"}]}] Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e3a4b45932d1498cb42c94248848b177 Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e1b9cc85-a362-4fe0-8e55-dc9e784800cj'} Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e1b9cc85-a362-4fe0-8e55-dc9e784800cj to delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1b9cc85-a362-4fe0-8e55-dc9e784800cj could not be found. Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.639821 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:51:46.644878 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.650021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-661f6619-0cdd-4291-9128-2be718ae0e4d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.651679 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-661f6619-0cdd-4291-9128-2be718ae0e4d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/e1b9cc85-a362-4fe0-8e55-dc9e784800cj" status: 404 len: 62 microversion: 2.1 time: 0.056417 Oct 10 10:51:46.652322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1501/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/e1b9cc85-a362-4fe0-8e55-dc9e784800cj => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:46.664294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ca5664d-56aa-409d-982d-a866e508011f tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Calling method '.version_select at 0x7f6780c64c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.683099 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3ca5664d-56aa-409d-982d-a866e508011f tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] HTTP exception thrown: Image not found. Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ca5664d-56aa-409d-982d-a866e508011f tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Request method failure captured: Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/84b3a60a-2147-462d-b08f-c14eb60f99c31 HTTP/1.1 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_lCpswa1uCHE19FAnR6bahYNKr7x091gwg-_XjJ5V27xxMtoWKkNuaZWOydk4Ny6k-xBKxGF1pfMosbYOD6Wn_ICd7KBvuUgcc1RWOyYHuqVHZH65_ES5V9a-240zhIDnok7huUIedDqu4ejZ1wTrMjHsDpsPAeZtIj06QmfqtQUm4 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a455b53ee043e29679c7721fee0bab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a455b53ee043e29679c7721fee0bab"}]}] Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e3a4b45932d1498cb42c94248848b177 Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '84b3a60a-2147-462d-b08f-c14eb60f99c31'} Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 84b3a60a-2147-462d-b08f-c14eb60f99c31 to delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84b3a60a-2147-462d-b08f-c14eb60f99c31 could not be found. Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.684845 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ca5664d-56aa-409d-982d-a866e508011f tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.689782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ca5664d-56aa-409d-982d-a866e508011f tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/84b3a60a-2147-462d-b08f-c14eb60f99c31" status: 404 len: 62 microversion: 2.1 time: 0.028521 Oct 10 10:51:46.691577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1502/2889] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/84b3a60a-2147-462d-b08f-c14eb60f99c31 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:46.695720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00554a1-ee3a-409e-904e-d6f85d1ae7d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Calling method '.version_select at 0x7f67778c09d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.723772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b00554a1-ee3a-409e-904e-d6f85d1ae7d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] HTTP exception thrown: Image not found. Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00554a1-ee3a-409e-904e-d6f85d1ae7d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Request method failure captured: Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/tempest-invalid-410946336 HTTP/1.1 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_lCpswa1uCHE19FAnR6bahYNKr7x091gwg-_XjJ5V27xxMtoWKkNuaZWOydk4Ny6k-xBKxGF1pfMosbYOD6Wn_ICd7KBvuUgcc1RWOyYHuqVHZH65_ES5V9a-240zhIDnok7huUIedDqu4ejZ1wTrMjHsDpsPAeZtIj06QmfqtQUm4 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a455b53ee043e29679c7721fee0bab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a455b53ee043e29679c7721fee0bab"}]}] Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e3a4b45932d1498cb42c94248848b177 Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'tempest-invalid-410946336'} Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-410946336 to delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-410946336 could not be found. Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.725537 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00554a1-ee3a-409e-904e-d6f85d1ae7d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.729673 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b00554a1-ee3a-409e-904e-d6f85d1ae7d4 tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-410946336" status: 404 len: 62 microversion: 2.1 time: 0.034938 Oct 10 10:51:46.732513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1503/2890] 10.222.0.16 () {58 vars in 1203 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/tempest-invalid-410946336 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:46.737369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fddef18-2a33-4e4f-b79b-fb3126b50a3d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Calling method '.version_select at 0x7f6780c64dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.765660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6fddef18-2a33-4e4f-b79b-fb3126b50a3d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] HTTP exception thrown: Image not found. Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fddef18-2a33-4e4f-b79b-fb3126b50a3d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Request method failure captured: Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/images/acc914e3-9fb0-4c39-b8d6-b33cd8aa0891 HTTP/1.1 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_lCpswa1uCHE19FAnR6bahYNKr7x091gwg-_XjJ5V27xxMtoWKkNuaZWOydk4Ny6k-xBKxGF1pfMosbYOD6Wn_ICd7KBvuUgcc1RWOyYHuqVHZH65_ES5V9a-240zhIDnok7huUIedDqu4ejZ1wTrMjHsDpsPAeZtIj06QmfqtQUm4 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7a455b53ee043e29679c7721fee0bab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7a455b53ee043e29679c7721fee0bab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7a455b53ee043e29679c7721fee0bab"}]}] Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b7a455b53ee043e29679c7721fee0bab Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-46176415 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e3a4b45932d1498cb42c94248848b177 Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-46176415-project Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'acc914e3-9fb0-4c39-b8d6-b33cd8aa0891'} Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image acc914e3-9fb0-4c39-b8d6-b33cd8aa0891 to delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image acc914e3-9fb0-4c39-b8d6-b33cd8aa0891 could not be found. Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.770473 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.781158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fddef18-2a33-4e4f-b79b-fb3126b50a3d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.788823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fddef18-2a33-4e4f-b79b-fb3126b50a3d tempest-ImagesDeleteNegativeTestJSON-46176415 tempest-ImagesDeleteNegativeTestJSON-46176415-project] 10.222.0.16 "DELETE /compute/v2.1/images/acc914e3-9fb0-4c39-b8d6-b33cd8aa0891" status: 404 len: 62 microversion: 2.1 time: 0.047504 Oct 10 10:51:46.788823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1504/2891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:46 2022] DELETE /compute/v2.1/images/acc914e3-9fb0-4c39-b8d6-b33cd8aa0891 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:51:46.822384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:46.823381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:46.843990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.845910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.846365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.851487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:46.852085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:46.852651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:46.911742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 HTTP/1.1 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '90158b28-c0c6-4d71-b74c-7e86176af903'} Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:51:46.913712 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:51:46.922185 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:51:46.924152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:51:46.925385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74847eb5-5f06-4ec7-aefa-d8c455419703 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 404 len: 111 microversion: 2.1 time: 0.111281 Oct 10 10:51:46.926570 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1505/2892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:46 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:51:47.014611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:47.023724 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3288e18c-7f76-468d-85fc-0553c7e56caa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.584323 Oct 10 10:51:47.026605 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1388/2893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:46 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:47.116254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-747276579", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:47.205321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:47.371616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:47.372843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:47.387515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:47.388322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:47.389470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:47.392704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:47.393665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:47.394311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.167442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:48.179766 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93bfb552-eb4a-4733-bc4c-2edfb1c6145b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.812404 Oct 10 10:51:48.196466 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1389/2894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:47 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:48.196466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2510fae-68a5-4540-beb0-4a596ff96a50", "name": "network-vif-plugged", "status": "completed", "tag": "03f94d7e-a415-45b4-ada4-e9ef72817eba"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:48.202371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:48.204254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:48.204702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.225391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] Creating event network-vif-plugged:03f94d7e-a415-45b4-ada4-e9ef72817eba for instance e2510fae-68a5-4540-beb0-4a596ff96a50 on n-h1-860687-2 Oct 10 10:51:48.234301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6df064a3-2c94-4475-bdea-e3dd65a66589 req-2d5bf779-cc84-41aa-aca9-40687514d79e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051523 Oct 10 10:51:48.235439 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1390/2895] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:48.241730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:48.243741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:48.252225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:48.253164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:48.253769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.254978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:48.255634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:48.256499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.436805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:48.455565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ac167be-06c6-485b-a768-78d976ee1bf1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1276 microversion: 2.1 time: 0.218696 Oct 10 10:51:48.464673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1391/2896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:48 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:48.464673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:48.464673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:48.465578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:48.481165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:48.481733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:48.482298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.483163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:48.483743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:48.484562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:48.965865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:48.982302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5409212-05c6-40ab-b980-f969229c237d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1322 microversion: 2.1 time: 0.524519 Oct 10 10:51:48.989275 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1392/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:48 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:48.997844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-801287120", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:49.075720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] validate_networks() for [('83ac550b-56ca-4869-90c4-64164905ffa9', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:51:49.207532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:49.208041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:49.208439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:49.208849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:49.209268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:49.225532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:49.226122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:49.226544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:49.228060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:49.228868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:49.229476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:49.267903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:49.280227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:49.298227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:49.300821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:49.313250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:49.355652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be0d8271-24be-4604-b822-fed10b2d899d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243894 Oct 10 10:51:49.356539 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1506/2898] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:49.363814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:49.364703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:49.372250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:49.372753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:49.373191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:49.374730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:49.375244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:49.375677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:49.976755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:49.990628 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6dba32af-16ff-4943-88f1-30ed9047fb45 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.632812 Oct 10 10:51:50.011786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1507/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:49 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:50.042256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:50.044180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:50.053666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.054850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.056278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.057356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.057825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.059014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.236092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:50.247518 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3859f862-77db-4ba3-b0f8-2d9050f7fce2 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1216 microversion: 2.1 time: 0.232645 Oct 10 10:51:50.248389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1508/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:50 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1216 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:50.420583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:50.421086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:50.421466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:50.422379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:50.423030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:50.432507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.433091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.433715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.434420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.434989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.435491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.454977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:50.462091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for user 42455b03876445a8851d343d88b72953 and project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:50.476147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:51:50.479751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:51:50.527728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c44d8f3a-d1d6-4737-b511-65c17145963d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f677c0a15e0>, body: {"keypair": {"name": "tempest-keypair-1433860265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPno+wGVT/lsvuiJIKGNzmgq539C7ZEdAzje9WRb1j8NMrz/tmKVD7IXDsTNPDjVLvcYieEFMsD4ea5v07V1b9S6JCpWq3IYBt2QVxRsvJo79bCmMrvz96GXlrs35wDmlw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:50.555864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c44d8f3a-d1d6-4737-b511-65c17145963d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:50.563120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c44d8f3a-d1d6-4737-b511-65c17145963d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:50.570759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2572042-2ab2-4367-90ea-585364e25f9f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.579571 Oct 10 10:51:50.579402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1393/2901] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:51:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:51:50.586262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:50.587828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:50.597105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.597858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.598540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.599612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.600258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.602726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.632829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c44d8f3a-d1d6-4737-b511-65c17145963d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.383010 Oct 10 10:51:50.635219 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1509/2902] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:50.649566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:50.650717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:50.668095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.670625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.673074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.674732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:50.675893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:50.676562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:50.706494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:51.193480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:51.201801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7b679f4-af80-470f-9c82-485825085ffb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.620999 Oct 10 10:51:51.202396 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1394/2903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:50 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:51.210121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.210737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:51.224654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:51.234216 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-20828b2d-cf1e-48fd-bbcd-6ad68769bdb7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1517 microversion: 2.1 time: 0.597744 Oct 10 10:51:51.234800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1510/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:50 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:51.250497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b92fcd7-b5a4-4e6b-9140-b5da097766c4 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f677ca48040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.253563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.254059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.254983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.255242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.255702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.256133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.277950 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b92fcd7-b5a4-4e6b-9140-b5da097766c4 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1433860265" status: 200 len: 498 microversion: 2.1 time: 0.031165 Oct 10 10:51:51.278542 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1511/2905] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:51:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1433860265 => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:51.295901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db26c176-1196-40eb-b7d7-70833826274c", "name": "network-vif-plugged", "status": "completed", "tag": "8078630b-fccc-4706-9e28-798783f3f178"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:51.314507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.315417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.316184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.345916 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] Creating event network-vif-plugged:8078630b-fccc-4706-9e28-798783f3f178 for instance db26c176-1196-40eb-b7d7-70833826274c on n-h2-860687-2 Oct 10 10:51:51.370300 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-58108de2-f38f-4721-a2b5-e445ae3f10c6 req-c5eb28df-9896-46ea-82bb-761e94957887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073997 Oct 10 10:51:51.371149 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1512/2906] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:51.381197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.386008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:51.395811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.397676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.400487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.402703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.404074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.404592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.417731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:51.426122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4673058d-b508-4d4f-8595-77a40730affc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1228 microversion: 2.1 time: 0.219692 Oct 10 10:51:51.426742 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1395/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:51 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1228 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:51.432255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:51.451808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:51.473753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.474355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.474797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.475781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.476402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.477051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.499885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:51.504449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'flavor' on Instance uuid e2510fae-68a5-4540-beb0-4a596ff96a50 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:51:51.618847 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fec4a8f6-bf09-4b48-8e2b-220a093f76e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action" status: 200 len: 32 microversion: 2.1 time: 0.190530 Oct 10 10:51:51.626006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1396/2908] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:51:51 2022] POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:51:51.653648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.655096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:51.686252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.687315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.689479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.690560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.692859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.693298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.847547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:51.856522 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67f53661-5130-41d1-9c5f-4cf70273b936 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.479434 Oct 10 10:51:51.857110 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1513/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:51 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:51.861826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33020efb-6019-42e6-a1a9-917a58524f94 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f6777a0c820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.886730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:51.892437 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33020efb-6019-42e6-a1a9-917a58524f94 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433860265" status: 202 len: 0 microversion: 2.1 time: 0.033859 Oct 10 10:51:51.893166 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1514/2910] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 10:51:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433860265 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:51:51.900617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:51.901581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:51.902829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f5c9cf1-0ad1-4b73-b731-83a3e391efd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1278 microversion: 2.1 time: 0.265060 Oct 10 10:51:51.903860 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1397/2911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:51 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:51.910625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.911495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.912165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.913260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:51.914027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:51.915846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:51.944431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8aab77d-292b-4aa9-9e38-28e30b9f0ab6 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f677cd931f0>, body: {"keypair": {"name": "tempest-keypair-382456631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3kdZy6xdsYHCf7UW6rdaFaDOxWasppnF9Bznp5RjOTZIZtiPwDC8vJyF+CamxFGr0PceT/ARsQPafEOuXr9wH33T550AuKMQWqSqH5v8HXml8py6IhHaEIS2jnpZnGOQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:51.975131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c8aab77d-292b-4aa9-9e38-28e30b9f0ab6 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:51.984709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c8aab77d-292b-4aa9-9e38-28e30b9f0ab6 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:52.046704 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8aab77d-292b-4aa9-9e38-28e30b9f0ab6 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141511 Oct 10 10:51:52.053090 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1398/2912] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:52.058641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:52.069395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:52.070217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:52.070857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:52.083916 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] Creating event network-changed:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:51:52.089749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c5ac136e-3fb6-46a3-abf3-4db84f3d7d90 req-3e4b378c-b04c-4a60-bced-4c75a7f364d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Oct 10 10:51:52.091237 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1399/2913] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:52.096841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f98b02e4-ec4f-4a85-8761-ca1a580469e0 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f677c3aed30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:52.124166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f98b02e4-ec4f-4a85-8761-ca1a580469e0 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382456631" status: 202 len: 0 microversion: 2.1 time: 0.031100 Oct 10 10:51:52.129499 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1400/2914] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382456631 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:51:52.140535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e19cb5c6-ec3d-4d0f-87e2-ff28ed41a566 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f677c9f35e0>, body: {"keypair": {"name": "tempest-keypair-1855277586", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:52.168765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e19cb5c6-ec3d-4d0f-87e2-ff28ed41a566 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:52.175706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e19cb5c6-ec3d-4d0f-87e2-ff28ed41a566 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:52.224307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e19cb5c6-ec3d-4d0f-87e2-ff28ed41a566 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.092986 Oct 10 10:51:52.231203 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1401/2915] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:52 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:52.232354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:52.233238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:52.240439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:52.241066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:52.241579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:52.242371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:52.244108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:52.245626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:52.952542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:52.962424 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5217b59f-37fa-4dcb-af35-088a63e64847 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 1.067029 Oct 10 10:51:52.963234 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1515/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:51 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:52.969909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5d2c0f3-f7a0-4076-b8f7-756140855a21 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f6780cc45e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:52.972521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:52.991483 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d55eab5-f209-4a08-8ace-acc1a83848c6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.764230 Oct 10 10:51:52.992198 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1402/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:52 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:52.997290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5d2c0f3-f7a0-4076-b8f7-756140855a21 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855277586" status: 202 len: 0 microversion: 2.1 time: 0.032420 Oct 10 10:51:52.998051 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1516/2918] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 10:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855277586 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:51:53.010349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.011253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:53.011633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.014376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:53.018218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.018919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.019554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.020266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.020725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.021172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.029788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.030733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.031601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.035579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.036328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.039185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.219463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:53.229931 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fecb1c36-8a2c-43df-ac2f-42d5a13699ae tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1282 microversion: 2.1 time: 0.235840 Oct 10 10:51:53.237397 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1403/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:52 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:53.243547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.244879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:53.254414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.255326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.255877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.256694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.257421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.257951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.530968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:53.540769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9844be8-6c6f-444d-a67c-686d266c95a8 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1318 microversion: 2.1 time: 0.533777 Oct 10 10:51:53.541660 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1517/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:52 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:53.560126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fe32367-04ed-4b04-8e0b-36f7df1ab6fa tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f6780c413a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-150307735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+NjJLS0qm+bmm0s0ZopRxXOUYZPUOKitbOIqBhx9eCkn7NAsHfTOSCnD7fTkCG8pQVIhnoyDxCIAhfF/bUhRaYhUTAfh2BKiJOXblj8gtHwWEaDdc76AJBy93fwGU/2w=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:53.582082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-0fe32367-04ed-4b04-8e0b-36f7df1ab6fa tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:53.592403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-0fe32367-04ed-4b04-8e0b-36f7df1ab6fa tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:53.619920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fe32367-04ed-4b04-8e0b-36f7df1ab6fa tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.076915 Oct 10 10:51:53.621693 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1518/2921] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:53.635753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e4ab94a-711d-4336-bce6-2131c7ab1ffe tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f67778e1700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1253559250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+72ppN7/cN9O6x7uWWCmImk4w65mLTRxPN6ockCQwrAHEecQnsgzlAfDj5kNDW1RvPsgfZ1EMSp5fWIcaab0q8Xr7vZsPCj+VzcraXGNXoNF+g3D/OXel7tflTC7y1mw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:53.655833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3e4ab94a-711d-4336-bce6-2131c7ab1ffe tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:53.664292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-3e4ab94a-711d-4336-bce6-2131c7ab1ffe tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:53.691938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e4ab94a-711d-4336-bce6-2131c7ab1ffe tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061666 Oct 10 10:51:53.692899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1519/2922] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:53.705649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-629fbb28-8237-4f6f-8e1a-d0173571b4d3 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Action: 'create', calling method: .version_select at 0x7f6780e27dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-76806856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8nhxDuc21PU0xI4EXOLb6BGV1mUwY7qmtyOfda8zE6Fc5LKaAA/e6dkdlkBCeD6V6i6NB4InT4CAWrO6rt1moHfcnjjV59tFA9oDx0g0VbdEFPS/5Idc+MSD1QmzLYqQ=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:53.723814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-629fbb28-8237-4f6f-8e1a-d0173571b4d3 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:51:53.730655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-629fbb28-8237-4f6f-8e1a-d0173571b4d3 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Getting quotas for user 216aab478b3742afa1d759377a1392d2 and project d0d551f462c447249a4bc7acec1bb591. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:51:53.758751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-629fbb28-8237-4f6f-8e1a-d0173571b4d3 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056858 Oct 10 10:51:53.759441 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1520/2923] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:51:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:51:53.769723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a3614f7-4959-4733-b720-9dd41395354e tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f67778e1040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.773601 n-d-860687-2 devstack@n-api.service[128800]: WARNING oslo_db.sqlalchemy.utils [None req-7a3614f7-4959-4733-b720-9dd41395354e tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:51:53.781301 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a3614f7-4959-4733-b720-9dd41395354e tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.015405 Oct 10 10:51:53.782049 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1521/2924] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:51:53 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:53.793468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc598e08-f1ef-4f2e-ae64-11f4387c684b tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f67778e5dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.814144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc598e08-f1ef-4f2e-ae64-11f4387c684b tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-76806856" status: 202 len: 0 microversion: 2.1 time: 0.024714 Oct 10 10:51:53.815571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:53.819123 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1522/2925] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-76806856 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:51:53.826151 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07a36c28-4aca-4a1c-8b85-db58297057d6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.587247 Oct 10 10:51:53.826678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28512c1b-f27a-4f23-aa37-3544669b914d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f67778e5f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.842404 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1404/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:53 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:53.857219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28512c1b-f27a-4f23-aa37-3544669b914d tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1253559250" status: 202 len: 0 microversion: 2.1 time: 0.036901 Oct 10 10:51:53.857856 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1523/2927] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Oct 10 10:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1253559250 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:51:53.869189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-055b7be4-d62d-4b78-980e-b4615f5ebf55 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] Calling method '.version_select at 0x7f677c9635e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.884701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f84222-724d-4329-a870-a6c66b2a1670", "tag": "789ea5b1-eedd-42a3-a160-36ab2a828687"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:53.896147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:53.896919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:53.897697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:53.910974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-055b7be4-d62d-4b78-980e-b4615f5ebf55 tempest-KeyPairsV2TestJSON-48924540 tempest-KeyPairsV2TestJSON-48924540-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-150307735" status: 202 len: 0 microversion: 2.1 time: 0.046670 Oct 10 10:51:53.911655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1405/2928] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-150307735 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:51:53.912274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] Creating event network-changed:789ea5b1-eedd-42a3-a160-36ab2a828687 for instance a2f84222-724d-4329-a870-a6c66b2a1670 on n-h2-860687-2 Oct 10 10:51:53.926690 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4e2cfcb7-c64a-4e67-9482-d044f4c3ed58 req-24d9713c-839a-453e-b701-5c822a204dd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046190 Oct 10 10:51:53.927899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1524/2929] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:51:53.989453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:53.992041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:53.998313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.000786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.001612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.002883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.003528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.004195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.021074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:54.022490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:54.035986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.038314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.038947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.041086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.042635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.043714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.455790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:54.465276 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eba51b8c-5e68-42e6-bff3-436538ea98e7 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.479606 Oct 10 10:51:54.466993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1406/2930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:53 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:54.472158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:54.472987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:54.480391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.481227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.481834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.482699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.482898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:54.483545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.484152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.494418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8d0a3cc-2df1-4d90-a075-61526b8106d9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.479804 Oct 10 10:51:54.495573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1525/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:54 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:54.501088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1cae6d-cdab-4da1-a40e-76f423f50903", "tag": "3fb3eec8-ee22-422c-ae0a-de4cac573f82"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:54.514522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.515147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.515762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.532245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] Creating event network-changed:3fb3eec8-ee22-422c-ae0a-de4cac573f82 for instance ea1cae6d-cdab-4da1-a40e-76f423f50903 on n-h1-860687-2 Oct 10 10:51:54.537489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e3f1434e-52db-4f8d-ace4-ad6112741347 req-475359c3-2d91-48e9-ae9f-1710f048a256 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Oct 10 10:51:54.538204 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1526/2932] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:51:54.573632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:54.574843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:54.582788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.583792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.584699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.585720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.587648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.588285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.590124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:54.601681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12cd7e69-3ec1-422f-a54d-df1d9e147b04 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1282 microversion: 2.1 time: 0.132925 Oct 10 10:51:54.616552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1407/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:54 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:54.854962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:54.856027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:54.865728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.866601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.867288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.869156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.869843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.870575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.910400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:54.922382 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5c3712b-fe42-4938-a948-aed7322c69d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1508 microversion: 2.1 time: 0.354608 Oct 10 10:51:54.923925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1527/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:54 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:54.949500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:54.950635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:54.958228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.959386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.960235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:54.962189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:54.963157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:54.964167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.289266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:55.299110 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-321e3ba8-4e3d-4d59-a703-405775541edd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.450170 Oct 10 10:51:55.299773 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1408/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:54 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:55.405940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:55.417650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b28e59e4-1acd-4da3-880d-6b36c7324708 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1508 microversion: 2.1 time: 0.475061 Oct 10 10:51:55.421379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1528/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:54 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:55.444646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:55.448707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:55.458107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.458221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.458624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.459386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.459980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.460412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.500690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:55.501367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:55.522525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.526125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.526589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.527365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.527833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.528265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.572280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:51:55.572792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:51:55.573452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:51:55.573877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:51:55.574304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:51:55.655979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:55.663608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.664162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.666213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.667082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.667557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.667993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.718084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fc28d1e-ac69-4a01-98cb-d0e56c3b5a60 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "POST /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c/action" status: 202 len: 1110 microversion: 2.1 time: 0.275931 Oct 10 10:51:55.719672 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1409/2937] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:51:55 2022] POST /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c/action => generated 1110 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 10:51:55.740899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:55.741530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:55.744696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:55.749329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.749785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.750949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.751692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.752151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.752577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.755404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4cf6e6f9-e469-48c3-8329-9c40e68eadeb tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.265716 Oct 10 10:51:55.756813 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1529/2938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:55 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:55.762552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:55.763378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:55.774330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.775494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.776172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:55.778873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:55.779759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:55.780771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:56.566684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:56.580422 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f931a84-4746-4dd0-a672-ea6f337d9927 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.848934 Oct 10 10:51:56.581272 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1410/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:55 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:56.587667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:56.588473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:56.596702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:56.597424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:56.598920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:56.601639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:56.603191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:56.603842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:56.757171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:56.765624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3d658be-59c7-4dca-9f1c-b65854b2503b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 1.007107 Oct 10 10:51:56.766095 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1530/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:55 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:56.770567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:56.771210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:56.783534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=89,nova_api:DELETE=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:56.795553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:56.796325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:56.796677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:56.798048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:56.799395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:56.799835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:57.358954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:57.371838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05897f01-1201-440c-b9e0-fdb26eb819e9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.787817 Oct 10 10:51:57.372601 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1411/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:56 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:57.381882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:57.384849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:57.403723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:57.404449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:57.405050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:57.405948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:57.407376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:57.407968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:57.520179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:57.530641 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59d71a92-ddf4-4088-b9e3-bf98a9673cbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.763472 Oct 10 10:51:57.534553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1531/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:56 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:57.606795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:57.608651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:57.625361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:57.626461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:57.627599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:57.628770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:57.638495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:57.659301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.067564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:58.077882 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23bad2af-8bc7-4ec7-ba98-8d0e26536935 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.704187 Oct 10 10:51:58.078468 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1412/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:57 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:58.093534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:58.094158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:58.110731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.111908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.112473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.113269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.124626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.125371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.227125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:58.242071 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9964e992-b575-4ef8-ad8d-6953f8a47b8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.640091 Oct 10 10:51:58.243510 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1532/2944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:57 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:58.396136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:58.396837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:58.404810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.405813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.406473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.407431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.408114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.408743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.689572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:58.692513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:58.697589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:58.697825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81210b26-813c-4f60-9fa2-dc826331f2b2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.305918 Oct 10 10:51:58.712507 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1533/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:58 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:58.715735 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df226169-753b-4dc4-a36f-8cbbb319f883 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.626138 Oct 10 10:51:58.720261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:58.720891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:58.723326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1413/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:58 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:58.736515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.737026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.737476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.738171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.738824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.739302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.846465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59ac015-f938-495e-af31-5348fcb70118", "tag": "c9533809-0005-4d56-b532-2dc456626fa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:51:58.869394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:58.870214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:58.871592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:58.902729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] Creating event network-changed:c9533809-0005-4d56-b532-2dc456626fa1 for instance f59ac015-f938-495e-af31-5348fcb70118 on n-h2-860687-2 Oct 10 10:51:58.908158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e7eaf06a-6788-4ece-bfe6-028395da8e45 req-5c9da618-1591-4d8f-80ab-405974be5e81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066116 Oct 10 10:51:58.909882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1414/2947] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:51:59.088059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:59.102775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:59.104237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:59.109486 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-170eed10-8e5e-40dc-8d80-f21217e90666 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.395693 Oct 10 10:51:59.111073 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1534/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:58 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:59.114087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.114821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.116315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.117948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.118703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.119525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.272930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:59.276045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:59.294483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:51:59.298934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.300433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.301586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.302742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.303734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.304567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.544074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:59.554372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3c00d71-d054-491e-83f9-db34b24cc755 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.456332 Oct 10 10:51:59.555565 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1415/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:59 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:51:59.728116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:59.728116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:59.735460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:51:59.738924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.742838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.743649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.744579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.750215 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0cfb200-c79d-4edd-96fb-eb851eabc56c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.483614 Oct 10 10:51:59.750823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1535/2950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:59 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:51:59.755763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:51:59.756866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:51:59.764796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.765687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.766484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.767485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:51:59.768161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.768860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:51:59.779589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:51:59.780647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.123346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:00.134085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:00.151836 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb60ee73-e47e-4bca-ad86-55dc6adbd562 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.399473 Oct 10 10:52:00.153343 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ddf3682-d7d7-4ec7-9f19-b8e2356ad325 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.430902 Oct 10 10:52:00.167025 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1536/2951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:59 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:00.167269 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1416/2952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:51:59 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:52:00.173600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:00.174392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:00.188917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.189678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.190292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.191327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.191960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.192582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.388170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:00.392573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:00.399138 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54a787b6-58de-4bca-a328-b4573025f276 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.239848 Oct 10 10:52:00.399971 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1537/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:00 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:00.584488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:00.585387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:00.593784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:00.598548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.599706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.600340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.601408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.603143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.603802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.768797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:00.780567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:00.781374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:00.788074 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3b126a9-6455-46ea-b011-56f62c6f222c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.208340 Oct 10 10:52:00.796300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.797317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1417/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:00 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:00.798295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.799181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:00.806334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:00.809336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:00.809897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:01.099481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:01.111894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97f40a6d-6ddc-49f6-9af1-c011c412d752 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.332896 Oct 10 10:52:01.111894 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1538/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:00 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:52:01.184860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:01.185813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:01.186133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:01.190713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:01.213527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:01.213900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:01.216205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:01.216835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:01.218543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:01.220372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:01.222869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:01.223619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:01.225623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:01.228923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:01.229673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:01.233918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.084599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:02.102441 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b309bd52-91dc-4df9-9640-a0331c5ffa00 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.925999 Oct 10 10:52:02.103698 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1539/2956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:01 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:02.112525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:02.113470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:02.132685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.133728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.134180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.135097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.139846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.140538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.142154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:02.159567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0515fdc-4139-48f4-a9b8-9b1c177009c4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.983572 Oct 10 10:52:02.163800 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1418/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:01 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:02.176303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f84222-724d-4329-a870-a6c66b2a1670", "name": "network-vif-plugged", "status": "completed", "tag": "789ea5b1-eedd-42a3-a160-36ab2a828687"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:02.200832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=50 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:02.207565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.209165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.211271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.260838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] Creating event network-vif-plugged:789ea5b1-eedd-42a3-a160-36ab2a828687 for instance a2f84222-724d-4329-a870-a6c66b2a1670 on n-h2-860687-2 Oct 10 10:52:02.276006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a60118cd-3a5e-4f8c-8cf1-7e51bca8df93 req-0b4cd48b-43cf-41c0-bcab-a1f3e96e93d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108369 Oct 10 10:52:02.276692 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1419/2958] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:02.284767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:02.291893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:02.321702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.323848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.324474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.330476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.331237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.331877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.542649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:02.551531 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5fbd324e-b794-403d-9d0c-c43084ea6b6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.444494 Oct 10 10:52:02.552138 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1540/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:02 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:02.573173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:02.577305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:02.592379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.592879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.593325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.594049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:02.594512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:02.594946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:02.808138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:02.827997 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71d4972d-b05f-4aa0-a15d-3c79cef3d099 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.536972 Oct 10 10:52:02.829730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1420/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:02 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:02.943251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:02.948485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91058ab1-7292-49bf-8283-679aaa40eaab tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.380395 Oct 10 10:52:02.949095 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1541/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:02 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:03.127852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:03.128679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:03.137501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.138053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.138891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.139718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.140308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.140749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.181885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-079a9467-ba87-4c04-b037-63118982022d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677ca88160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-672641043", "description": "tempest-description-1960368679"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:03.371978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:03.388536 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4697e2d4-b859-4c99-8a15-133115357097 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.266522 Oct 10 10:52:03.403402 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1542/2962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:03 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:52:03.410650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:03.411310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:03.418455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.418937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.419708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.420653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.421279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.421711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.438962 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-079a9467-ba87-4c04-b037-63118982022d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.390529 Oct 10 10:52:03.439584 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1421/2963] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:03.452942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcf17564-15c2-4a2d-82fb-23e627317878 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677c7baf70>, body: {"security_group_rule": {"parent_group_id": "6d050b3f-2ccb-4838-8f59-b52db99ff797", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:03.619549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:03.628041 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab4e50a6-bd50-4d3b-9d95-bde6036cfc77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.223231 Oct 10 10:52:03.628619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1543/2964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:03 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:03.650622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:03.652508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:03.662019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.662780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.663837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.665609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.666787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.667462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.738989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:03.764637 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcf17564-15c2-4a2d-82fb-23e627317878 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.315373 Oct 10 10:52:03.765673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1422/2965] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:52:03.785456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12d8d8e3-f614-4cdd-817d-0ef820d628cb tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677cd934c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1159993004", "description": "tempest-description-944148762"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:03.870862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:03.905741 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29a4ddc0-76f3-4e19-b2ed-76a50e97aa56 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1320 microversion: 2.1 time: 0.275806 Oct 10 10:52:03.906338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1544/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:03 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:03.935113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:03.937641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:03.974254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.974808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.975240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:03.975973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:03.976427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:03.977224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.051246 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12d8d8e3-f614-4cdd-817d-0ef820d628cb tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.275905 Oct 10 10:52:04.052335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1423/2967] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:04.057426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:04.065815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:04.068999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:04.086564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:04.099227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:04.099227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.099227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:04.099964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:04.100577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.336886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:04.341325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:04.352512 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-720e6043-66c6-454c-8612-0ad6f438a852 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.444299 Oct 10 10:52:04.359664 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1545/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:03 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:04.364748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14613491-990a-4403-b435-c844d360475f tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f67778f6a60>, body: {"security_group_rule": {"parent_group_id": "ca5f1686-64f0-41b7-ae3f-115f78a7c08c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:04.374920 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cc7aa4d-2ff9-4d11-bf27-ab23c137ce8f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.321316 Oct 10 10:52:04.375465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1424/2969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:04 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:04.385952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1cae6d-cdab-4da1-a40e-76f423f50903", "name": "network-vif-plugged", "status": "completed", "tag": "3fb3eec8-ee22-422c-ae0a-de4cac573f82"}, {"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-plugged", "status": "completed", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:04.402301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:04.402784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:04.403557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.420960 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Creating event network-vif-plugged:3fb3eec8-ee22-422c-ae0a-de4cac573f82 for instance ea1cae6d-cdab-4da1-a40e-76f423f50903 on n-h1-860687-2 Oct 10 10:52:04.421565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] Creating event network-vif-plugged:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:52:04.428540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-542f26ff-a0bb-490d-b65c-043c04afa557 req-49a3f794-08cb-4b17-b379-0b90e8cd99d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051595 Oct 10 10:52:04.430359 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1425/2970] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:04.438802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:04.440687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:04.451255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:04.452335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:04.453197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.454273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:04.455617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:04.456262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:04.978685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14613491-990a-4403-b435-c844d360475f tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.617582 Oct 10 10:52:04.979396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1546/2971] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:04 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:04.984203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:04.984881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:04.994800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.004075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.004853 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8d82455-665a-4249-b9cd-b3a3456cd7fa tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.572749 Oct 10 10:52:05.005199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.005858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1426/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:04 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.006059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.006979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.007616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.008509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.010906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:05.011949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:05.018057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.018732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.019441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.020348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.021087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.021928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.325000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.334237 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8cfe7ff6-7f08-4fe1-872a-636a3668b634 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1502 microversion: 2.1 time: 0.327250 Oct 10 10:52:05.340625 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1427/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:05 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1502 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.349617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bfffeb9-cb08-4b3e-bbae-7733a9b26308 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677ce154c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1083689394", "description": "tempest-description-1623593379"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:05.371338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.380786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b31922d-d517-42ac-9ee3-183c2e9bd5f2 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.399882 Oct 10 10:52:05.381319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1547/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:04 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.400096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:05.400722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:05.408737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.409251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.409688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.410406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.410864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.412070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.632116 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bfffeb9-cb08-4b3e-bbae-7733a9b26308 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.289864 Oct 10 10:52:05.633786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1428/2975] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:05 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:05.638642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:05.639563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:05.647278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.649060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.649583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.650336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.650821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.651236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.695577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.708267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3347a829-3107-4484-8bd4-33fdf5184b0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1502 microversion: 2.1 time: 0.325905 Oct 10 10:52:05.709493 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1548/2976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:05 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.717749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:05.718692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:05.727616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.728451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.728923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.729649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.730107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.730625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.893245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.902049 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea505d59-2429-434c-bec9-6258fcfc3f6b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.267071 Oct 10 10:52:05.902635 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1429/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:05 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.907893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65da8a21-ccf7-4c10-9221-c9f729c3955d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677ce15d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1091909115", "description": "tempest-description-309530252"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:05.936661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:05.945426 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-803a1edc-32d3-4eda-a12b-80f108e18ad2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1318 microversion: 2.1 time: 0.234526 Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1549/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:05 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.959202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:05.959932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:05.960024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:05.990688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:06.100851 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6d443d1-ef30-4e8a-b942-e47701c0ea46 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 204 len: 0 microversion: 2.1 time: 0.152705 Oct 10 10:52:06.102591 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1550/2979] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:05 2022] DELETE /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:06.109513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:06.113928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:06.128537 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65da8a21-ccf7-4c10-9221-c9f729c3955d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.224460 Oct 10 10:52:06.129361 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1430/2980] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:06.131097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.131600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.132036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.133360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.133817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.134388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.136694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:06.137614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:06.154719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.155496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.156059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.156873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.157562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.158098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.379776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:06.389554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83b5c3a8-af04-493a-9069-1c1817ebd82b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.285164 Oct 10 10:52:06.391768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1551/2981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:06 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:06.399508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62217f78-39e5-4eb5-bc1b-44a96e0ed642 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f67778e15e0>, body: {"security_group_rule": {"parent_group_id": "64077e3b-21b3-4a9f-bb62-5e49b3ffc6c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3854ae28-fca7-46fd-adfa-11e8e2da8a66"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:06.432670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:06.442729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31e52702-b8bb-4be1-a111-c443056e4eb5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1508 microversion: 2.1 time: 0.312055 Oct 10 10:52:06.443262 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1431/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:06 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:06.449725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:06.449725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:06.455381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.455879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.456321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.457034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.457491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.458282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.672394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:06.681525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7de25b44-fc5b-417a-aaec-00a847b10276 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.236572 Oct 10 10:52:06.682428 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1432/2983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:06 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:06.688488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59ac015-f938-495e-af31-5348fcb70118", "name": "network-vif-plugged", "status": "completed", "tag": "c9533809-0005-4d56-b532-2dc456626fa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:06.700896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.701531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.702021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.720097 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] Creating event network-vif-plugged:c9533809-0005-4d56-b532-2dc456626fa1 for instance f59ac015-f938-495e-af31-5348fcb70118 on n-h2-860687-2 Oct 10 10:52:06.726352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ae69512d-8994-408c-ac42-0e9a2bbddc3a req-fc6dd7ea-80af-400b-9e81-e03d89dd45b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042580 Oct 10 10:52:06.728717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1433/2984] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:06.846852 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-62217f78-39e5-4eb5-bc1b-44a96e0ed642 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.452957 Oct 10 10:52:06.856779 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1552/2985] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:06.866905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-754c2289-8137-43c2-8022-580ed22fceec tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677cfb94c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-946357231", "description": "tempest-description-1947259039"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:06.928190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:06.929137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:06.937910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.938402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.938842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:06.939573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:06.940029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:06.940446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.114524 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-754c2289-8137-43c2-8022-580ed22fceec tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.251751 Oct 10 10:52:07.124834 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1434/2986] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:07.144013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:07.145615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:07.163850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:07.181138 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-684875d3-b136-44f2-8dac-02a094f5c878 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.258244 Oct 10 10:52:07.182318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.185496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.186795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.189554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.190821 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1553/2987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:06 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:07.192880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.194800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.205602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c822eeb-39ba-4b30-b761-f71c314d960d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f67778e1310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-78500751", "description": "tempest-description-530592636"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:07.462105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:07.475724 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5bf1884-9827-447e-91d2-f64d444db723 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1467 microversion: 2.1 time: 0.349347 Oct 10 10:52:07.478579 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1435/2988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:07 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:07.488489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:07.489470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:07.505057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.506381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.507067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.509374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.520048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.521065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.651629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c822eeb-39ba-4b30-b761-f71c314d960d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.459417 Oct 10 10:52:07.653134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1554/2989] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:07 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:07.657783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:07.658615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:07.673013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.676065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.680825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.681778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.683047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.683742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.875027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:07.892096 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8beebc65-474b-4a65-ad76-03595183c445 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1324 microversion: 2.1 time: 0.412274 Oct 10 10:52:07.893231 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1436/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:07 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:07.898609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:07.899678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:07.913264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.914125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.914912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:07.918818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:07.919617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.920808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.921504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.922216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.925699 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b3d0c6f-6217-4bd7-a9dc-c055bb2fa65c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1508 microversion: 2.1 time: 0.271397 Oct 10 10:52:07.926599 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1555/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:07 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:07.932173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:07.933893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:07.941542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.942306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.942975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.943965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:07.944669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:07.946033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:07.995526 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6680f53-9e9a-426c-a5d0-6702ae2613d5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments/8d8c74a5-1f28-4031-a3a2-d5265414aea6" status: 200 len: 194 microversion: 2.20 time: 0.100967 Oct 10 10:52:07.996179 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1437/2992] 10.222.0.16 () {60 vars in 1454 bytes} [Mon Oct 10 10:52:07 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments/8d8c74a5-1f28-4031-a3a2-d5265414aea6 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:08.001035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2312d92-c70b-43c5-b3bf-b16ffddc0a15 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677ce154c0>, body: {"security_group_rule": {"parent_group_id": "52786365-2751-4440-986e-89cd89282faf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "60d6e26a-1a95-4666-89d7-d2c97f644283"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:08.218119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:08.230570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-450be2a8-88d7-42c5-861d-62978d2a399b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1466 microversion: 2.1 time: 0.302431 Oct 10 10:52:08.236819 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1556/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:07 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1466 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:08.246086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:08.249093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:08.282580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.283519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.284408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.285961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.286592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.287995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.677984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:08.687420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11c9f248-bc0a-41c9-8f9c-cb58d20af4cc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.449085 Oct 10 10:52:08.703658 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1557/2994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:08 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:08.716790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:08.717662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:08.727517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2312d92-c70b-43c5-b3bf-b16ffddc0a15 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.729659 Oct 10 10:52:08.728174 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1438/2995] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:07 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:08.733664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:08.734660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:08.744035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.746760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.748564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.749642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.750489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.750992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.751416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.752114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:08.752567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.752987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.756096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:08.756540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:08.931387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'services' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:09.040049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:09.049427 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9539091-ba0f-4b51-8f72-af1584304ec4 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.319984 Oct 10 10:52:09.050540 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1439/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:08 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:09.061881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-392043455"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:09.064817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:09.074966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.075880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.076774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.077732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.078436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.079180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.084127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:09.126388 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b434fcf-3318-42b1-bf08-24cace18778c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments/8d8c74a5-1f28-4031-a3a2-d5265414aea6" status: 202 len: 0 microversion: 2.20 time: 0.421250 Oct 10 10:52:09.132466 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1558/2997] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 10 10:52:08 2022] DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments/8d8c74a5-1f28-4031-a3a2-d5265414aea6 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:09.155228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f84222-724d-4329-a870-a6c66b2a1670", "name": "network-vif-deleted", "tag": "789ea5b1-eedd-42a3-a160-36ab2a828687"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:09.202619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.203142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.205300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.247372 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] Creating event network-vif-deleted:789ea5b1-eedd-42a3-a160-36ab2a828687 for instance a2f84222-724d-4329-a870-a6c66b2a1670 on n-h2-860687-2 Oct 10 10:52:09.262456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8c946945-2306-49b9-960e-44fc556fe005 req-071b7c03-da7e-4ded-9398-4a2cf6a3be5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128013 Oct 10 10:52:09.266141 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1559/2998] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:09.273861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d93c4115-a6d3-47d6-912e-032c5ae5d145 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f67778d9d30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:09.524416 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b58fcdc-8488-4818-9a46-37ea5ca74023 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "POST /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95/action" status: 202 len: 0 microversion: 2.1 time: 0.471635 Oct 10 10:52:09.525497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1440/2999] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:09 2022] POST /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:52:09.532826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:09.533538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:09.558612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.559135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.559575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.560293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.560756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.561183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.690791 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d93c4115-a6d3-47d6-912e-032c5ae5d145 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/60d6e26a-1a95-4666-89d7-d2c97f644283" status: 202 len: 0 microversion: 2.1 time: 0.423324 Oct 10 10:52:09.692367 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1560/3000] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:09 2022] DELETE /compute/v2.1/os-security-groups/60d6e26a-1a95-4666-89d7-d2c97f644283 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:09.704671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:09.711870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:09.723456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.724382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.725103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.726625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.727363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.728086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.793926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.794511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.796184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.796867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lazy-loading 'fault' on Instance uuid a2f84222-724d-4329-a870-a6c66b2a1670 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:09.866429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:09.877877 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-76bba11c-3d6f-4634-8aa2-8edccbd8f82f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 200 len: 1310 microversion: 2.1 time: 0.178219 Oct 10 10:52:09.879229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1561/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:09 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:09.906929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:09.912859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:09.917296 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74e1a6a9-7914-4165-b777-0dc8023cb2b6 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1522 microversion: 2.1 time: 0.389796 Oct 10 10:52:09.919706 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1441/3002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:09 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:09.925694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bd293e5-39d1-4af3-bce1-08a439e2c1b9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cc55160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:09.932879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:09.950671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.952711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.953517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.954610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:09.955709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:09.956311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:09.995456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4635a1d-8300-4b80-869e-6759a42c86b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103587 Oct 10 10:52:10.001437 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1562/3003] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:09 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:10.006505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd33cfca-9d84-402b-8d2a-474e9ce20488 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f6780cc49d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.009972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bd293e5-39d1-4af3-bce1-08a439e2c1b9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.088903 Oct 10 10:52:10.010500 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1442/3004] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:09 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:10.020184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.020807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:10.037999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.038871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.039565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.040633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.041181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.041528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.059789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd33cfca-9d84-402b-8d2a-474e9ce20488 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/52786365-2751-4440-986e-89cd89282faf" status: 200 len: 247 microversion: 2.1 time: 0.056949 Oct 10 10:52:10.060506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1563/3005] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:52:10 2022] GET /compute/v2.1/os-security-groups/52786365-2751-4440-986e-89cd89282faf => generated 247 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:10.074241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.074241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:10.080398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.080991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.081748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.082752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.083472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.084140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.305224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:10.308585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:10.315647 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8ec1cf4-b590-4d3c-a4eb-e336e7d50d08 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.303997 Oct 10 10:52:10.318012 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d5efeb7-d6a8-44c7-acf9-c15364231972 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1522 microversion: 2.1 time: 0.256433 Oct 10 10:52:10.321390 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1443/3006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:10 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:10.327651 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1564/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:10 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:10.335227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.335227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:10.349135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.358161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.358161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.358161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.358992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d53e6887-2d3d-4eee-91da-2ff56a45d883 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f67778f3d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1691693834", "description": "tempest-description-1176640550"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:10.365192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.365929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.573350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:10.581872 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bc18fe0-00c2-46ca-9359-b7b178ef34a2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.259239 Oct 10 10:52:10.585176 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1444/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:10 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:10.601299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1361884318"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:10.604715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:10.613518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.614151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.615030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.616003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.616649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.617736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.673761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d53e6887-2d3d-4eee-91da-2ff56a45d883 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.344613 Oct 10 10:52:10.676084 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1565/3009] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:10.691610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f66c7c9-3aa9-44f3-aa48-e2065bfb11de tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f67778e15e0>, body: {"security_group_rule": {"parent_group_id": "8a89a7a5-3355-4626-befb-6dc37edb4d6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:10.924271 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a5cd5ee-da2e-44e4-9a60-d5ec815ad830 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118/action" status: 202 len: 0 microversion: 2.1 time: 0.326872 Oct 10 10:52:10.925506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1445/3010] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:10 2022] POST /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:52:10.930835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f66c7c9-3aa9-44f3-aa48-e2065bfb11de tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.242696 Oct 10 10:52:10.932050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.933018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:10.939444 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1566/3011] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:10.939618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.940350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.940866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.941838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:10.942365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:10.942861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:10.951872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59aa888f-7f0f-4bec-aa80-c1beb1e1e54b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f67778f6160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:10.957993 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 HTTP/1.1 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a2f84222-724d-4329-a870-a6c66b2a1670'} Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:10.960201 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:10.967315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-537b3ecc-81e6-447e-8079-34f6ba61362d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 404 len: 111 microversion: 2.1 time: 0.036884 Oct 10 10:52:10.973006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1446/3012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:10 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:10.983734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e6ae635-d52a-4552-b200-69a59c2e2288 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Action: 'create', calling method: .version_select at 0x7f677ce7f5e0>, body: {"security_group_rule": {"parent_group_id": "8a89a7a5-3355-4626-befb-6dc37edb4d6b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:11.123971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59aa888f-7f0f-4bec-aa80-c1beb1e1e54b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e" status: 204 len: 0 microversion: 2.1 time: 0.181942 Oct 10 10:52:11.124652 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1567/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:10 2022] DELETE /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:11.129750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63109c43-f66e-4bc8-9984-1969ee1fc108 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: .version_select at 0x7f67778f6a60>, body: {"keypair": {"name": "tempest-key-1448111556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtqI2pZGFlhmFJamYlSjdrVP+TmRZ3Rfh1BH2wg0600pfQgQiqQiafoAyubVFLOvZTezcULN+q8fr9tsLKgiG+dUBboJWTPAn83PdYvfIqzXzeAcfFTBX8bU+QyrSC18g=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:11.152447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-63109c43-f66e-4bc8-9984-1969ee1fc108 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:11.161672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-63109c43-f66e-4bc8-9984-1969ee1fc108 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:11.210056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63109c43-f66e-4bc8-9984-1969ee1fc108 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.083809 Oct 10 10:52:11.212035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1568/3014] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:52:11 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:11.224020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.224792 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e6ae635-d52a-4552-b200-69a59c2e2288 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.250710 Oct 10 10:52:11.232042 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1447/3015] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:52:10 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:11.232042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00c5d0dc-32ed-46d1-964d-2a3afffc1a73 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c7baf70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.232618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:11.244397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.244959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.245481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.246250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.246777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.247317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.280072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3fb250b8-a1a5-4fa6-9a39-17f0de6a270a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065815 Oct 10 10:52:11.280897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1569/3016] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:11.284606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00c5d0dc-32ed-46d1-964d-2a3afffc1a73 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.057691 Oct 10 10:52:11.285486 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1448/3017] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:11.287717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97741653-d746-42d1-9c9a-9447ad695409 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f677c073e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.291704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-175f264f-dffe-424b-8528-31be9a044712 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '.version_select at 0x7f677ce7f1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.297122 n-d-860687-2 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-175f264f-dffe-424b-8528-31be9a044712 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:52:11.304030 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-175f264f-dffe-424b-8528-31be9a044712 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.017091 Oct 10 10:52:11.305753 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1449/3018] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:11.310881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af48ab7c-55f2-4a73-a086-94aa0b7571d4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677cd95310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.314010 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-97741653-d746-42d1-9c9a-9447ad695409 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Image not found. Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97741653-d746-42d1-9c9a-9447ad695409 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e HTTP/1.1 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: exception: Image not found. Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '46ebf618-3c74-44b2-9838-f6d56e7f398e'} Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46ebf618-3c74-44b2-9838-f6d56e7f398e Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 10:52:11.322448 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46ebf618-3c74-44b2-9838-f6d56e7f398e could not be found. Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:11.327513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97741653-d746-42d1-9c9a-9447ad695409 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Image not found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:11.334068 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97741653-d746-42d1-9c9a-9447ad695409 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e" status: 404 len: 62 microversion: 2.1 time: 0.048565 Oct 10 10:52:11.334068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1570/3019] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:52:11.355197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.355974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:11.371492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.376884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.377669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.378888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.379594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.380242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.428175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af48ab7c-55f2-4a73-a086-94aa0b7571d4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8a89a7a5-3355-4626-befb-6dc37edb4d6b" status: 200 len: 665 microversion: 2.1 time: 0.121266 Oct 10 10:52:11.430572 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1450/3020] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/os-security-groups/8a89a7a5-3355-4626-befb-6dc37edb4d6b => generated 665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:11.435290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.435915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:11.454165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.454678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.455154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.455875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.456338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.456768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.625950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:11.637483 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ff8887b-7442-476d-9fa9-ad7aa0035fc3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1534 microversion: 2.1 time: 0.301374 Oct 10 10:52:11.638080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1571/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1534 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:11.643260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f647c4b-7e98-4395-917e-afc55da243a0 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677c073e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.721065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:11.729152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d753c61c-7db2-4c77-8c90-b0ad8a9bdd85 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.297519 Oct 10 10:52:11.732284 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1451/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:11.745048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-590190702", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-key-1448111556", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:11.855374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:11.867901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f647c4b-7e98-4395-917e-afc55da243a0 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/9870f5ce-ce88-4d32-8ad4-d90708d0984f" status: 202 len: 0 microversion: 2.1 time: 0.228053 Oct 10 10:52:11.872564 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1572/3023] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Oct 10 10:52:11 2022] DELETE /compute/v2.1/os-security-group-rules/9870f5ce-ce88-4d32-8ad4-d90708d0984f => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:11.877483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:11.878325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:11.891822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.893931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.894744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:11.900080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:11.901125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:11.901783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.236048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:12.245193 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a82ed60a-0cc6-4fb1-9acb-9fee70594c92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.371272 Oct 10 10:52:12.245884 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1573/3024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:11 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:12.251373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-118dae7e-528c-4405-8101-7b080a7c731f tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f67778d9700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.595885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:12.596580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:12.596766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:12.598349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:12.598977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:12.611685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.612162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.612595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.613529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.614001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.614412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.623048 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-118dae7e-528c-4405-8101-7b080a7c731f tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a89a7a5-3355-4626-befb-6dc37edb4d6b" status: 202 len: 0 microversion: 2.1 time: 0.375652 Oct 10 10:52:12.624177 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1574/3025] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:12 2022] DELETE /compute/v2.1/os-security-groups/8a89a7a5-3355-4626-befb-6dc37edb4d6b => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:12.630950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.636170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:12.644234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.645070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.645743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.646918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.649178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.650267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.675321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:12.685571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:12.703676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:12.708777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:12.735242 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5325df46-82b1-437e-8082-6fd14eb723b1 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108245 Oct 10 10:52:12.736196 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1575/3026] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:12 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:12.745399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7cc00782-f4c8-4cd4-9a04-7f605bb30687 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777898c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.778360 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e15998e-e68a-4488-96c9-1169c3096443 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044022 Oct 10 10:52:12.779657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1452/3027] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:52:12.790735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677cf1f550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.819294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:52:12.820263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7cc00782-f4c8-4cd4-9a04-7f605bb30687 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.079260 Oct 10 10:52:12.820436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Neutron security group 60d6e26a-1a95-4666-89d7-d2c97f644283 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:52:12.820936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] HTTP exception thrown: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.820936 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.822258 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1576/3028] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:12 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Request method failure captured: Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/60d6e26a-1a95-4666-89d7-d2c97f644283 HTTP/1.1 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_lSVvGquJp0gByTnN708iEFpt8AAme2YcQpUG01WaM-EdoMZ6TEU1J0bQpJFRbwRXb00izXWzIKXy_XAo9KeFSS_KO-XiShR1ILZmJp06mjd3RcE4gVyxwL54z7BS2C_6FhJhGaGy7iposBFW10b1JsetU8lFASXdm-_gRtQA8XRW8 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 23f0f6edc2a84740b241dbe738217656 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1655158787 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23f0f6edc2a84740b241dbe738217656"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23f0f6edc2a84740b241dbe738217656", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23f0f6edc2a84740b241dbe738217656"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23f0f6edc2a84740b241dbe738217656"}]}] Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1655158787 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 23f0f6edc2a84740b241dbe738217656 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1655158787 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesTestJSON-1655158787-project Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: fed74e7e3a5d4ecd88c1817096beacc5 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1655158787-project Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '60d6e26a-1a95-4666-89d7-d2c97f644283'} Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:52:12.831427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] Oct 10 10:52:12.836393 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:12.841456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Returning 404 to user: Security group 60d6e26a-1a95-4666-89d7-d2c97f644283 does not exist Oct 10 10:52:12.841456 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-58c47c37-1d56-48bb-9b7b-19dad1350014'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:12.845142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c4eddc7-ae59-410c-8f51-e93d50ed96b4 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/60d6e26a-1a95-4666-89d7-d2c97f644283" status: 404 len: 194 microversion: 2.1 time: 0.060945 Oct 10 10:52:12.846275 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1453/3029] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:12 2022] DELETE /compute/v2.1/os-security-groups/60d6e26a-1a95-4666-89d7-d2c97f644283 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:12.855165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.856019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:12.859566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:12.860486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:12.875600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.876310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.878130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.879258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.880194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.880904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.881561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.882174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.882934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:12.887030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:12.888591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:12.889482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:13.210271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:13.218560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:13.224042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d82dd0a8-ff34-4ae2-90ee-1a9bb266d2a7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.376367 Oct 10 10:52:13.227971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e224d9a-cee7-4ade-9c5b-c651006f085b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1540 microversion: 2.1 time: 0.404490 Oct 10 10:52:13.228958 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1454/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:12 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:13.232169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1577/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:12 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1540 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:13.240011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3d4eadd-b859-44d1-bf0e-a981c12ec6d0 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f6777987820>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:13.240953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0e2d36e-1172-48fd-b722-600c3b994549 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:13.244554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0e2d36e-1172-48fd-b722-600c3b994549 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:13.416045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0e2d36e-1172-48fd-b722-600c3b994549 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:13.424194 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0e2d36e-1172-48fd-b722-600c3b994549 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1228 microversion: 2.1 time: 0.193788 Oct 10 10:52:13.427386 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1455/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:13 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1228 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:13.470584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:13.471714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:13.483963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:13.484668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:13.486061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:13.488124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:13.490882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:13.491593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:13.866927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:13.880892 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-963a3539-8e7d-4cf3-b21d-6ac0017086bf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.440125 Oct 10 10:52:13.887424 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1456/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:13 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:13.902363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-plugged", "status": "completed", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:13.936430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:13.936430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:13.936430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:13.966608 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] Creating event network-vif-plugged:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:52:14.001521 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-dd0cc2ad-6cbc-4f56-ab39-e15f9efbba9a req-3834ccea-a634-40c1-b1a0-98e48e5b42d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107200 Oct 10 10:52:14.004921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3d4eadd-b859-44d1-bf0e-a981c12ec6d0 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/52786365-2751-4440-986e-89cd89282faf" status: 202 len: 0 microversion: 2.1 time: 0.771637 Oct 10 10:52:14.005807 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1578/3034] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:13 2022] DELETE /compute/v2.1/os-security-groups/52786365-2751-4440-986e-89cd89282faf => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:14.009620 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1457/3035] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:14.017412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa16390b-d6c1-4beb-9710-c28cbde9120b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778e1ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.025447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.056058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:14.120315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.120918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.121379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.122150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.122601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.127206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.129113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa16390b-d6c1-4beb-9710-c28cbde9120b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.117253 Oct 10 10:52:14.130503 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1579/3036] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:14 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:14.137503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f20e0fb4-041f-4ace-a57c-84cf807ec4b2 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677c0a1ee0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.190865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cec68ebe-c7cd-470b-8788-3f81c3aff392 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179857 Oct 10 10:52:14.192685 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1458/3037] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:14 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:14.254975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.257257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:14.266221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.270320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.270956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.271889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.273812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.274561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.558721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:14.576729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb52470d-969a-421b-93d4-164c8370f201 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1522 microversion: 2.1 time: 0.325689 Oct 10 10:52:14.582115 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1459/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:14 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:14.595654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.596756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:14.639117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.640105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.640768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.642605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.649527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.650308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.660549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f20e0fb4-041f-4ace-a57c-84cf807ec4b2 tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3854ae28-fca7-46fd-adfa-11e8e2da8a66" status: 202 len: 0 microversion: 2.1 time: 0.528549 Oct 10 10:52:14.661428 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1580/3039] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:14 2022] DELETE /compute/v2.1/os-security-groups/3854ae28-fca7-46fd-adfa-11e8e2da8a66 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:14.674712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.686824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:14.704609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.705338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.705998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.706920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.707631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.708474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.939838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:14.955205 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-935d5d2a-0181-414e-8193-a58eeda3073e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1280 microversion: 2.1 time: 0.288445 Oct 10 10:52:14.957014 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1581/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:14 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1280 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:14.962945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:14.963924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:14.982119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.983057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.991036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:14.992786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:14.993426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:14.994198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:15.074407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:15.131613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:15.152809 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00dd1f66-46aa-4ce4-8176-9c93f3f6b28b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.566256 Oct 10 10:52:15.154961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1460/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:14 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:15.169969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-081fa153-9760-4b82-99f7-3a848bb5559d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677d093d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:15.347286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc89dc4d-1d78-4516-8a47-56b3b6552f46 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 204 len: 0 microversion: 2.1 time: 0.387848 Oct 10 10:52:15.350420 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1582/3042] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:14 2022] DELETE /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:15.386971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:15.390663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:15.404172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:15.404684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:15.405212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:15.405819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:15.410700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:15.412407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:15.480545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:16.460102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:16.472615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a084bce-42d6-45d4-af6e-9ec271ae0510 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 1.107967 Oct 10 10:52:16.488496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1583/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:15 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:16.504943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ecf93a2-d37f-465c-ac4f-0d59bc7413c9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778f3040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:16.510827 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-081fa153-9760-4b82-99f7-3a848bb5559d tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/64077e3b-21b3-4a9f-bb62-5e49b3ffc6c9" status: 202 len: 0 microversion: 2.1 time: 1.353183 Oct 10 10:52:16.512173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1461/3044] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:15 2022] DELETE /compute/v2.1/os-security-groups/64077e3b-21b3-4a9f-bb62-5e49b3ffc6c9 => generated 0 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:16.517641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:16.529979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:16.551425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.551954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.553524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:16.554357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.554818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.557611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:16.640539 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ecf93a2-d37f-465c-ac4f-0d59bc7413c9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.149683 Oct 10 10:52:16.642460 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1584/3045] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:16 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:16.657326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:16.665119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:16.681428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:16.687305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.688351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.689039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:16.690922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.694384 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38f60f76-7cfa-436f-a24e-3e457cf9f9a2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180856 Oct 10 10:52:16.694760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.696307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:16.697430 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1462/3046] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:16 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:52:16.705589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:16.706211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:16.718209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.719054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.719680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:16.720879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:16.721526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:16.722133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:17.120749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:17.126617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:17.137621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79206dec-6377-4249-9fa1-5a7d43100ecd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.439126 Oct 10 10:52:17.142056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1463/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:16 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:17.146307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1168d8d-9af7-4b01-89dd-692256c6ebea tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1528 microversion: 2.1 time: 0.501125 Oct 10 10:52:17.149957 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1585/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:16 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1528 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:17.152493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:17.155389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:17.160949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff1b2f09-8517-4ae2-9358-896f1d78bacf tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f6777898e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:17.174632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:17.175496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:17.176148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:17.177709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:17.180825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:17.181683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:17.188087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:17.572786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:17.587162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9425df2-3ce1-4fa0-a172-c62b8bb4fde6 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.439888 Oct 10 10:52:17.587992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1464/3049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:17 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:17.604558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59ac015-f938-495e-af31-5348fcb70118", "name": "network-vif-plugged", "status": "completed", "tag": "c9533809-0005-4d56-b532-2dc456626fa1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:17.624711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:17.625413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:17.626205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:17.657796 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] Creating event network-vif-plugged:c9533809-0005-4d56-b532-2dc456626fa1 for instance f59ac015-f938-495e-af31-5348fcb70118 on n-h2-860687-2 Oct 10 10:52:17.672609 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d5ab1410-b1ab-48e2-accb-8deccaae537b req-53c98655-8886-43e6-929f-45510736bd46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082508 Oct 10 10:52:17.676429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1465/3050] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:17.691061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:17.692187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:17.707884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:17.713354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:17.714298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:17.716553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:17.718576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:17.719212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.169181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:18.183761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9688f4fb-6b74-499f-973a-aa1651a1b86c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.505676 Oct 10 10:52:18.189813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1466/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:17 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:18.211757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca862cd4-f35b-4e87-971e-76e92a5649f1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ca60430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.233392 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff1b2f09-8517-4ae2-9358-896f1d78bacf tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ca5f1686-64f0-41b7-ae3f-115f78a7c08c" status: 202 len: 0 microversion: 2.1 time: 1.081263 Oct 10 10:52:18.234393 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1586/3052] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:17 2022] DELETE /compute/v2.1/os-security-groups/ca5f1686-64f0-41b7-ae3f-115f78a7c08c => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:18.244046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.258640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:18.286632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.287836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.288453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.290134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.291132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.291808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.319278 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca862cd4-f35b-4e87-971e-76e92a5649f1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.124930 Oct 10 10:52:18.323865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1467/3053] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:18 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:18.346020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033ef583-0e0d-431d-956b-c34d688a51fc", "tag": "2a75fd29-9f45-4140-898b-570c3aa1709a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:18.378939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.384017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.384667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.405331 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] Creating event network-changed:2a75fd29-9f45-4140-898b-570c3aa1709a for instance 033ef583-0e0d-431d-956b-c34d688a51fc on n-h2-860687-2 Oct 10 10:52:18.414383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c57864b-b3ae-45eb-8590-c1f2d660ee5f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.176094 Oct 10 10:52:18.415516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1587/3054] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:52:18 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:18.417372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-80e5ccc9-b5f5-463c-a311-f387fbc511e1 req-660485a3-25a4-46aa-a9cd-9034508da2f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092010 Oct 10 10:52:18.421770 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1468/3055] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:18.425449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.427666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:18.431880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.439629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:18.441745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.442926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.444134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.446506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.447896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.448694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.452768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.453272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.453719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.454440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.459258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.460093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.609500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:18.621453 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9937568b-2f75-43ca-ab95-08cfd8e02879 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1486 microversion: 2.1 time: 0.198005 Oct 10 10:52:18.622796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1469/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:18 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1486 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:18.634062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ca467df-7da0-4de8-9f98-7cb9c074798e tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] Calling method '.version_select at 0x7f677d318b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.893206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:18.903829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-88d45af8-123f-46f7-a50b-d02a40c8325d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.486788 Oct 10 10:52:18.904965 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1588/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:18 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:18.910176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:18.910666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:18.919847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.920692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.921367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.922344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:18.923028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:18.923651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:18.967083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:19.063809 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ca467df-7da0-4de8-9f98-7cb9c074798e tempest-SecurityGroupRulesTestJSON-1655158787 tempest-SecurityGroupRulesTestJSON-1655158787-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6d050b3f-2ccb-4838-8f59-b52db99ff797" status: 202 len: 0 microversion: 2.1 time: 0.439067 Oct 10 10:52:19.066519 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1470/3058] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:52:18 2022] DELETE /compute/v2.1/os-security-groups/6d050b3f-2ccb-4838-8f59-b52db99ff797 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:19.077082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:19.079215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:19.109038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.109544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.109989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.113581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.114061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.114494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.174850 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa51eb17-934e-4c13-a98e-fcd0f364c1fd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 204 len: 0 microversion: 2.20 time: 0.266921 Oct 10 10:52:19.179714 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1589/3059] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:52:18 2022] DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:52:19.191214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59ac015-f938-495e-af31-5348fcb70118", "name": "network-vif-deleted", "tag": "c9533809-0005-4d56-b532-2dc456626fa1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:19.212276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.213174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.213974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.229212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] Creating event network-vif-deleted:c9533809-0005-4d56-b532-2dc456626fa1 for instance f59ac015-f938-495e-af31-5348fcb70118 on n-h2-860687-2 Oct 10 10:52:19.234972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7cd942e9-d57c-4d70-9aee-49238787a268 req-f222922c-bc6d-4571-b3f3-aa6d26853d9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049770 Oct 10 10:52:19.236657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1590/3060] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:19.243546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:19.244512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:19.251615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.252774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.253381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.255123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.255988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.257072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.549331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:19.558845 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-087e3825-124c-4f5a-91bc-5f2124310518 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.490930 Oct 10 10:52:19.563557 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1471/3061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:19.582613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:19.583561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:19.600273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.601132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.601576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.602283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.603071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.603661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.624605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:19.635125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:19.641837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:19.646941 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-81806fc4-df9a-473c-8286-65632a1875bb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.408508 Oct 10 10:52:19.649564 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1591/3062] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:19.660820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bf55f3f-3bc6-4546-a75a-ef274115c4bb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777844b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:19.758973 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bf55f3f-3bc6-4546-a75a-ef274115c4bb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.107888 Oct 10 10:52:19.761411 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1592/3063] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:19.768946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:19.769574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:19.787750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.788249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.790883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.791860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:19.792687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:19.794783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:19.976165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:19.994975 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2811f31a-7d69-44c3-8ad1-613f673c62b3 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1486 microversion: 2.1 time: 0.231828 Oct 10 10:52:19.998138 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1593/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:20.009421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:20.011276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:20.030001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.033848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.035136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:20.035902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.036562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.037000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:20.093917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:20.112418 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff95114a-75f5-4079-ab16-245042bfa3cd tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1523 microversion: 2.1 time: 0.545515 Oct 10 10:52:20.115717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1472/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:20.226686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:20.241704 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6eec843-2084-4f16-aaae-6586e6861b92 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.235263 Oct 10 10:52:20.251155 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1594/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:19 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:20.593467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:20.594105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:20.609532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.610311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.611858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:20.613333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.613977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.615182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:20.678559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:20.679694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:20.691877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.695685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.697537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:20.704361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:20.705211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:20.705844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.069565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:21.090059 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4507ab4f-e381-40df-8619-d8d47b495793 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.505517 Oct 10 10:52:21.097408 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1473/3067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:20 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:21.104707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c60143a9-0b06-42d6-8d62-9bb72c37d792 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c4ef790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:21.176852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:21.197979 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c60143a9-0b06-42d6-8d62-9bb72c37d792 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.098161 Oct 10 10:52:21.199389 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1474/3068] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:21 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:21.209824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:21.211966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:21.242845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.243627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.245720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.247835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.248534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.249157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.312808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.313589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.314194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.314843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lazy-loading 'fault' on Instance uuid f59ac015-f938-495e-af31-5348fcb70118 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:21.823868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:21.831954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f076018-7182-44f7-a8f0-cc5b7d2819ce tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 200 len: 1314 microversion: 2.1 time: 0.631292 Oct 10 10:52:21.832536 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1475/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:21 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:21.841419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:21.845081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:21.864568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:21.865895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:21.870317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:21.871619 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a20cd58-1b96-42b1-b925-7d8b6e1f7f16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 1.197476 Oct 10 10:52:21.872197 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1595/3070] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:20 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:52:21.889822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.890613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.891507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.893507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.899357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.899944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:21.900583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.901486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:21.928525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.940025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.941436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:21.944557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:21.945868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:21.951874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:22.650748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:22.771038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:22.787769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bd6f2c5-f863-4f30-89a6-159cae4f6229 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.898627 Oct 10 10:52:22.794431 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1596/3071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:21 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:22.800088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:22.815804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:22.838316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:22.840792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:22.842964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:22.848573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:22.852716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:22.853450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:22.927915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:22.955626 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8adbe91-a2b7-426b-8038-ede16c3656b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1503 microversion: 2.1 time: 1.116671 Oct 10 10:52:22.958914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1476/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:21 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1503 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:22.983826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdc86466-9c19-4cf2-9d96-cd2530314277 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ce8b5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:23.071073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdc86466-9c19-4cf2-9d96-cd2530314277 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.102820 Oct 10 10:52:23.072115 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1477/3073] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:22 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:23.088176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:23.092667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:23.094891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:23.105534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.112056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.112927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.114528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.115244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.115864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.161409 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 HTTP/1.1 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f59ac015-f938-495e-af31-5348fcb70118'} Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:23.165581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:23.170760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:23.176846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:23.178186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-297c9350-e32f-4a44-8536-372d7174af0d tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 404 len: 111 microversion: 2.1 time: 0.104745 Oct 10 10:52:23.182087 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1478/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:23 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:23.193483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:23.194286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:23.215342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.215889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.216588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.217308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.217762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.218180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.420844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:23.515041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:23.537601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44e4ffd2-c9a4-433c-9052-f370d6a8d4a1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.734662 Oct 10 10:52:23.541615 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1597/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:22 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:23.548953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:23.560019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:23.583787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.589806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.592463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.594346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:23.599857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:23.600516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:23.953215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:23.971953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:23.973957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:23.988188 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df012b4f-099b-4263-b5d2-c3d33266be59 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1721 microversion: 2.20 time: 0.803834 Oct 10 10:52:23.989367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1479/3076] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:23 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1721 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:23.999424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1396484372", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:24.122660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:24.130037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] validate_networks() for [('83ac550b-56ca-4869-90c4-64164905ffa9', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:24.134783 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fecc03a9-6079-4c58-8e4d-4245b7f4a8f3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1516 microversion: 2.1 time: 0.590303 Oct 10 10:52:24.155586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1598/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:23 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1516 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:24.170898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:24.171942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:24.185469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.190191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.190970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:24.191975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.192661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.193331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:24.541109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:24.549237 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a11251f3-53e2-4a62-801b-7dd71a9f9103 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.389240 Oct 10 10:52:24.559657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1599/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:24 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:24.571882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38cdc486-c1a9-4290-94c8-10a8b7573a90 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ca48d30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:24.639457 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38cdc486-c1a9-4290-94c8-10a8b7573a90 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.078567 Oct 10 10:52:24.640170 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1600/3079] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:24 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:24.650221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:24.655881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 5551607e-6752-4e8b-8c7f-2f54dca09f4d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:24.681806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/5551607e-6752-4e8b-8c7f-2f54dca09f4d/action HTTP/1.1 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 14 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: {"rescue": {}} Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '5551607e-6752-4e8b-8c7f-2f54dca09f4d', 'body': {'rescue': {}}} Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:24.695709 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. Oct 10 10:52:24.700520 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:24.701985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 404 to user: Instance 5551607e-6752-4e8b-8c7f-2f54dca09f4d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:24.703142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0164dbda-aa2f-4bca-aa76-d19ffaac9b60 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/5551607e-6752-4e8b-8c7f-2f54dca09f4d/action" status: 404 len: 111 microversion: 2.1 time: 0.062032 Oct 10 10:52:24.703938 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1601/3080] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:24 2022] POST /compute/v2.1/servers/5551607e-6752-4e8b-8c7f-2f54dca09f4d/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:24.714461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:24.717516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:24.732034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.733694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.734776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:24.744085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.744584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.745032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:24.919387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:24.927284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27416e34-72f4-4e69-879c-bc39b2260b24 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 0.222061 Oct 10 10:52:24.935280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1602/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:24 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:24.940280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:24.941038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:24.955440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.956387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.957008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:24.957933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:24.963753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:24.964537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.062203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:25.091835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec10e626-5913-4b50-ba9d-efbe5e97671f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action" status: 202 len: 0 microversion: 2.1 time: 0.154515 Oct 10 10:52:25.093196 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1603/3082] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:24 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:25.099341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:25.100416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:25.108501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.109334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.110275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.111448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.112195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.112896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.317817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:25.333152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:25.338172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:25.341905 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11154398-769c-454c-a712-c88d52267713 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1653 microversion: 2.20 time: 0.245611 Oct 10 10:52:25.343330 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1604/3083] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:25 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1653 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:25.369721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:25.370819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:25.406152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.407055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.408011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.408773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.411764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.412226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.479416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:25.479896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:25.480305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:25.480933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:25.481532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:25.497623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.502730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.504577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.507304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.507932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.511057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.566415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:25.577772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Getting quotas for user 42455b03876445a8851d343d88b72953 and project b24ce776c5874bd4b87760c3954fc50f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:25.608744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:25.622126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:25.729201 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56f8f082-b1c8-4a5f-8e92-89a7b7fb5758 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.737493 Oct 10 10:52:25.743589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1480/3084] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:52:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:52:25.754108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033ef583-0e0d-431d-956b-c34d688a51fc", "name": "network-vif-plugged", "status": "completed", "tag": "2a75fd29-9f45-4140-898b-570c3aa1709a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:25.780553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:25.783020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.783729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.785524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.789140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22264d58-a318-41e0-9066-4d1bbb1216dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1501 microversion: 2.1 time: 0.444751 Oct 10 10:52:25.789825 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1605/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:25 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:25.798941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:25.799795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:25.809582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.810080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.811958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.812912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:25.813624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:25.814164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:25.823607 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] Creating event network-vif-plugged:2a75fd29-9f45-4140-898b-570c3aa1709a for instance 033ef583-0e0d-431d-956b-c34d688a51fc on n-h2-860687-2 Oct 10 10:52:25.859569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ce907ecf-9dc0-4acd-b238-be9b14b32b94 req-66d63e92-5806-4ec3-bd15-9010f19972bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100906 Oct 10 10:52:25.865706 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1481/3086] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:25.900907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29793b1a-02d5-4133-8cb0-d54a56ea61b8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c5485e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:26.017409 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29793b1a-02d5-4133-8cb0-d54a56ea61b8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.140963 Oct 10 10:52:26.021679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1482/3087] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:25 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:26.040037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e6764da-caf6-44fd-91f6-6294ff0b3120 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:26.044408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e6764da-caf6-44fd-91f6-6294ff0b3120 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:26.286179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e6764da-caf6-44fd-91f6-6294ff0b3120 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:26.332102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e6764da-caf6-44fd-91f6-6294ff0b3120 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1225 microversion: 2.1 time: 0.306270 Oct 10 10:52:26.333889 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1483/3088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:26 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1225 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:26.344441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:26.360901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:26.378742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.383236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.385879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:26.389853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.391892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.393250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:26.499104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'flavor' on Instance uuid b69e5873-8bb0-495a-80c8-ce1b71859e61 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:26.549575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Cannot 'rescue' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state paused Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action HTTP/1.1 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 14 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: {"rescue": {}} Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'rescue' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state paused Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b69e5873-8bb0-495a-80c8-ce1b71859e61', 'body': {'rescue': {}}} Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 in vm_state paused. Cannot rescue while the instance is in this state. Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state paused Oct 10 10:52:26.557826 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state paused Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:26.562419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 409 to user: Cannot 'rescue' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state paused {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:26.565274 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aea632d4-ca58-41c7-9e14-971b0e649c3f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action" status: 409 len: 144 microversion: 2.1 time: 0.228475 Oct 10 10:52:26.568950 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1484/3089] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:26 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action => generated 144 bytes in 234 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:52:26.599090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:26.599842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:26.613968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.615852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.617045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:26.620693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.622378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.624614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:26.882427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:26.891890 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bd30392-fe1f-459a-9d24-db5bd8353468 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 1.100981 Oct 10 10:52:26.911243 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1606/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:25 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:26.938727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:26.941784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:26.980287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.981255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.982019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:26.983316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:26.984361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:26.985388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.033562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.034551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.035298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.036620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'fault' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:27.681768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:27.695044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:27.696697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:27.698103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7552b87-82b6-49d7-a368-389e4b415ea4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1370 microversion: 2.20 time: 0.781637 Oct 10 10:52:27.700420 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1607/3091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:26 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1370 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:27.713499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:27.714288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:27.724565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.725289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.726555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.727730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.728542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.729122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.778583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:27.787029 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79b628e0-380e-4260-a7ac-f97e29567fb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1515 microversion: 2.1 time: 1.216821 Oct 10 10:52:27.787628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1485/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:26 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1515 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:27.813784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3336aaa7-7f97-4985-8589-74926d3df687", "name": "network-vif-deleted", "tag": "59ded25d-4146-49d9-93b4-edc3fdfa9064"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:27.844053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.844536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.844966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.877163 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] Creating event network-vif-deleted:59ded25d-4146-49d9-93b4-edc3fdfa9064 for instance 3336aaa7-7f97-4985-8589-74926d3df687 on n-h2-860687-2 Oct 10 10:52:27.890686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-79701bb1-ceef-468c-a086-6ce9746f3d2d req-8fe8318e-4a80-43ee-a16a-84d8f297a029 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101842 Oct 10 10:52:27.891867 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1486/3093] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:27.903857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-768bc948-30e6-44e0-bddf-9b21c721b7a6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677d2548b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:27.908050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1c3d28a-30ef-4417-a71d-5f75d2a3c8d5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action" status: 202 len: 0 microversion: 2.1 time: 0.203146 Oct 10 10:52:27.911255 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1608/3094] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:27 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:27.918849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:27.925958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:27.934863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.935642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.939430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:27.940762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:27.941440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:27.942028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.000048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-768bc948-30e6-44e0-bddf-9b21c721b7a6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.104583 Oct 10 10:52:28.001503 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1487/3095] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:27 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:28.008895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:28.009979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:28.017135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.017836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.018513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.019448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.020058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.020631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.046586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:28.057195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d973dabb-c769-492c-994a-c50fdd3df7d7 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1277 microversion: 2.1 time: 0.144531 Oct 10 10:52:28.058703 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1609/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:27 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:28.067308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:28.071685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:28.087353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.088370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.088979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.089860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.090485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.091177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.731724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:28.759968 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c5b2e73-b7d1-42de-9de4-e76d5f15b18c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1328 microversion: 2.1 time: 0.694396 Oct 10 10:52:28.765752 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1610/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:28 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1328 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:28.781384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:28.784558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:28.855154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.856400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.860386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.861429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.862520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.863214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.983467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:28.986459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:28.987300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:28.988318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'fault' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:29.246253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.260041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.267472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.279456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.279938 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ba22b46-4eba-4a1f-a284-732fddd42349 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1508 microversion: 2.1 time: 1.274513 Oct 10 10:52:29.281206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24a3169e-d087-4d19-a86b-d5b19ab23900 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1370 microversion: 2.20 time: 0.514297 Oct 10 10:52:29.281842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1611/3098] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:28 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:29.296986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:29.297836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:29.312834 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1488/3099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:28 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1508 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:29.314918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.318824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.319360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.320936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.321590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.322025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.386379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c8257bd-ef1e-4777-a400-09d3fd6929ea tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c9a9700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:29.495999 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c8257bd-ef1e-4777-a400-09d3fd6929ea tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.181940 Oct 10 10:52:29.496745 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1489/3100] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:29 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:29.510923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:29.519090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:29.531390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.532349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.533166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.536499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.538289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.539715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.817690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.828594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4877e679-77f5-4b1c-9369-fe525fee174f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1283 microversion: 2.1 time: 0.328049 Oct 10 10:52:29.831281 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1490/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:29 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1283 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:29.844707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:29.846360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:29.862156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.863883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.864315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.870096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:29.870862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:29.871484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:29.890912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:29.911505 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d20cce19-e6c7-4d7e-8772-f7447749388a tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1533 microversion: 2.1 time: 0.628633 Oct 10 10:52:29.913029 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1612/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:29 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1533 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:30.126061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:30.138808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c273394-f7de-4088-8956-61e669f15dd4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1509 microversion: 2.1 time: 0.306076 Oct 10 10:52:30.141395 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1491/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:29 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:30.168141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.172014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:30.184295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.201576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.202129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.202779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.203345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.203694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.311285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.312529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:30.323745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.324516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.325284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.326894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.331486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.332177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.386164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:30.434455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.441234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.441892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.442698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'fault' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:30.527775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:30.555499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:30.567225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:30.573848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:30.574597 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88aec9e7-7bbf-417e-bce9-da0c9f3cc200 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1370 microversion: 2.20 time: 0.265572 Oct 10 10:52:30.587373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1492/3104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:30 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:30.587373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.587373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:30.597121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.598225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.598746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.599843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.600868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.601528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.602565 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-190a3a67-47a4-4c3c-b590-893e0b468018 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1509 microversion: 2.1 time: 0.439659 Oct 10 10:52:30.611337 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1613/3105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:30 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:30.622254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8024f7dd-5df0-4013-9e75-cf462b1e2c76 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6780d36700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.712011 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8024f7dd-5df0-4013-9e75-cf462b1e2c76 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.105549 Oct 10 10:52:30.712802 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1614/3106] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:30 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:30.720729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.726525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:30.737203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.737920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.738732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.739726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.744731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.745604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.782447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:30.886188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-746de2ba-1650-4dbe-bdf7-584f8404ea39 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 204 len: 0 microversion: 2.1 time: 0.171863 Oct 10 10:52:30.886871 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1615/3107] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:30 2022] DELETE /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:30.894965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:30.895807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:30.903464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.904413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.905032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:30.906300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:30.906967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:30.907587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.026442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.039519 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-99d7b0ed-c0d9-4551-ac58-38afa0fd57eb tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1283 microversion: 2.1 time: 0.150444 Oct 10 10:52:31.041941 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1616/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:30 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:31.083463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:31.084344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:31.107776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.109302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.110024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.110897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.111540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.112161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.150099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:31.180962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.197247 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6220425-fdb2-45c2-9f88-9af51a8e3f14 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1516 microversion: 2.1 time: 0.620249 Oct 10 10:52:31.197885 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1493/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:30 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1516 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:31.242335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:31.251322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:31.280332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.281504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.283345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.284727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.285938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.292118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.332261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.348637 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b7f260d-451d-4c0a-a9dd-1044b74276e7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1515 microversion: 2.1 time: 0.284172 Oct 10 10:52:31.349626 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1617/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:31 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:31.604437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:31.605070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:31.622667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.623670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.624264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.625037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.625485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.625919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.629504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.639634 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8c1e955-0652-4d6c-994c-901432cd19ce tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1521 microversion: 2.1 time: 0.417308 Oct 10 10:52:31.640222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1494/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:31 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:31.718460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:31.719182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:31.719623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:31.720146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'fault' on Instance uuid 3336aaa7-7f97-4985-8589-74926d3df687 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:31.728822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c53a843-629d-4e57-bf6b-3066095c12c2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c44e160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:31.843210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.860285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.869514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:31.872128 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c53a843-629d-4e57-bf6b-3066095c12c2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.147560 Oct 10 10:52:31.872579 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1495/3112] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:31 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:31.879464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2ffffa0-2121-43b4-8b23-aab347d2aaa9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 200 len: 1370 microversion: 2.20 time: 0.270922 Oct 10 10:52:31.901844 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1618/3113] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:31 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:52:32.067594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:32.068273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:32.085611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.086246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.086785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:32.087571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.088113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.088579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:32.374911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:32.377384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:32.392266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.393230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.403548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:32.405145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.405869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.406489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:32.721612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:32.734946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b9231cd-8a58-4bf1-b864-c6991483dc1e tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.666482 Oct 10 10:52:32.735726 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1496/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:32 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:32.753314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:32.753989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:32.776763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.777403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.779198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:32.780022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:32.781384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:32.782568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.157437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:33.174516 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d6572a9-f4d6-4057-a569-da6fbd80cf96 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1515 microversion: 2.1 time: 0.802947 Oct 10 10:52:33.182447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1619/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:32 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1515 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:52:33.200579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d3eeed5-2d3e-4d5b-9a3a-dbade8a7c8bf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67779ae550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:33.278882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d3eeed5-2d3e-4d5b-9a3a-dbade8a7c8bf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.094854 Oct 10 10:52:33.284082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1620/3116] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:33 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:33.299941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:33.301098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:33.317967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:33.318540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:33.322983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.326607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:33.330048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:33.333564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.404170 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 HTTP/1.1 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3336aaa7-7f97-4985-8589-74926d3df687'} Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:33.406259 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:33.411157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0fc7932-b068-4c2f-8c83-2858bf9e6940 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 404 len: 111 microversion: 2.20 time: 0.122476 Oct 10 10:52:33.419401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1621/3117] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:33 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:52:33.436917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b0ebb19-3359-498f-8de7-a6e77f69a338 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '.version_select at 0x7f67778e15e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:33.488636 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b0ebb19-3359-498f-8de7-a6e77f69a338 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-580224880" status: 204 len: 0 microversion: 2.20 time: 0.067457 Oct 10 10:52:33.490808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1622/3118] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Oct 10 10:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-580224880 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:52:33.659829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db26c176-1196-40eb-b7d7-70833826274c", "name": "network-vif-unplugged", "status": "completed", "tag": "8078630b-fccc-4706-9e28-798783f3f178"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:33.687610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:33.688769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:33.689061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.709908 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] Creating event network-vif-unplugged:8078630b-fccc-4706-9e28-798783f3f178 for instance db26c176-1196-40eb-b7d7-70833826274c on n-h2-860687-2 Oct 10 10:52:33.724024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c7fc0194-3db3-4655-8b92-77b1b5b6d57d req-49813833-9c59-46b8-9f12-4d6c3014b364 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070024 Oct 10 10:52:33.732219 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1623/3119] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:33.766410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:33.767280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:33.785637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:33.786146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:33.786590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.787336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:33.787794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:33.788426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:33.861711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:33.874349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2913d59-92b6-4683-ad19-5b61adc2d45c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1521 microversion: 2.1 time: 1.137496 Oct 10 10:52:33.892504 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1497/3120] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:32 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1521 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:34.154222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:34.160587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:34.187885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.190147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.190677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.192830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.197919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.200556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.253500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'flavor' on Instance uuid b69e5873-8bb0-495a-80c8-ce1b71859e61 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:34.410844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:34.420215 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6bd5b0d3-b60e-4a26-9199-9c339d058e40 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.658088 Oct 10 10:52:34.434639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1624/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:33 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:52:34.448871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:34.465371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:34.476626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.476964 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b8b19a5-a487-466a-9e6e-a505509050b8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action" status: 200 len: 32 microversion: 2.1 time: 0.327711 Oct 10 10:52:34.477538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.477988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.478692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.481250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.482202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.483532 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1498/3122] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:34 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 10:52:34.489737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5cdaf1a-42ba-405c-93f3-a05d1b62b37c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cf0e9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:34.552013 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5cdaf1a-42ba-405c-93f3-a05d1b62b37c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.066911 Oct 10 10:52:34.553070 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1499/3123] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:34 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:34.559642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:34.560709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:34.574769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.575670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.576386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.577386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.578128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.578992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.685553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:34.703142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1c1108c-1b50-49aa-986a-2c3f8fadb04a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 200 len: 1473 microversion: 2.1 time: 0.267040 Oct 10 10:52:34.703820 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1625/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:34 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:34.904616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:34.905524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:34.914510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.915034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.931803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:34.935984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:34.936697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:34.939461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:35.402287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:35.431479 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fffb71b-3f48-41a3-a297-e55fef67582e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.874189 Oct 10 10:52:35.433525 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1500/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:34 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:35.536775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:35.658146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033ef583-0e0d-431d-956b-c34d688a51fc", "name": "network-vif-deleted", "tag": "2a75fd29-9f45-4140-898b-570c3aa1709a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:35.676341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:35.676689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:35.677039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:35.698437 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] Creating event network-vif-deleted:2a75fd29-9f45-4140-898b-570c3aa1709a for instance 033ef583-0e0d-431d-956b-c34d688a51fc on n-h2-860687-2 Oct 10 10:52:35.717804 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1ef1ec3d-c178-47bd-96dd-b0dd2de45648 req-f339fcdb-2632-4b87-a92d-4664c20ac866 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261128 Oct 10 10:52:35.719160 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1501/3126] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:35.729303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:35.735605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:35.748062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:35.751119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:35.755480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:35.756592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:35.757870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:35.758571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:35.775468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:35.815030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2ddea11-8e7c-4e4b-b4ab-ced581a5b3d7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1521 microversion: 2.1 time: 0.895413 Oct 10 10:52:35.815868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1626/3127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:34 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1521 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:35.852911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e77952e9-bd72-44cf-a538-066fd591d7a2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778bfb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:36.010784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e77952e9-bd72-44cf-a538-066fd591d7a2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.170645 Oct 10 10:52:36.011675 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1627/3128] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:35 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:36.044801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:36.045509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:36.085532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:36.097385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:36.104711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:36.110823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:36.111623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:36.112123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:36.115200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:36.127708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fb1c4df-5b8f-4e40-aa8e-7f08e6c6a11c tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.406913 Oct 10 10:52:36.128975 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1502/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:35 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:36.140695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db26c176-1196-40eb-b7d7-70833826274c", "name": "network-vif-plugged", "status": "completed", "tag": "8078630b-fccc-4706-9e28-798783f3f178"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:36.176535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:36.177026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:36.177463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:36.192526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc HTTP/1.1 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '033ef583-0e0d-431d-956b-c34d688a51fc'} Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:36.198927 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:52:36.203936 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:52:36.206963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:36.208043 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f13dad2-d5ab-4dad-9f68-40c454071c3b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 404 len: 111 microversion: 2.1 time: 0.192085 Oct 10 10:52:36.212694 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1628/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:36 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:36.224971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00e26b1c-2e06-4b4d-b941-e42936b07947 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: .version_select at 0x7f677787a4c0>, body: {"keypair": {"name": "tempest-keypair-968833037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGatUdo3DgNBQOso7g2OvwMQ/YRw6Ov4C/TbytOVn4mkkSDHzmhS/YwQaD7VN6i2WhvslOxyYHOKsau4E1D6GqnwCEE4B8kmDQJWODVPjePlC0FWx571OTBy0mbbTP1g5Q=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:36.226961 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] Creating event network-vif-plugged:8078630b-fccc-4706-9e28-798783f3f178 for instance db26c176-1196-40eb-b7d7-70833826274c on n-h2-860687-2 Oct 10 10:52:36.240122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9992ec94-42ce-432a-b492-7d97d44c1f61 req-7e2fb2c9-79a6-4650-82a7-359f3089179a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108799 Oct 10 10:52:36.242778 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1503/3131] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:36.257364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35604f57-a181-41a8-a4bd-54292a02eae4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '.version_select at 0x7f677c2bbb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:36.270976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-00e26b1c-2e06-4b4d-b941-e42936b07947 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for project 42e1556caa994a6e9b322c4da89dd453. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:36.278309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:36.305969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-00e26b1c-2e06-4b4d-b941-e42936b07947 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for user f4ea69b8d1c14356a46d3d1db32e0456 and project 42e1556caa994a6e9b322c4da89dd453. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:36.306570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:36.318366 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35604f57-a181-41a8-a4bd-54292a02eae4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1448111556" status: 202 len: 0 microversion: 2.1 time: 0.071829 Oct 10 10:52:36.322810 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1504/3132] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Oct 10 10:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1448111556 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:36.414726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00e26b1c-2e06-4b4d-b941-e42936b07947 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.200523 Oct 10 10:52:36.418892 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1629/3133] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:52:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:52:36.461056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:36.461930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:36.481737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:36.485588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:36.486114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:36.488778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:36.490773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:36.491847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:36.626635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2005444844", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:36.756525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:37.956641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:37.968644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c781c618-9eb9-4cda-82f9-27a9f22ca37f tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 1.511938 Oct 10 10:52:37.972019 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1505/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:36 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:37.985437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:37.986028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:37.997320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:37.998290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.000188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.001434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.002492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.003946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.529614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:38.545956 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c91727e-3d14-4c0d-83b2-fff984f9a168 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1506 microversion: 2.1 time: 0.572191 Oct 10 10:52:38.547205 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1506/3135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:37 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:38.553204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27442e5f-eb59-42a8-8cbf-d52b863cd622 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c2bb4c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:38.632459 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27442e5f-eb59-42a8-8cbf-d52b863cd622 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1454 microversion: 2.1 time: 0.083947 Oct 10 10:52:38.635143 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1507/3136] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:38 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:38.655946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:38.660839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:38.681287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.681801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.682242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.682957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.687879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.691091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.725671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:38.726667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:38.727516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:38.728097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:38.729221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:38.753309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.754533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.755207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.757425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.758690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.761139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:38.792393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:38.806303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:38.844590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:38.849862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:38.906984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:38.919617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-296cdb53-2772-4b57-b4e4-79a9a4db9f29 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.275558 Oct 10 10:52:38.935039 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1508/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:38 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:38.935039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79078f2d-ec37-4b1d-9080-22aed0df1694", "tag": "effaa7f9-69a5-4e31-98ca-85f5f90c2b66"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:38.976876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:38.977526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:38.977944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:39.016220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0c33b62-016f-43ee-8677-41e7acd10783 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394558 Oct 10 10:52:39.027157 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] Creating event network-changed:effaa7f9-69a5-4e31-98ca-85f5f90c2b66 for instance 79078f2d-ec37-4b1d-9080-22aed0df1694 on n-h1-860687-2 Oct 10 10:52:39.034105 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1630/3138] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:52:39.044896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:39.045369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:39.059565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-84a24fbe-011b-4dea-85aa-f14d9acd463f req-c0f062a1-8bc9-459a-9774-a669bd759ed1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131954 Oct 10 10:52:39.075213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:39.079905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:39.080393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1509/3139] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:39.083849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:39.086776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:39.093578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:39.094289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:39.099536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:39.108346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:39.123081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:39.128914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:39.135205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:39.137009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:39.139181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:39.139796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:39.737018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:39.782916 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e32f70cb-5766-4de5-9aef-f25bcf0baa97 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 200 len: 1506 microversion: 2.1 time: 0.743067 Oct 10 10:52:39.810099 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1631/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:39 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:39.816150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03f4dc2d-4a99-4d77-bb64-6e2f6125c812 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:39.817736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03f4dc2d-4a99-4d77-bb64-6e2f6125c812 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:39.941067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:39.952413 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a19ac66e-f46a-4293-9110-7a4acb8f5276 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.867671 Oct 10 10:52:39.954989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1510/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:39 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:39.967360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62152fc3-441f-41f5-8d00-849e3b48a2b3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ce34d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:40.002546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03f4dc2d-4a99-4d77-bb64-6e2f6125c812 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:40.016657 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03f4dc2d-4a99-4d77-bb64-6e2f6125c812 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1209 microversion: 2.1 time: 0.205241 Oct 10 10:52:40.017847 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1632/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:39 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:40.031512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:40.033470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:40.048340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.050516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.051628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.053197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.056089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.056782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.095154 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62152fc3-441f-41f5-8d00-849e3b48a2b3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1463 microversion: 2.1 time: 0.135887 Oct 10 10:52:40.096520 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1511/3143] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:39 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:40.123953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:40.126810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:40.146509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:40.152612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.153423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.155542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.157680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.161368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.163700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.311398 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d469f24b-cae0-437b-a98b-3cb8c1bba76d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 204 len: 0 microversion: 2.1 time: 0.291755 Oct 10 10:52:40.312086 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1633/3144] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:40 2022] DELETE /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:40.327588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd87cc03-a519-4999-a149-61485cdc8e75 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6780cc45e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:40.465448 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd87cc03-a519-4999-a149-61485cdc8e75 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 200 len: 1463 microversion: 2.1 time: 0.145622 Oct 10 10:52:40.477202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1634/3145] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:40 2022] GET /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:40.488143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:40.489773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:40.498763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.499736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.500596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.501706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.502374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.503375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.696392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:40.706403 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f825cb0-18b3-444f-994b-822d2877f42b tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.605713 Oct 10 10:52:40.717341 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1512/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:40 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:40.743425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-213177836", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "83b4380d-603f-4590-b49d-99b71035f3ea"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:40.791348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:40.805133 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc9f8b65-bf38-4c0f-aa2c-d53b93381ad3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1466 microversion: 2.1 time: 0.324520 Oct 10 10:52:40.808691 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1635/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:40 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1466 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:40.831460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1776074960"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:40.834574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:40.836342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] validate_networks() for [('83b4380d-603f-4590-b49d-99b71035f3ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:40.844158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.844939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.845604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:40.846530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:40.847473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:40.848085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.231848 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c53595c-b858-4b77-9224-1e02982069b5 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "POST /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903/action" status: 202 len: 0 microversion: 2.1 time: 0.404132 Oct 10 10:52:41.241554 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1636/3148] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:40 2022] POST /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 10 10:52:41.250419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:41.254267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:41.292727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.296326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.298583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.301034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.302334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.308677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.881639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:41.898191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28ddada9-f743-4d9e-bcf0-bc6f75e737ce tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.658535 Oct 10 10:52:41.898827 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1637/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:41 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:41.907263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:41.908168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:41.935408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.936226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.936881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.938123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.938854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.939463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.941345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:41.941840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:41.942246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:41.942662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:41.945684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:41.967683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.968258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.968708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:41.973167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:41.973886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:41.974474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:42.049784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:42.059200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for user 129b6fe8d95645568c521e13faa798c2 and project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:42.081545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:42.087630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:42.098869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:42.102556 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef26034a-bcb3-4ed2-836d-958b06b834d3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1261 microversion: 2.1 time: 0.201356 Oct 10 10:52:42.103220 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1638/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:41 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:42.127916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7db4c326-db9d-493b-97f0-c6bb125e6f53 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778523a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:42.205027 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7db4c326-db9d-493b-97f0-c6bb125e6f53 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.081596 Oct 10 10:52:42.206607 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1639/3151] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:42 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:42.221185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-25283058", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d3a7b62-8c84-4abe-b3b5-946ae78094eb"}], "security_groups": [{"name": "tempest-securitygroup--899106998"}], "key_name": "tempest-keypair-968833037", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:42.264015 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d1d2d6b-0d86-4f6c-bfe8-8d283d172d20 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543921 Oct 10 10:52:42.265284 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1513/3152] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:52:42.270880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:42.271893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:42.283131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:42.283987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:42.284601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:42.285645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:42.286272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:42.288391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:42.329774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:42.774117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] validate_networks() for [('2d3a7b62-8c84-4abe-b3b5-946ae78094eb', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:42.815836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:42.829335 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e0cfcaf-dd1c-4720-b756-0e0dcc22c7e9 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.559941 Oct 10 10:52:42.846787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1514/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:42 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:42.846787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02ce697a-6205-4c60-b0bf-ee012b3cf27e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:42.846787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02ce697a-6205-4c60-b0bf-ee012b3cf27e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:42.991721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02ce697a-6205-4c60-b0bf-ee012b3cf27e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:43.003911 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02ce697a-6205-4c60-b0bf-ee012b3cf27e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1217 microversion: 2.1 time: 0.165991 Oct 10 10:52:43.007730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1515/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:42 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:43.014158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:43.021871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:43.036640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:43.037687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:43.038502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:43.039536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:43.040249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:43.041411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:43.520563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:43.531444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e941818e-332b-48d9-ac74-a3da95c4aaea tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.521494 Oct 10 10:52:43.535124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1516/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:43 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:43.548354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:43.549104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:43.551238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:43.565483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:43.566097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:43.566831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:43.567815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:43.575955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:43.576847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:43.753900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:43.764857 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e6c3cab-771c-4be1-9044-8db35f2d5473 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1267 microversion: 2.1 time: 0.228460 Oct 10 10:52:43.772899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1517/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:43 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:43.811203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26662ee6-46d3-4958-8a1b-89bfd07c46c9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c963d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:43.913794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26662ee6-46d3-4958-8a1b-89bfd07c46c9 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.139096 Oct 10 10:52:43.914675 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1518/3157] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:43 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:43.925750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db26c176-1196-40eb-b7d7-70833826274c", "name": "network-vif-deleted", "tag": "8078630b-fccc-4706-9e28-798783f3f178"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:43.951914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:43.952764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:43.953500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:43.987821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] Creating event network-vif-deleted:8078630b-fccc-4706-9e28-798783f3f178 for instance db26c176-1196-40eb-b7d7-70833826274c on n-h2-860687-2 Oct 10 10:52:43.996576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-519845ee-d4a3-4756-bdcd-ad88c70352f1 req-2ac41960-7cbf-4d51-a6ae-0bb6887b7c68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076030 Oct 10 10:52:44.003805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1519/3158] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:44.014427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:44.015463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:44.032028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.032695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.033377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.034246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.034861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.035486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.604782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:44.605343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:44.605749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:44.606268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:44.606683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:44.619484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.620290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.620996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.621920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.622684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.623359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.664247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for project 42e1556caa994a6e9b322c4da89dd453. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:44.672212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Getting quotas for user f4ea69b8d1c14356a46d3d1db32e0456 and project 42e1556caa994a6e9b322c4da89dd453. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:44.688955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:44.691709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:44.815822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1bfc009-8154-435f-a810-1ee0c3cf8715 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.607396 Oct 10 10:52:44.816767 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1640/3159] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:52:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 2610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:52:44.821611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:44.831987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:44.846732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.847286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.847733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.848463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:44.849008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:44.849354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:44.873642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:45.040500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.059585 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48fbddd3-6db1-4892-b0aa-4da8ef5fb7ac tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 1.048068 Oct 10 10:52:45.060324 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1520/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:44 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:45.071867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:45.074734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:45.077590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.093482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be7f5bf4-129a-4204-9d4b-08f9b79d433c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1275 microversion: 2.1 time: 0.275437 Oct 10 10:52:45.100919 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1641/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:44 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:45.108276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:45.121030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:45.136370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:45.138479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:45.140615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:45.141392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:45.141872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:45.142306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:45.145708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:45.151954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:45.152907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:45.153830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:45.156083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:45.167854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:45.711371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.724581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.729024 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acfa8845-90c7-4b6b-bd75-cb61ee12d730 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.665875 Oct 10 10:52:45.730746 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1521/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:45 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:45.736547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b3425979-a047-4315-99ae-94167b1c4c0f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 0.634311 Oct 10 10:52:45.739316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1642/3163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:45 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:45.747615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a77221f-baf1-4584-816d-8b23206059d8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777898e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:45.760330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:45.761280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:45.862102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a77221f-baf1-4584-816d-8b23206059d8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.118618 Oct 10 10:52:45.872178 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1643/3164] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:45 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:45.879945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79078f2d-ec37-4b1d-9080-22aed0df1694", "name": "network-vif-plugged", "status": "completed", "tag": "effaa7f9-69a5-4e31-98ca-85f5f90c2b66"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:45.894257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:45.895171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:45.895881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:45.904853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.911283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] Creating event network-vif-plugged:effaa7f9-69a5-4e31-98ca-85f5f90c2b66 for instance 79078f2d-ec37-4b1d-9080-22aed0df1694 on n-h1-860687-2 Oct 10 10:52:45.919481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.920663 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ccd6e680-d70b-4918-95ca-36765d66ae55 req-1e77f9c7-fb01-4978-a867-34776279a8e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046069 Oct 10 10:52:45.921358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:45.922606 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1644/3165] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:45.924447 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b765be5-8969-4f4b-8e53-56062697d018 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1279 microversion: 2.20 time: 0.191830 Oct 10 10:52:45.925620 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1522/3166] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:45 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:46.098973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:46.109584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:46.126802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:46.128033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:46.143150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.145517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.146709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:46.153566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.154800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.170216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:46.171707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.172416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.172884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:46.176501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.177318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.181838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:46.698057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:46.710293 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe745e79-71fb-4a8f-90ec-3882a44b6506 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1275 microversion: 2.1 time: 0.584216 Oct 10 10:52:46.714106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1523/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:46 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1275 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:46.763212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:46.764002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:46.774397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.775562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.776010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:46.776735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:46.779627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:46.780091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:47.409322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:47.432118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b5e7fd7-2397-48ee-a4cc-d1242aab9ac8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 1.336709 Oct 10 10:52:47.433002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1645/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:46 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:47.444574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:47.448854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:47.454500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:47.463830 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-577395e3-4843-4b56-8ae6-324e4b669c4e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.707836 Oct 10 10:52:47.486576 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1524/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:46 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:47.497485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:47.500162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb7f19a7-fe2d-428e-b118-4669f62fe4bf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c2bb940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:47.504477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:47.505790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:47.511945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:47.514479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:47.520875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:47.613932 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb7f19a7-fe2d-428e-b118-4669f62fe4bf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.125886 Oct 10 10:52:47.614606 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1525/3170] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:47 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:47.622836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:47.627436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:47.640893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:47.648210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:47.649222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:47.650202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:47.650892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:47.651572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:47.918795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:47.932691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:47.934446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:47.936865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29faa06c-95ed-45ed-8df5-460947578e8d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1337 microversion: 2.20 time: 0.321022 Oct 10 10:52:47.942254 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1526/3171] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:47 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1337 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:48.088918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:48.100399 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f39e9b42-d4c4-45d7-ade9-cd5bf007b0cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 0.665539 Oct 10 10:52:48.111206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1646/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:47 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:48.118349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:48.119349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:48.133545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.134357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.138139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:48.139185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.139868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.141057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:48.377457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:48.392572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14a7e953-9d36-425c-9414-d394361a9861 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.279730 Oct 10 10:52:48.394310 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1647/3173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:48 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:48.405457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-unplugged", "status": "completed", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}, {"server_uuid": "ea1cae6d-cdab-4da1-a40e-76f423f50903", "name": "network-vif-plugged", "status": "completed", "tag": "3fb3eec8-ee22-422c-ae0a-de4cac573f82"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:48.432038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.433410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.435051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:48.468224 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Creating event network-vif-unplugged:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:52:48.469091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] Creating event network-vif-plugged:3fb3eec8-ee22-422c-ae0a-de4cac573f82 for instance ea1cae6d-cdab-4da1-a40e-76f423f50903 on n-h1-860687-2 Oct 10 10:52:48.480482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f874a879-5a72-409c-a1e6-9d1d8d0a3ef7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f677c30b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1642396233", "description": "tempest-description-96408566"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:48.491473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-252dad78-3111-4dad-9f3e-ec6a65bc3817 req-28062356-2eea-4dc3-86ea-c8164bbd18a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.089984 Oct 10 10:52:48.503559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1648/3174] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:48.521672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fac89db-b9ce-4b1e-965a-2e3e3641b01d", "tag": "8d39a1e0-8fef-495f-a172-9e07645f2bc2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:48.550638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.556017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.556951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:48.579509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] Creating event network-changed:8d39a1e0-8fef-495f-a172-9e07645f2bc2 for instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d on n-h2-860687-2 Oct 10 10:52:48.593560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c43e88e7-2c33-4808-baf5-5ea45e875690 req-0d94b4ed-e24d-4dd5-abcb-90cb399bc646 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087039 Oct 10 10:52:48.595279 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1649/3175] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:48.607760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:48.609793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:48.627442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.629915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.636152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:48.637703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:48.639573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:48.640069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:49.392618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:49.404602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-525be78e-af7d-4756-8527-05d4341418dc tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1325 microversion: 2.1 time: 0.806712 Oct 10 10:52:49.414322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1650/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:48 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1325 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:49.419814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:49.428051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:49.445377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:49.451436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:49.452397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:49.455566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:49.456291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:49.459595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:49.698884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f874a879-5a72-409c-a1e6-9d1d8d0a3ef7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.755226 Oct 10 10:52:49.699765 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1527/3177] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:49.712056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9f997aa-6c3f-403c-bd4e-062db1fc818a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677e382ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:49.819388 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9f997aa-6c3f-403c-bd4e-062db1fc818a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.118493 Oct 10 10:52:49.823401 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1528/3178] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:49 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:49.835783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:49.836668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:49.868228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:49.870448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:49.871042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:49.872286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:49.874493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:49.876224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:50.607705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:50.637291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-601ee188-a6c4-4f18-8b1a-57f35c222e01 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 1.207633 Oct 10 10:52:50.643900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1651/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:49 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:50.688083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:50.691096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:50.716506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:50.720216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:50.734326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:50.736644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:50.738252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:50.739750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:50.740935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:50.741708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:50.746320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:50.750759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-815b61df-97e6-4667-9d84-0b64d3d9511e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.926221 Oct 10 10:52:50.753121 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1529/3180] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:49 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:50.760575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:50.765904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:50.784783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:50.785937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:50.786907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:50.790177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:50.791655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:50.792513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.087461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:51.102279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e14d854d-9818-4811-80df-62655534b758 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 0.454695 Oct 10 10:52:51.122167 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1652/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:50 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:51.135015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a55acdc-6987-487e-9960-97b9f9acccd0 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f677787aca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1722972427", "description": "tempest-description-933385970"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:51.150191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:51.165950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b466a4b0-33b6-442a-a538-911585c3708e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.410308 Oct 10 10:52:51.169015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1530/3182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:50 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:51.174943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:51.176387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:51.183791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.185708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.186428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.187451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.188154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.188818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.425518 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a55acdc-6987-487e-9960-97b9f9acccd0 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.295652 Oct 10 10:52:51.428180 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1653/3183] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:52:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:51.438286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b1d233-bf33-4817-b2a5-8a803b249f18", "tag": "b079f181-a34b-472c-91e5-81890fee6aa0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:51.496796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.503462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.506021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.555802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] Creating event network-changed:b079f181-a34b-472c-91e5-81890fee6aa0 for instance b5b1d233-bf33-4817-b2a5-8a803b249f18 on n-h2-860687-2 Oct 10 10:52:51.569400 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7898debd-d574-485f-b7c8-b0fd39f1c521 req-0f94ca19-d921-4212-ba55-d9d5b16c474a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139202 Oct 10 10:52:51.575184 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1654/3184] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:51.582536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1aea966-c0de-4d13-803d-9b526a95c1d8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777898dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:51.671848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:51.685493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68bc911d-90b2-4262-81b4-9ecd7b0bc990 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1522 microversion: 2.1 time: 0.514827 Oct 10 10:52:51.686316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1aea966-c0de-4d13-803d-9b526a95c1d8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.109035 Oct 10 10:52:51.691679 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1655/3185] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:51 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:51.691994 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1531/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:51 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:51.703698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:51.704448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:51.725308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:51.725962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:51.731807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.732312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.734553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.735275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.735882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.740441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.740677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.741517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:51.741658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.742242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.745060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:51.748192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:51.828623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:52:51.987942 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ff739e3-cabb-4d1f-bfbb-60780af1dd25 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 204 len: 0 microversion: 2.1 time: 0.266831 Oct 10 10:52:51.992358 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1532/3187] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:51 2022] DELETE /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:52:52.009388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:52.010155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:52.013353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:52.025359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:52.026243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:52.028251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:52.029255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:52.031564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:52.032247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:52.072695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:52.085703 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a427a3e-3722-42c0-ade7-dea5bee40854 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.392472 Oct 10 10:52:52.087246 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1656/3188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:51 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:52.094818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1083092263", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "6c23d851-00be-46d7-bf0e-2ac8fd1fc196"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:52.229817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] validate_networks() for [('6c23d851-00be-46d7-bf0e-2ac8fd1fc196', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:52:52.755140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:52.766665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:52.768267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:52.769685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4d67fd1-8395-40ff-a12b-1c8169ce3ee4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.779446 Oct 10 10:52:52.783432 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1533/3189] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:51 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:52.794602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:52.795454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:52.802043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:52.802898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:52.804199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:52.805178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:52.805917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:52.806590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:53.505512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:53.515452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51e614d6-23c4-4c84-866b-4157cda22434 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1528 microversion: 2.1 time: 0.730446 Oct 10 10:52:53.516693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1534/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:52 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1528 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:53.525593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:53.526556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:53.552233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:53.561931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:53.562493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:53.567626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:53.568151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:53.568630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.372107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:52:54.373097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:52:54.373765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:52:54.374344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:52:54.374905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:52:54.389952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.390869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.391682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.393546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.394282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.395638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.431207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Getting quotas for project 0e59b8262d82433a902c54c840251330. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:52:54.437159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Getting quotas for user 7ae91e3c6d1148b1b67838994ec1240b and project 0e59b8262d82433a902c54c840251330. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:52:54.450709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:54.452446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:52:54.454987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:52:54.502389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:54.512980 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d74a102b-4cc5-4dfc-b433-246c0b0eb7ad tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.423376 Oct 10 10:52:54.514619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1657/3191] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:52:54.521709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:54.523714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:54.531963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.532661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.533297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.535027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.535871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.536515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.546548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d69a4ca2-e427-46d8-985f-b75202166407 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 1.028338 Oct 10 10:52:54.550075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1535/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:53 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:54.558960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aaf24275-7933-4125-80cb-495ec2bc866b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cd934c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:54.642642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aaf24275-7933-4125-80cb-495ec2bc866b tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.090881 Oct 10 10:52:54.645480 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1536/3193] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:54 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:54.654006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:54.654972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:54.662646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.663395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.664000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.665486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:54.666296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:54.666941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:54.685744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:55.135916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.154620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.184599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff1bd070-ad9c-4b88-9dac-7b5249955ee2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1502 microversion: 2.1 time: 0.537731 Oct 10 10:52:55.185464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-deb34160-0cbe-4a96-bcaf-38254346f67e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.656877 Oct 10 10:52:55.187192 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1537/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:54 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1502 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:55.188810 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1658/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:54 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:55.197003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:55.214735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:55.217007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:55.264892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.283727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.284451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.284897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.285275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.285890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.286667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.287336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.296739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.308939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] Creating event network-changed:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h2-860687-2 Oct 10 10:52:55.316748 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a84eacf8-79d2-4d86-9d2a-cef1c534e02f req-e19f1c9e-930e-4ba4-87fe-ff60ba7d1b9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128149 Oct 10 10:52:55.318356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1538/3196] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:55.325603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d1933d3-9170-4f9c-94c2-9fb94725028c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:55.326545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d1933d3-9170-4f9c-94c2-9fb94725028c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:55.455441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d1933d3-9170-4f9c-94c2-9fb94725028c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.465567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d1933d3-9170-4f9c-94c2-9fb94725028c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1216 microversion: 2.1 time: 0.144213 Oct 10 10:52:55.469317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1539/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:55 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:55.474259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:55.484689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:55.509338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.514224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.514868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.515663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.516132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.522498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.639979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.640500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.652102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.652964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lazy-loading 'fault' on Instance uuid 79078f2d-ec37-4b1d-9080-22aed0df1694 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:52:55.777114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42455b03876445a8851d343d88b72953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24ce776c5874bd4b87760c3954fc50f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.788209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.799182 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5be80449-e769-45fa-80e4-61c7747dc904 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 200 len: 1315 microversion: 2.1 time: 0.328439 Oct 10 10:52:55.800442 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1540/3198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:55 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:55.806735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79078f2d-ec37-4b1d-9080-22aed0df1694", "name": "network-vif-deleted", "tag": "effaa7f9-69a5-4e31-98ca-85f5f90c2b66"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:55.816400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.819831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.820462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.820892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.821114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:55.824743 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97ed0253-8f1c-4479-9d02-cbdb3bbb1bce tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.634791 Oct 10 10:52:55.834354 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] Creating event network-vif-deleted:effaa7f9-69a5-4e31-98ca-85f5f90c2b66 for instance 79078f2d-ec37-4b1d-9080-22aed0df1694 on n-h1-860687-2 Oct 10 10:52:55.841361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d0064ec4-8e76-4a54-b418-fc9fda33e93c req-9b4ded1b-5633-424f-aa7a-fb403198f5b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Oct 10 10:52:55.842134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1541/3199] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:55.843164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1659/3200] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:55 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:55.849049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "897e3ae6-0eb5-4b07-84df-16a5d406bda7"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:55.852176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:55.854712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:55.855381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:55.860721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.861393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.861851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.861989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.862315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.862825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.863442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.863799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:55.864264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.864384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:55.864804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.865142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:55.901411 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Cannot 'attach_volume' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state rescued Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/os-volume_attachments HTTP/1.1 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 74 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: {"volumeAttachment": {"volumeId": "897e3ae6-0eb5-4b07-84df-16a5d406bda7"}} Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'attach_volume' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state rescued Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': 'b69e5873-8bb0-495a-80c8-ce1b71859e61', 'body': {'volumeAttachment': {'volumeId': '897e3ae6-0eb5-4b07-84df-16a5d406bda7'}}} Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 10 10:52:55.903641 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state rescued Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state rescued Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 409 to user: Cannot 'attach_volume' instance b69e5873-8bb0-495a-80c8-ce1b71859e61 while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be0c7eb2-e034-4911-b4fe-5e085c8d5d95 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061721 Oct 10 10:52:55.908413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1542/3201] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:52:55 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:52:56.037934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:56.048204 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e6d34ff9-320e-49bb-8c4b-c1e52e223fc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 0.203534 Oct 10 10:52:56.050204 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1660/3202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:55 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:56.072991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1ab378b-8a22-44a6-99ac-420d7811f54d tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778f65e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:56.133282 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1ab378b-8a22-44a6-99ac-420d7811f54d tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.072366 Oct 10 10:52:56.134242 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1661/3203] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:56 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:56.149301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:56.150281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:56.157590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.158112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.158563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.159320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.159790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.160218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.170415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fac89db-b9ce-4b1e-965a-2e3e3641b01d", "name": "network-vif-plugged", "status": "completed", "tag": "8d39a1e0-8fef-495f-a172-9e07645f2bc2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:52:56.187753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.188671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.189426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.205435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] Creating event network-vif-plugged:8d39a1e0-8fef-495f-a172-9e07645f2bc2 for instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d on n-h2-860687-2 Oct 10 10:52:56.212469 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f0110b0c-2d22-4d9f-8d45-2181ad8c4fc2 req-fbfdaa20-eb45-4b9a-aa38-a49dcd5e8ce3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304922 Oct 10 10:52:56.217419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1543/3204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:52:56.234252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:56.236880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:56.250642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.251741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.252379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.253542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.254179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.254785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.285809 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65fcceb6-9e94-40b1-b14b-ebcd899f3b43 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action" status: 202 len: 0 microversion: 2.1 time: 0.141873 Oct 10 10:52:56.286812 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1662/3205] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:52:56 2022] POST /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:56.300482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:56.301489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:56.311137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.312261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.313071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:56.313865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:56.314463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:56.315088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.173248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:57.182333 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3dd90f6b-7b6c-4a2d-bfe6-24c7307e4776 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1510 microversion: 2.1 time: 0.888860 Oct 10 10:52:57.184065 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1663/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:56 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1510 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:57.190208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:57.191189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:57.206883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.207921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.209723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.210917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.211751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.212440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.242067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:52:57.458289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:57.471539 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa96a5b8-4dcf-48e8-9dd6-5436b1edaba1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 1.246124 Oct 10 10:52:57.474618 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1544/3207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:56 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:57.504604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:57.506053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:57.508196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 79078f2d-ec37-4b1d-9080-22aed0df1694] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:57.516714 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f2b914e-8018-4fde-9ba5-72b7ea9b21b9 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1286 microversion: 2.1 time: 0.330663 Oct 10 10:52:57.518707 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1664/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:57 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1286 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:57.529552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:57.531660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:57.531883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.532492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.532954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.534619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.535147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.535578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.548009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.548518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.548963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.549688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.550151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.550580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.603162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 HTTP/1.1 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '79078f2d-ec37-4b1d-9080-22aed0df1694'} Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:57.611621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. Oct 10 10:52:57.621746 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:57.628148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance 79078f2d-ec37-4b1d-9080-22aed0df1694 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:57.629905 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-355c8058-15bc-48c6-913b-5077bf3ffd0f tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694" status: 404 len: 111 microversion: 2.1 time: 0.153642 Oct 10 10:52:57.634191 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1545/3209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:57 2022] GET /compute/v2.1/servers/79078f2d-ec37-4b1d-9080-22aed0df1694 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:57.655574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:57.656498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:57.665564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.666232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.667803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:57.669626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:57.671737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:57.677328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.220742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.228598 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-701e260e-7df3-4568-8b51-80aaf71de6cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1309 microversion: 2.1 time: 0.589613 Oct 10 10:52:58.229170 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1546/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:57 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1309 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:58.251858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1245cc20-2eee-4d37-9361-92eda23df73e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c2bb4c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.308708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.320123 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1245cc20-2eee-4d37-9361-92eda23df73e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.071969 Oct 10 10:52:58.320877 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1547/3211] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:58 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:58.344190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f46248a-0122-4494-911c-d31658bfea03 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f677c39e5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.350918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.352419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.353811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d77c07d0-5220-459e-af80-e5678fcfa9eb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.833917 Oct 10 10:52:58.367410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1665/3212] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:57 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:52:58.378160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.379033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:58.386338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.387168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.387861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.392813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.393839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.394744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.415417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2f46248a-0122-4494-911c-d31658bfea03 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Image not found. Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f46248a-0122-4494-911c-d31658bfea03 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e HTTP/1.1 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: exception: Image not found. Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '46ebf618-3c74-44b2-9838-f6d56e7f398e'} Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 46ebf618-3c74-44b2-9838-f6d56e7f398e to delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46ebf618-3c74-44b2-9838-f6d56e7f398e could not be found. Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.417686 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f46248a-0122-4494-911c-d31658bfea03 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f46248a-0122-4494-911c-d31658bfea03 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e" status: 404 len: 62 microversion: 2.1 time: 0.079201 Oct 10 10:52:58.422208 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1548/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:58 2022] DELETE /compute/v2.1/images/46ebf618-3c74-44b2-9838-f6d56e7f398e => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:52:58.435552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.436213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:58.449468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.450039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.450595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.451459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.452061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.456108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.483144 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 HTTP/1.1 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f59ac015-f938-495e-af31-5348fcb70118'} Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:58.484765 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ebe46e7-0882-4f63-a342-99272ec92ac2 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 404 len: 111 microversion: 2.1 time: 0.062175 Oct 10 10:52:58.490224 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1549/3214] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:52:58 2022] DELETE /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:58.496692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.497545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: f59ac015-f938-495e-af31-5348fcb70118] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:58.503903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.504514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.505058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.505860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.506726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.507413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 HTTP/1.1 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f59ac015-f938-495e-af31-5348fcb70118'} Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:52:58.531642 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance f59ac015-f938-495e-af31-5348fcb70118 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88f803ff-65cb-4d1f-b455-89bb5b995250 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118" status: 404 len: 111 microversion: 2.1 time: 0.040172 Oct 10 10:52:58.536579 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1550/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:58 2022] GET /compute/v2.1/servers/f59ac015-f938-495e-af31-5348fcb70118 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:52:58.542711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.543453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:58.550139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.550703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.551225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.552338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.553712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.554370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.770821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.792140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1703c09e-34a4-409a-b773-568d2b3ef9bc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1510 microversion: 2.1 time: 0.423221 Oct 10 10:52:58.803268 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1666/3216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:58 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:58.808330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.808955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:58.816614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.819314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.819910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.820667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:58.822291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:58.822725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:58.894109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.909821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcdd8e11-18d5-45b4-bc10-91673647236f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.372703 Oct 10 10:52:58.911457 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1551/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:58 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:58.917933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e41c5847-78d4-45bd-8e09-b9610f7572d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f6780cc53a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:58.926510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:52:58.942860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-885bdce7-3705-493a-9ffc-c6a3bd5f7214 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1274 microversion: 2.1 time: 0.148535 Oct 10 10:52:58.943506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1667/3218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:58 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:58.968228 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e41c5847-78d4-45bd-8e09-b9610f7572d8 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811554130" status: 202 len: 0 microversion: 2.1 time: 0.054463 Oct 10 10:52:58.969883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1552/3219] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 10:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811554130 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:52:59.252447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:59.253067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:59.261230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:59.261718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:59.262162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:59.262862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:59.263337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:59.263772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:59.341842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31433ac8-07d4-4861-96d1-c33507e89ee3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c2bbd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:59.439514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31433ac8-07d4-4861-96d1-c33507e89ee3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.106234 Oct 10 10:52:59.441273 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1553/3220] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:52:59 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:52:59.454114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:52:59.454748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:52:59.471407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:59.475833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:59.476269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:52:59.477010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:52:59.477475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:52:59.477963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.161322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.171700 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9cb10b94-ed4b-4e78-bc56-ffc280ced915 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1490 microversion: 2.1 time: 0.922714 Oct 10 10:53:00.173323 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1668/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:52:59 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1490 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:00.179766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:00.180718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:00.188685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.189597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.190371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.191354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.192025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.192619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.375853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.393235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.395131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.396699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94e70c22-f60b-45be-8da2-b528df94fd62 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.954600 Oct 10 10:53:00.415189 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1554/3222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:52:59 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:00.424289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:00.426454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:00.444162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.444781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.445319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.446047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.450112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.450756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.573477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.583758 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a03b4b1-a2ee-4136-9dcd-04d259b7aa0e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1516 microversion: 2.1 time: 0.409204 Oct 10 10:53:00.607879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1669/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:00 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1516 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:00.611998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:00.612693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:00.621390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.621904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.622510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.626785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:00.628029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:00.628659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:00.893083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.913722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af12686c-f5a5-4012-a195-20e7083051e7 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.496145 Oct 10 10:53:00.916225 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1555/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:00 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:00.929092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51131e7b-962c-4f81-aefd-3cc6b4680473 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '.version_select at 0x7f677d2545e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:00.966363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:00.974254 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bad5959-f99f-497b-852f-28a0aff2d0a3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.365880 Oct 10 10:53:00.975424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1670/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:00 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:00.979797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b1d233-bf33-4817-b2a5-8a803b249f18", "name": "network-vif-plugged", "status": "completed", "tag": "b079f181-a34b-472c-91e5-81890fee6aa0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:01.002832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.003357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.004122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.040248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-51131e7b-962c-4f81-aefd-3cc6b4680473 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Image not found. Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51131e7b-962c-4f81-aefd-3cc6b4680473 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/2eabed7b-788a-453b-82b3-bdc65305d380 HTTP/1.1 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: exception: Image not found. Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2eabed7b-788a-453b-82b3-bdc65305d380'} Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2eabed7b-788a-453b-82b3-bdc65305d380 to delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2eabed7b-788a-453b-82b3-bdc65305d380 could not be found. Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.047176 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 10:53:01.051810 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.056187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51131e7b-962c-4f81-aefd-3cc6b4680473 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:01.064061 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51131e7b-962c-4f81-aefd-3cc6b4680473 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/images/2eabed7b-788a-453b-82b3-bdc65305d380" status: 404 len: 62 microversion: 2.1 time: 0.139948 Oct 10 10:53:01.065589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] Creating event network-vif-plugged:b079f181-a34b-472c-91e5-81890fee6aa0 for instance b5b1d233-bf33-4817-b2a5-8a803b249f18 on n-h2-860687-2 Oct 10 10:53:01.068593 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1556/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:00 2022] DELETE /compute/v2.1/images/2eabed7b-788a-453b-82b3-bdc65305d380 => generated 62 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:53:01.079492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2005444844", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:01.087719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-36497832-6cbd-487b-b2a1-7964eb909daa req-90c79fe2-bbf4-4080-8cd9-1100ed8062a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111012 Oct 10 10:53:01.088357 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1671/3227] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:01.093919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-256304a6-c2fd-485a-9eca-1b36fc205da8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777898c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:01.259525 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-256304a6-c2fd-485a-9eca-1b36fc205da8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.169815 Oct 10 10:53:01.262312 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1672/3228] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:01 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:01.265343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:01.280476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:01.283026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:01.299131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.304291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.307806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.309237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.311961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.314559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.356825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc HTTP/1.1 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc'} Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:01.361028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:01.367475 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb4bd776-1077-4845-8d12-75cbd866bcab tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 404 len: 111 microversion: 2.1 time: 0.093642 Oct 10 10:53:01.372407 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1673/3229] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:01 2022] DELETE /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:01.390175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:01.392945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] [instance: 87aeb77a-172e-4a78-94d0-2d2131ab79fc] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:01.405923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.409986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.410823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.411742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.413342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.414464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.467918 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] HTTP exception thrown: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Request method failure captured: Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc HTTP/1.1 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kEkkLJdnrIzI3plHoGpX4g6u8sNyeRVI71X8MekoQ9GiCqafMae6OKFZ8K68c7LFbhyvhPZOXUiKDi_YUjNLDl0mRRS-5fKTuslTAwSyVk1kii2OM6ovMFCvciJq-zLDF8W25Y_-ieQ6Z0QpI72NZdZsUJ_8zyFr2YpEfdIXh4BXc Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b24ce776c5874bd4b87760c3954fc50f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b24ce776c5874bd4b87760c3954fc50f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b24ce776c5874bd4b87760c3954fc50f"}]}] Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b24ce776c5874bd4b87760c3954fc50f Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-316964759 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 42455b03876445a8851d343d88b72953 Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-316964759-project Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '87aeb77a-172e-4a78-94d0-2d2131ab79fc'} Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.471226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] Returning 404 to user: Instance 87aeb77a-172e-4a78-94d0-2d2131ab79fc could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:01.476907 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07e9dd85-5fe4-45dd-87d3-8fdae667a187 tempest-ImagesOneServerNegativeTestJSON-316964759 tempest-ImagesOneServerNegativeTestJSON-316964759-project] 10.222.0.16 "GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc" status: 404 len: 111 microversion: 2.1 time: 0.100315 Oct 10 10:53:01.481052 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1674/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:01 2022] GET /compute/v2.1/servers/87aeb77a-172e-4a78-94d0-2d2131ab79fc => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:01.487231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:01.487847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:01.506563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.507784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.512004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:01.513760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:01.515222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:01.518359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.072085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:02.084281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:02.086943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:02.096828 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6d69491-5ebf-467f-a7b1-2a3c35d47dfe tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 0.614628 Oct 10 10:53:02.097427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1675/3231] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:01 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:02.105273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:02.105896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:02.132218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.134114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.134776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.137636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.139478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.140645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.549074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:02.549773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:02.551500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:02.552193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:02.553397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:02.571115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.572381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.573004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.574587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.583347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.584954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.609422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:02.623534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:02.646806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:02.659985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:02.739585 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-725fb846-b8d4-44eb-9f6f-35357c078046 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669611 Oct 10 10:53:02.741243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1557/3232] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:02.746845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:02.748403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:02.755312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.756457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.757091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:02.758310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:02.758940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:02.759542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:03.001309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:03.014498 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eca646bc-f371-494d-844d-fca196ed8263 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1317 microversion: 2.1 time: 0.915227 Oct 10 10:53:03.015662 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1676/3233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:02 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:03.045712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-939c5745-f0c5-4c98-956c-f925a4a3785d tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777831af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:03.142838 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-939c5745-f0c5-4c98-956c-f925a4a3785d tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.123647 Oct 10 10:53:03.164375 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1677/3234] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:03 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:03.174708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9215f64a-fa69-4875-bba3-9165a7ded1ba tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:03.175370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9215f64a-fa69-4875-bba3-9165a7ded1ba tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:03.247184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:03.273868 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b861e90d-b22b-4c45-b36b-5c71062e2140 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.530137 Oct 10 10:53:03.276282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1558/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:02 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:03.288769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "name": "network-vif-plugged", "status": "completed", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:03.322002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:03.323364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:03.325094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:03.369694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9215f64a-fa69-4875-bba3-9165a7ded1ba tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:03.377064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=25 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:03.384431 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9215f64a-fa69-4875-bba3-9165a7ded1ba tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1209 microversion: 2.1 time: 0.213648 Oct 10 10:53:03.385463 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1678/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:03 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1209 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:03.396915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:03.398654 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] Creating event network-vif-plugged:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h2-860687-2 Oct 10 10:53:03.402376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:03.422901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1776fe8b-ed20-46d5-9f0f-c228857074ef req-7523a64b-1de0-4e69-b346-28dfe95da8ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139090 Oct 10 10:53:03.423292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:03.424024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:03.425998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:03.430459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:03.432975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:03.433633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:03.465027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1559/3237] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:03.502211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-332f0afb-660c-4001-b371-cca8859ff92b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: .version_select at 0x7f6780d230d0>, body: {"keypair": {"name": "tempest-keypair-574850040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9DwTJjDJB55Bzgpua4edKR1tAS2Es1A1HQlFzMo8Imdbs7nsf1LpGizAvApJ3khagHpKJcqb4T+THsZPkPEhBiJQl6t9ZgsFBuLoRdLR+VrgED3c7jXBXABWpsDyl3JA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:03.607875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-332f0afb-660c-4001-b371-cca8859ff92b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:03.628935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:03.637036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-332f0afb-660c-4001-b371-cca8859ff92b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for user 8f6c75faee37446a96834935a3933cd8 and project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:03.684209 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-332f0afb-660c-4001-b371-cca8859ff92b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212567 Oct 10 10:53:03.686059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1560/3238] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:53:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:03.692945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d1582b-8e1f-4c1d-a264-df09c4b299a0", "tag": "00991c4b-73a0-4011-b7b0-52f412ed1717"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:03.718798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:03.718917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:03.719361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:03.760221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] Creating event network-changed:00991c4b-73a0-4011-b7b0-52f412ed1717 for instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 on n-h1-860687-2 Oct 10 10:53:03.779034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f470a845-42fb-40ba-a347-b768dd3e1a0a req-6157d4b8-43b1-4d69-b32e-0948471c5e04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086913 Oct 10 10:53:03.779034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1561/3239] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:04.044286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:04.055400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:04.073715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:04.074338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:04.076041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:04.076813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:04.081373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:04.082184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:04.407368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:04.851684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:04.869900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:04.874963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:04.878072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6738c520-d09c-490c-b6c6-1d54d895bc9d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 1.487625 Oct 10 10:53:04.878654 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1679/3240] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:03 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:04.891355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cafef0c8-acd1-49c1-b99f-9955c42dbd0c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677780d670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:04.921437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:04.938771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47f51910-5985-44f9-85d2-c071f392110c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1508 microversion: 2.1 time: 0.898424 Oct 10 10:53:04.942187 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1562/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:04 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1508 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:04.959094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:04.960620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:04.973994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:04.975940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:04.977702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:04.979695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:04.981008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:04.983104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.094823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cafef0c8-acd1-49c1-b99f-9955c42dbd0c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.213140 Oct 10 10:53:05.096071 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1680/3242] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:04 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:05.119661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:05.123322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:05.149867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.152720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.154136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.157723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.163882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.164574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.536140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:05.553721 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ce63e81-61e1-41ef-961d-33a92f338cc0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1269 microversion: 2.1 time: 0.453818 Oct 10 10:53:05.554340 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1681/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:05 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1269 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:05.589524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:05.590179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:05.603427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.604459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.605197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.613283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.615954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.617719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.813509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:05.822584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71a983ff-a364-44d2-a111-b804648423b3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.879117 Oct 10 10:53:05.823211 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1563/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:04 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:05.932747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:05.937421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:05.958333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.959901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.960703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:05.961755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:05.964311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:05.965086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:06.797631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:06.812499 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b931491-28cb-43f5-b5d4-c838d58105eb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1508 microversion: 2.1 time: 1.237653 Oct 10 10:53:06.816212 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1682/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:05 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1508 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:06.837654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24d50fd5-fd57-4e4f-ac92-8bba7632cb9c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777863700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:06.885078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:06.909745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:06.923918 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24d50fd5-fd57-4e4f-ac92-8bba7632cb9c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.102964 Oct 10 10:53:06.926115 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1683/3246] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:06 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:06.930671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:06.932187 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d38d4b5-dae3-4b44-bd4b-38d819a9ee94 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1404 microversion: 2.20 time: 1.025122 Oct 10 10:53:06.942486 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1564/3247] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:05 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1404 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:06.947133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:06.950202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:06.960867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:06.967504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:06.975551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:06.978240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:06.980570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:06.983315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:06.984311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:06.993009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.000476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.012410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.014290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.020417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.023855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.025260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.214155 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3b1fc42-f531-4f11-80cb-d7fc3a59bcdd tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "PUT /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1080 microversion: 2.1 time: 0.269246 Oct 10 10:53:07.216202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1565/3248] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:53:06 2022] PUT /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1080 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:07.224096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:07.226025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:07.237624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.238567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.239220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.242788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.243712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.244323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:07.245957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.253232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:07.263706 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-77114317-3be9-4b15-b663-0f1f8858bea8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1267 microversion: 2.1 time: 0.324071 Oct 10 10:53:07.271619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1684/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:06 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1267 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:07.289708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:07.290760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:07.310130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.311053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.311860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.312826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:07.314125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:07.317983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:07.634583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:07.647302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7dd56e55-d030-441d-99e2-56184d33fcb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.428813 Oct 10 10:53:07.659569 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1566/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:07 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:07.942156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c383036d-aefc-4841-a2f8-8e23afbfecbe tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c3e69d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:07.988667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:08.011857 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f07ae8a9-59e6-4e68-9dc5-74d0594a9c7c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1506 microversion: 2.1 time: 0.738597 Oct 10 10:53:08.012540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1685/3251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:07 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:08.017126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:08.017730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:08.035970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:08.036403 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c383036d-aefc-4841-a2f8-8e23afbfecbe tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.098414 Oct 10 10:53:08.037486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:08.037486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:08.038492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:08.038947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:08.047511 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1567/3252] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:07 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:08.049780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:08.053183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:08.054495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:08.061460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:08.062139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:08.062792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:08.063770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:08.064412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:08.065060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:09.215114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:09.223465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:09.244435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:09.245410 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2c1edce-4e0c-4ebd-9523-77c1b435721e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1506 microversion: 2.1 time: 1.194927 Oct 10 10:53:09.261765 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1568/3253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:08 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1506 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:09.269360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:09.276048 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ced7b04e-5319-432f-877f-bbea5a9147ef tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1596 microversion: 2.20 time: 1.261525 Oct 10 10:53:09.277986 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1686/3254] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:08 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1596 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:09.280967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:09.285120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:09.290656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-771838118", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3862d372-cf60-4344-b196-50210b6e2996"}], "security_groups": [{"name": "tempest-securitygroup--1444620213"}], "key_name": "tempest-keypair-574850040", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:09.304342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:09.304844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:09.305423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:09.306195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:09.306771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:09.308470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:09.731525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] validate_networks() for [('3862d372-cf60-4344-b196-50210b6e2996', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:10.125246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:10.135953 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8188d500-9a10-4872-a941-370062e8ea93 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 0.872498 Oct 10 10:53:10.152077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1569/3255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:09 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:10.157210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:10.158597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:10.166856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:10.167647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:10.168350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:10.169888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:10.170866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:10.171556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:10.488740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:10.502903 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51cde079-22b0-4687-af8c-85895271234c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.349268 Oct 10 10:53:10.528384 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1570/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:10 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:10.533570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5db09e83-10ea-44b1-9948-feead0362d75 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677d254160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:10.669935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5db09e83-10ea-44b1-9948-feead0362d75 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1455 microversion: 2.1 time: 0.139105 Oct 10 10:53:10.670574 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1571/3257] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:10 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:10.688779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:10.705891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:10.723311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:10.726500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:10.727299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:10.735482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:10.736211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:10.737443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:10.901484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:10.903708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:10.904064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:10.906301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:10.912517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:11.041733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:11.058438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.060097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.061160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.069541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.070332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.071752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.124739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-565e99a3-92c9-4de3-9684-2bf67f8479bc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "POST /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18/action" status: 202 len: 1112 microversion: 2.1 time: 0.442569 Oct 10 10:53:11.126040 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1572/3258] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:53:10 2022] POST /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18/action => generated 1112 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 10:53:11.132773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:11.133754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:11.142388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.143279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.144132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.145172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.146282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.146952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.322327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:11.322930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:11.325009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:11.327098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:11.327884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:11.332420 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ad45ba5-8cd0-44a3-9c57-0c28d1f0009e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.204062 Oct 10 10:53:11.333578 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1573/3259] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:53:11 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:53:11.345916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:11.346629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:11.354433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.356349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.359546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.359546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.359546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.364384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.367913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.373568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.374154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.374961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.378813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.379301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.425867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:11.437684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Getting quotas for user 8f6c75faee37446a96834935a3933cd8 and project 790c92b4ee424b9d8659fae80b9e72d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:11.453208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:11.459225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:11.582936 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac5d0666-3a5a-4e5c-9959-9704d99bbefe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.303635 Oct 10 10:53:11.585230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1687/3260] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:11.594099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:11.595776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:11.607964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.608912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.609598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.610940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.612097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.614279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.667484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:11.887952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:11.905911 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-736fa26e-8ce8-4165-9d6a-0a4d18f9171c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.570963 Oct 10 10:53:11.907739 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1574/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:11 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:11.913891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:11.914749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:11.934669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.938981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.940049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:11.942076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:11.944404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:11.945236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:12.037500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:12.048240 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8dcde643-0da3-406e-b0ad-f05661273784 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 0.461511 Oct 10 10:53:12.050461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1688/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:11 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:12.067557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-691c6854-decd-4411-8480-788e7d09cb66 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:12.069281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-691c6854-decd-4411-8480-788e7d09cb66 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:12.217004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-691c6854-decd-4411-8480-788e7d09cb66 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:12.225065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-691c6854-decd-4411-8480-788e7d09cb66 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1244 microversion: 2.1 time: 0.173429 Oct 10 10:53:12.239495 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1689/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:12 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:12.248799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-642b3712-3d60-42a2-964c-5e3e286d2fb8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677780dca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:12.320948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-642b3712-3d60-42a2-964c-5e3e286d2fb8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1464 microversion: 2.1 time: 0.079344 Oct 10 10:53:12.332738 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1690/3264] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:12 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1464 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:12.345885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d1582b-8e1f-4c1d-a264-df09c4b299a0", "name": "network-vif-plugged", "status": "completed", "tag": "00991c4b-73a0-4011-b7b0-52f412ed1717"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:12.369571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:12.369974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:12.370639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:12.392373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] Creating event network-vif-plugged:00991c4b-73a0-4011-b7b0-52f412ed1717 for instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 on n-h1-860687-2 Oct 10 10:53:12.413922 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b6010dec-9437-4539-ba50-0b6b273ee803 req-55296416-6dc7-4a66-89d0-4f0ae8d5394a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077638 Oct 10 10:53:12.415549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1691/3265] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:12.423626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7be159cb-bfb5-4550-b9c2-20f23e5e4607 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677783e940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:12.514624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7be159cb-bfb5-4550-b9c2-20f23e5e4607 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 200 len: 1464 microversion: 2.1 time: 0.097055 Oct 10 10:53:12.535496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1692/3266] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:12 2022] GET /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 1464 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:12.555588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:12.556398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:12.573857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:12.574465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:12.578292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:12.579098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:12.579586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:12.580031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:12.599675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:12.731247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:12.745006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad8fbf19-5b48-47e4-be29-41ca0cf80c02 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.833475 Oct 10 10:53:12.747817 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1575/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:11 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:12.931990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:12.932666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:12.939487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:12.940059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:12.940476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:12.941172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:12.941777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:12.942205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:13.651174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:13.757012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:13.768594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2123f150-3ba9-48d4-acfc-b1611c381342 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1467 microversion: 2.1 time: 1.230265 Oct 10 10:53:13.793298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1693/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:12 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1467 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:13.806930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:13.807605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:13.821994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:13.822778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:13.823955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:13.824856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:13.825515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:13.826105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.060963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:14.079139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-009ab754-85e2-4b7d-85a3-e61895402527 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 1.150266 Oct 10 10:53:14.080760 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1576/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:12 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:14.091643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:14.092863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:14.101704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.102878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.103855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.106147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.106809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.107700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.181271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:14.190103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ce5e94ee-bc26-49cd-8eaf-fdc5616143fe tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 0.393330 Oct 10 10:53:14.190991 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1694/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:13 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:14.211035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:14.212310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:14.218612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.219202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.219846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.220722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.221339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.221922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.279722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:14.289386 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52ffd9ce-cca9-4226-bc7e-84c918372245 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1302 microversion: 2.1 time: 0.207088 Oct 10 10:53:14.290133 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1577/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:14 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1302 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:14.295616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87c0cf1-2c55-4c71-9409-c4aac3ca6d55", "tag": "b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:14.310366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.311416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.312441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.330707 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] Creating event network-changed:b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f for instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 on n-h1-860687-2 Oct 10 10:53:14.339363 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-485067e0-885a-4e4a-be43-3d016699a4e6 req-bee5ba40-28d3-49e1-b017-aaf3bb1bfa0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046470 Oct 10 10:53:14.340694 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1578/3272] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:14.346940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2041379244"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:14.350339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:14.356847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.357477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.357930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.358702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.359234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.359598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.624869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f54916c9-14e0-4afb-b9a0-faf2255224a4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "POST /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95/action" status: 202 len: 0 microversion: 2.1 time: 0.282575 Oct 10 10:53:14.630190 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1579/3273] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:53:14 2022] POST /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 10:53:14.640845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1cae6d-cdab-4da1-a40e-76f423f50903", "name": "network-vif-unplugged", "status": "completed", "tag": "3fb3eec8-ee22-422c-ae0a-de4cac573f82"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:14.644987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:14.657569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:14.658438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:14.659437 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df239808-cf56-4f6f-8032-b867bfb29993 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1316 microversion: 2.1 time: 0.452864 Oct 10 10:53:14.660619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1695/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:14 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:14.665746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83738c29-42fd-42ca-8385-5657dbb4af40 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677782e040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:14.668138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:14.709848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] Creating event network-vif-unplugged:3fb3eec8-ee22-422c-ae0a-de4cac573f82 for instance ea1cae6d-cdab-4da1-a40e-76f423f50903 on n-h1-860687-2 Oct 10 10:53:14.720359 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4eb3e35d-1d5f-4a7f-8f4e-85286215594e req-136b25d6-1f8b-4393-bf52-a75e248ca9aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085809 Oct 10 10:53:14.721511 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1580/3275] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:14.753599 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83738c29-42fd-42ca-8385-5657dbb4af40 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.091542 Oct 10 10:53:14.762740 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1696/3276] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:14 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:15.112092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:15.114408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:15.124041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.124974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.125609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:15.126489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.127154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.128008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:15.215319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:15.217249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:15.225274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.226794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.227525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:15.228454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.229085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.229675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:15.641950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:15.654572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd8dc525-2db3-4e5f-b2e4-d4aaed0ee059 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.550449 Oct 10 10:53:15.656571 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1581/3277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:15 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:15.669028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:15.672113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:15.681844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.682532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.683342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:15.684703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:15.685327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:15.686052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.264236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:16.265368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:16.277684 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52b929e9-0e89-4394-aeac-0b565ce3bfe0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1302 microversion: 2.1 time: 0.619800 Oct 10 10:53:16.281611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1582/3278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:15 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1302 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:16.292757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:16.294026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:16.300013 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-443bed54-de78-402a-8c25-21f17be726db tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 1.089211 Oct 10 10:53:16.303946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1697/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:15 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:16.314579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.315531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.316452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.319618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.321854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.323957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.329988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14594ce2-0d10-4de9-9604-cfcb19e93183 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778e5790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:16.337764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:16.413825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14594ce2-0d10-4de9-9604-cfcb19e93183 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.108145 Oct 10 10:53:16.415580 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1698/3280] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:16 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:16.426486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:16.440482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.441220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.441901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.458243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] Creating event network-changed:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h2-860687-2 Oct 10 10:53:16.465416 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-05c4baa5-46f3-40ea-ade7-f183be66902c req-98613e55-8e6e-442f-88ae-6e66c1f4a0b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048331 Oct 10 10:53:16.467111 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1699/3281] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:16.680248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:16.681532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:16.688290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.689134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.689667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.690604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.691444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.692111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.814953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:16.834795 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65d73dd2-0648-4124-9347-619063a1cbf4 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1505 microversion: 2.1 time: 0.546407 Oct 10 10:53:16.835808 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1583/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:16 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:16.867653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1642396233"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:16.868357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:16.876636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.877274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.878372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:16.879440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:16.880131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:16.882028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:17.352052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:17.386984 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c738b288-d73f-4f32-b0db-e1109e691c68 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.709796 Oct 10 10:53:17.387616 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1700/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:16 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:17.403359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:17.403359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:17.405500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:17.406482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:17.409278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:17.410440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:17.412293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:17.412741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:17.546058 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Adding security group 4cb3481e-e86f-4606-a049-51190c76b596 to port 00991c4b-73a0-4011-b7b0-52f412ed1717 Oct 10 10:53:18.187929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:18.196691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd906a22-fcac-4be8-b5f3-60309339f442 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.804083 Oct 10 10:53:18.211396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1701/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:17 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:18.217871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:18.218752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:18.225954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:18.226729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:18.227406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:18.228303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:18.228929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:18.229529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:19.331889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:19.355395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f7acdeb-1293-4d92-b878-8ac005aa49f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 1.142416 Oct 10 10:53:19.356384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1702/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:18 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:19.369597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4dbab9bd-f1d9-48ea-b209-6fc7f40e951f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c0731f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:19.423858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4dbab9bd-f1d9-48ea-b209-6fc7f40e951f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.065619 Oct 10 10:53:19.425576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1703/3286] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:19 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:19.431583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:19.432523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:19.439131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:19.440175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:19.440849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:19.441785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:19.442463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:19.443816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:19.887934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12064f16-aaaa-4305-a138-26829c047747 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/action" status: 202 len: 0 microversion: 2.1 time: 3.027263 Oct 10 10:53:19.888728 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1584/3287] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:53:16 2022] POST /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/action => generated 0 bytes in 3029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:19.897164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:19.898486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:19.918574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:19.919918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:19.921164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:19.922724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:19.923453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:19.924833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.136227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:20.147725 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54ba3bd1-f415-4e1f-8318-b50cd0d26662 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.720765 Oct 10 10:53:20.155394 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1704/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:19 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:20.170181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1722972427"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:20.172263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:20.186588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:20.208189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:20.210691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:20.212183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.213527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:20.214286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:20.215221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.739655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:20.749322 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7ff7792-6a74-4f17-b6cc-ac2dd675f454 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.859533 Oct 10 10:53:20.752820 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1585/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:19 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:20.763785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d1582b-8e1f-4c1d-a264-df09c4b299a0", "tag": "00991c4b-73a0-4011-b7b0-52f412ed1717"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:20.787223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:20.791735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:20.792313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.820876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] Creating event network-changed:00991c4b-73a0-4011-b7b0-52f412ed1717 for instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 on n-h1-860687-2 Oct 10 10:53:20.830885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e6c80fb6-e120-412d-874b-4f0250a0b3a3 req-6c47007b-a177-4ca6-adea-c5531670126f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076492 Oct 10 10:53:20.831980 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1586/3290] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:20.842104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:20.846127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:20.861249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:20.862834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:20.863549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.864892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:20.865734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:20.866440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:20.882164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Adding security group 55c05929-f58d-43a2-92fa-89c9613c9e92 to port 00991c4b-73a0-4011-b7b0-52f412ed1717 Oct 10 10:53:21.393272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:22.214975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:22.224862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:22.227682 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cfe3285-a6a2-4cf3-a64a-0941b3920f4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 1.394408 Oct 10 10:53:22.228883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1587/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:20 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:22.247648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7159e95-7710-4816-b839-115b79ee5de0 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777acfaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:22.346882 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7159e95-7710-4816-b839-115b79ee5de0 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.116480 Oct 10 10:53:22.349576 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1588/3292] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:22 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:22.368747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:22.373610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:22.386519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:22.387441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:22.388137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:22.389963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:22.390669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:22.391363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:23.525061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:23.554662 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-156eb47d-7ed7-4efa-bcdd-32fa57e1fee3 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 1.198539 Oct 10 10:53:23.559724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1589/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:22 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:23.572674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-plugged", "status": "completed", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:23.596533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:23.599392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:23.600714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:23.622838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] Creating event network-vif-plugged:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:53:23.629468 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4459377f-0eaa-4fd4-8f32-8188bad779f1 req-a74d321e-3879-4bd7-9231-d8a025bf9e47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067809 Oct 10 10:53:23.636078 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1590/3294] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:23.643843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:23.647261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:23.655098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:23.655590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:23.656027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:23.657036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:23.657493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:23.658967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:23.785714 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58c93088-a93b-4078-ae39-58f3c57cc250 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/action" status: 202 len: 0 microversion: 2.1 time: 3.627537 Oct 10 10:53:23.789880 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1705/3295] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:53:20 2022] POST /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/action => generated 0 bytes in 3631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:23.794756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:23.795419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:23.812805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:23.813333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:23.813765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:23.814498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:23.815055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:23.815627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:24.498509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:24.520926 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ad303d8-2168-4fc0-a4a0-d73682f271ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.878786 Oct 10 10:53:24.523454 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1591/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:23 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:24.540109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:24.554982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:24.562968 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28e085e8-db42-4dbc-9233-9c7e2a0ab03f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 0.774888 Oct 10 10:53:24.563588 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1706/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:23 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:24.581751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec85ce83-064c-42e9-987f-8f8d45579a9e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6780d36700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:24.588128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:24.588914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:24.589596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:24.629627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] Creating event network-changed:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:53:24.645121 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c8d256bf-c789-4ad5-ae7d-11ae33af2c1b req-ab62cc1b-05d5-4eeb-9f74-641f31bbbba3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115727 Oct 10 10:53:24.650296 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1592/3298] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:24.668693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:24.672934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:24.688200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:24.690946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:24.693859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:24.697781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:24.698513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:24.699304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:24.702076 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec85ce83-064c-42e9-987f-8f8d45579a9e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.137434 Oct 10 10:53:24.702667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1707/3299] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:24 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:24.712594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:24.713331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:24.732418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:24.732976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:24.733470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:24.734196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:24.734662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:24.735126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:25.241453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:25.251493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed8e9654-cdf4-4205-8932-df4fcf0629d5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.547730 Oct 10 10:53:25.263668 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1708/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:24 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:25.280203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb8de876-61c0-4638-8235-c8dfacee43d5 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.627775 Oct 10 10:53:25.280817 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1593/3301] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Oct 10 10:53:24 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0/os-security-groups => generated 1156 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:25.302859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4b0632a-a079-4ec6-9bf1-e9ea7387397d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6777831040>, body: {"security_group": {"name": " tempest-securitygroup -581807496 ", "description": "tempest-description-1853390354"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:25.546145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:25.546825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:25.563953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:25.564999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:25.566296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:25.567264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:25.569279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:25.569904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:25.850609 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4b0632a-a079-4ec6-9bf1-e9ea7387397d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.554971 Oct 10 10:53:25.851378 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1709/3302] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:25 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:25.856544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:25.857602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:25.871581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:25.874315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:25.878178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:25.879245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:25.879981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:25.881298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:26.184214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:26.257355 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d10c247-f2f5-46b1-b8a9-87b53755104a tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.715508 Oct 10 10:53:26.257961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1594/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:25 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:26.296857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87c0cf1-2c55-4c71-9409-c4aac3ca6d55", "name": "network-vif-plugged", "status": "completed", "tag": "b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:26.336957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:26.339975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:26.340562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:26.389907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] Creating event network-vif-plugged:b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f for instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 on n-h1-860687-2 Oct 10 10:53:26.403426 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cb7211ba-5b38-474f-9e2e-52c9fa084e60 req-93ef0845-6070-460b-a665-da414417f766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143710 Oct 10 10:53:26.403924 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1595/3304] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:26.421764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-753e942a-a362-423d-95d9-ecc4891c708f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777ae64c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:26.426247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:26.446622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03f3b124-6f46-41bf-966c-a0be3c17350f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 0.593426 Oct 10 10:53:26.446750 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1710/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:25 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:26.463952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c5f600cc-ea97-4552-98ff-ff950a2dd123 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67778e5940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:26.512574 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-753e942a-a362-423d-95d9-ecc4891c708f tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.107464 Oct 10 10:53:26.514527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1596/3306] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:26 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:26.529619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:26.531313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:26.546277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:26.547681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:26.548624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:26.549620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:26.550331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:26.551157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:26.918900 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c5f600cc-ea97-4552-98ff-ff950a2dd123 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48" status: 200 len: 223 microversion: 2.1 time: 0.469597 Oct 10 10:53:26.919518 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1711/3307] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:53:26 2022] GET /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 => generated 223 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:26.933901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d1582b-8e1f-4c1d-a264-df09c4b299a0", "tag": "00991c4b-73a0-4011-b7b0-52f412ed1717"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:26.967122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:26.967632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:26.968073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:26.993719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] Creating event network-changed:00991c4b-73a0-4011-b7b0-52f412ed1717 for instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 on n-h1-860687-2 Oct 10 10:53:27.018939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-614a47aa-ea8e-4f15-8962-0f79075a0196 req-bc4c481a-f465-40f3-948f-de27de482560 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078763 Oct 10 10:53:27.020731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1712/3308] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:27.035033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63272e0c-9173-46e9-b9ba-3d5925bcb718 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777839b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:27.254749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:27.264400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d97ec2f-b5ff-406f-81f2-a6cffd6e8162 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1517 microversion: 2.1 time: 0.747733 Oct 10 10:53:27.269722 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1597/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:26 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1517 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:27.290438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:27.292893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:27.310227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:27.311073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:27.312259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:27.316278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:27.317118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:27.318573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:27.771271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:27.782070 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-395e4a4e-4406-4ca3-aac9-b153facd5b61 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.500075 Oct 10 10:53:27.785235 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1598/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:27 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:27.855156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63272e0c-9173-46e9-b9ba-3d5925bcb718 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48" status: 202 len: 0 microversion: 2.1 time: 0.832775 Oct 10 10:53:27.856379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1713/3311] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:53:27 2022] DELETE /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:27.861825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:27.862948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:27.874317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:27.875243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:27.875956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:27.877211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:27.877947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:27.878616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:28.445144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-828790958", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:28.596655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:28.841658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:28.861820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-31c58b13-f8c4-48df-b2fa-f7dd0fd2a720 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1309 microversion: 2.1 time: 1.004083 Oct 10 10:53:28.865749 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1714/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:27 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1309 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:28.874354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa6600db-6915-4ed6-998e-a334d5b95695 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777822c10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:28.987749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa6600db-6915-4ed6-998e-a334d5b95695 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.119696 Oct 10 10:53:28.989209 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1715/3313] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:28 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:29.004755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67778299d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:29.086581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:53:29.087437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group f04003da-834a-4b41-8328-20772bef6b48 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:53:29.088145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.088145 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 HTTP/1.1 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f04003da-834a-4b41-8328-20772bef6b48'} Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:53:29.091502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] Oct 10 10:53:29.100154 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:29.112255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:53:29.112255 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-3b53b1fa-2a1d-4baf-852f-d7ca30964296'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:29.113596 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c46cdd0-3f23-452f-8131-94149a76173f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48" status: 404 len: 194 microversion: 2.1 time: 0.112660 Oct 10 10:53:29.116339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1716/3314] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:53:28 2022] GET /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:29.133986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:29.135925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:29.158646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:29.161882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:29.163401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:29.164392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:29.170160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:29.175304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:29.559901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:29.576035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83dbb7cf-7c67-4685-be76-a8a508ceb696 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.458364 Oct 10 10:53:29.596802 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1717/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:29 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:29.611842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:29.612850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:29.630717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:29.632752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:29.636316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:29.638066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:29.640971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:29.642155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:30.003129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:30.012526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a036ed68-795d-45c4-9776-fbc9f65bb607 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.413423 Oct 10 10:53:30.027419 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1718/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:29 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:30.037234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3cd72c7-56e5-4581-b6be-cbc6fd51af4a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f677782e940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-180718966", "description": "tempest-description-1818119984"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:30.701826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:30.706213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:30.706779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:30.707235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:30.707708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:30.727801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:30.728395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:30.728840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:30.729825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:30.730315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:30.730775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:30.772962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:30.781186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:30.800786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:30.805149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:30.867749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f0408f0-eeba-40ce-ad4f-1fb94d13c788 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.080984 Oct 10 10:53:30.876193 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1599/3317] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:30.882247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:30.883394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:30.891893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:30.892846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:30.893520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:30.894462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:30.895218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:30.899407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:30.987735 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3cd72c7-56e5-4581-b6be-cbc6fd51af4a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.958844 Oct 10 10:53:30.988930 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1719/3318] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:30.999523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c41be5d5-9eca-46e3-a1d0-8e85697271c2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778381f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:31.103970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c41be5d5-9eca-46e3-a1d0-8e85697271c2 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.099846 Oct 10 10:53:31.108696 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1720/3319] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:30 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:31.136932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:31.145191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:31.184151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:31.185300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:31.186569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:31.190541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:31.193115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:31.197647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:31.225784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:31.237987 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d315cb9-f10a-41db-8f50-3d7f4b38e534 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1490 microversion: 2.1 time: 0.357279 Oct 10 10:53:31.239169 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1600/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:30 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1490 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:31.244544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-409b2c83-8ab5-4b45-89a2-bb6066f4eca5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:31.248654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-409b2c83-8ab5-4b45-89a2-bb6066f4eca5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:31.258708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:31.277805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:31.354104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-409b2c83-8ab5-4b45-89a2-bb6066f4eca5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:31.363031 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-409b2c83-8ab5-4b45-89a2-bb6066f4eca5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1214 microversion: 2.1 time: 0.122075 Oct 10 10:53:31.366910 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1601/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:31 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:31.390507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a913fa8-9fb8-4c55-8ab9-12471a550a8d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6777a81f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-32622455", "description": "tempest-description-576446426"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:31.719015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:31.740959 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58e49fa5-924e-4628-988f-9b8758b30a70 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.625978 Oct 10 10:53:31.760365 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1721/3322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:31 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:31.781269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:31.781929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:31.800986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:31.805763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:31.806636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:31.807628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:31.809758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:31.811134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.052949 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a913fa8-9fb8-4c55-8ab9-12471a550a8d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.683068 Oct 10 10:53:32.055786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1602/3323] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:31 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:32.063717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:32.066920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:32.090560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.096618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.100563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.104849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.105560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.107409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.231502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:32.258571 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0516491f-fae5-45f3-a79d-a197218f6520 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.494511 Oct 10 10:53:32.261491 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1722/3324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:31 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:32.272200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "name": "network-vif-plugged", "status": "completed", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:32.314801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.315320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.322374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.362908 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] Creating event network-vif-plugged:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:53:32.387624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0ef7d278-affb-4567-bc05-f0ba0e921d44 req-8bd50768-9da6-4db1-9966-ac949dbe7f24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124631 Oct 10 10:53:32.388932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1723/3325] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:32.421793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e211f7d8-748c-43d5-a089-a9ac83cd10e3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6777838dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1074483649", "description": "tempest-description-630983752"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:32.555433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:32.579723 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15fa3b84-300a-4c42-b8b0-c205aac3185e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1490 microversion: 2.1 time: 0.522064 Oct 10 10:53:32.582413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1603/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:32 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1490 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:32.596308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b5a30dd-d055-4729-a169-6313cc005715 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777a81a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:32.710929 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b5a30dd-d055-4729-a169-6313cc005715 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.125458 Oct 10 10:53:32.711857 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1604/3327] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:32 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:32.727719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:32.728668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:32.736759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.737573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.738219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.739344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.740628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.741952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.820265 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e211f7d8-748c-43d5-a089-a9ac83cd10e3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.429604 Oct 10 10:53:32.821143 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1724/3328] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:32.825872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:32.826673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:32.839273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.845810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.846603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.847687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.848369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.849058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.873334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:32.893648 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92503716-c5f2-493c-97d0-cd68725b36fe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1210 microversion: 2.1 time: 0.171222 Oct 10 10:53:32.905550 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1605/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:32 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:32.912148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:32.918752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:32.933705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.934802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.935799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:32.936981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:32.937675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:32.938481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.204596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:33.214589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:33.226777 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1d01750-6062-4f8e-866e-08b2e84a9f54 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.319714 Oct 10 10:53:33.227982 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1606/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:32 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:33.228982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b127c757-3115-4b99-abd8-e2cb577d2ec9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1490 microversion: 2.1 time: 0.406573 Oct 10 10:53:33.237325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9175d21-726f-4933-bfb8-804d3bb86be7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a81a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:33.246042 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1725/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:32 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:33.252955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:33.253638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:33.259907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.260649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.261248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.262120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.262856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.263640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.300694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:33.596600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c2b85f7-01b0-4638-8028-86bf8fcfb62a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 204 len: 0 microversion: 2.1 time: 0.342274 Oct 10 10:53:33.601632 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1726/3332] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:33 2022] DELETE /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:33.620209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:33.624108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:33.641184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.642124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.644554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.646910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.650001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.651342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.707552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9175d21-726f-4933-bfb8-804d3bb86be7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.477812 Oct 10 10:53:33.708914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1607/3333] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:53:33 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:33.714633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:33.715303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:33.726376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.726651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.727457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:33.729019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:33.729749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:33.730356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:34.240572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:34.256132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2fe48bff-6e57-4c02-88b8-ac2af85eb376 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1370 microversion: 2.1 time: 0.650512 Oct 10 10:53:34.258569 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1727/3334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:33 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1370 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:34.269252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:34.279307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0eb84d45-6d61-4335-b74b-ae6f6a12382f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1496 microversion: 2.1 time: 0.569335 Oct 10 10:53:34.279798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2642d03-0e8c-4f6a-8ac2-26d53210b436 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67778224c0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:34.293858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1608/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:33 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1496 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:34.331290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72c78cc2-705c-4a4e-9862-b2ca1fcfc83c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777ad19d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:34.381746 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72c78cc2-705c-4a4e-9862-b2ca1fcfc83c tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.086294 Oct 10 10:53:34.383027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1609/3336] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:34 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:34.394632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:34.395737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:34.402683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:34.403517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:34.404182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:34.405133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:34.405811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:34.406458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:34.541260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:34.544848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:34.552507 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2948c77-904e-4a60-bfb8-05c1347550a6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1266 microversion: 2.1 time: 0.166132 Oct 10 10:53:34.557298 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1610/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:34 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:34.566964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:34.569519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:34.591335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:34.607427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:34.609381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:34.610326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:34.612123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:34.612761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:35.246352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:35.261375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1be4b4be-affa-4303-bae6-060ee4ffe84f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.697828 Oct 10 10:53:35.265432 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1611/3338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:34 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:35.284616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b1d233-bf33-4817-b2a5-8a803b249f18", "name": "network-vif-unplugged", "status": "completed", "tag": "b079f181-a34b-472c-91e5-81890fee6aa0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:35.306187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:35.306970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:35.308846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:35.335852 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] Creating event network-vif-unplugged:b079f181-a34b-472c-91e5-81890fee6aa0 for instance b5b1d233-bf33-4817-b2a5-8a803b249f18 on n-h2-860687-2 Oct 10 10:53:35.349173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8ef62b2d-e601-4786-aad0-44d628bdfab2 req-b7eafc50-93f4-41a6-b3b1-5a9f98086d8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080493 Oct 10 10:53:35.354795 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1612/3339] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:35.362428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:35.367329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:35.374486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:35.375448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:35.376250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:35.377222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:35.377948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:35.379516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:35.524949 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2642d03-0e8c-4f6a-8ac2-26d53210b436 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca" status: 202 len: 0 microversion: 2.1 time: 1.263453 Oct 10 10:53:35.529150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1728/3340] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:53:34 2022] DELETE /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:35.533927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:35.534736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:35.547628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:35.555907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:35.556380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:35.557460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:35.557939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:35.558368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.075402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:36.084795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:36.085035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-709b5d1a-2175-4df6-880a-faec447ebe7d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1496 microversion: 2.1 time: 0.554756 Oct 10 10:53:36.085545 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1729/3341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:35 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1496 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:36.099149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4701edb2-5329-4721-864c-6b70ef2d7587 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777829af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.110337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-114b8eee-508e-4234-897a-5478a6fcdc92 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1564 microversion: 2.1 time: 0.752954 Oct 10 10:53:36.111296 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1613/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:35 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1564 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:36.151296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777ae6ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.218110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4701edb2-5329-4721-864c-6b70ef2d7587 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.124793 Oct 10 10:53:36.219786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1730/3343] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:36 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:36.227845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:53:36.228756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 66ad2a68-70e7-41fd-a97e-28037bfafeca not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:53:36.229360 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.229360 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca HTTP/1.1 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '66ad2a68-70e7-41fd-a97e-28037bfafeca'} Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:53:36.231570 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6d05da4b-2ac1-41a2-bf54-c8e1964f761c'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:36.236014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-669b824c-0ec9-4252-83fb-99f39bb85148 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca" status: 404 len: 194 microversion: 2.1 time: 0.085899 Oct 10 10:53:36.238786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1614/3344] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:53:36 2022] GET /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:36.240857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.241486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:36.251292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.252665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:36.257081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.258345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.258797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.259664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.260192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.260673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.290352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.290926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.292479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.293220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.293691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.294126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.466148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:36.481054 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97b5a98f-bfd5-4ca0-b6ce-ff078114bd4c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1272 microversion: 2.1 time: 0.253399 Oct 10 10:53:36.484070 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1731/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:36 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:36.499229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a1c20c8-4ba0-47d3-a3df-a75f926d9f29 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777830550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.556896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21e6b5bd-0a00-45ff-a443-c5f63b843eef tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.318071 Oct 10 10:53:36.557611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1615/3346] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:53:36 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:36.562260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:36.562881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:36.574288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.575165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.575842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.576859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:36.577564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:36.578250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:36.986362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:37.009068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8eb1e1d-f642-4b08-ad88-e6c3f7daadde tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.449961 Oct 10 10:53:37.011270 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1616/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:36 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:37.115482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:37.116931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:37.131390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.132381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.133193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.142583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.143500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.144892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.498618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:37.509979 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f64a270-19db-4d50-9f94-70030cf8e597 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 200 len: 1454 microversion: 2.1 time: 0.402879 Oct 10 10:53:37.516494 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1617/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:37 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 1454 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:37.528815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42e5af13-93a2-435f-b6f8-8628cd8b1036 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c39eb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:37.565124 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a1c20c8-4ba0-47d3-a3df-a75f926d9f29 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6" status: 202 len: 0 microversion: 2.1 time: 1.079731 Oct 10 10:53:37.566284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1732/3349] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:53:36 2022] DELETE /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6 => generated 0 bytes in 1082 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:37.574457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87c0cf1-2c55-4c71-9409-c4aac3ca6d55", "name": "network-vif-deleted", "tag": "b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:37.624702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.627768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.635533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.656868 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42e5af13-93a2-435f-b6f8-8628cd8b1036 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.136435 Oct 10 10:53:37.661228 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1618/3350] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:37 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:37.670394 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] Creating event network-vif-deleted:b45d88aa-fac6-4f1b-ba93-2fbf3ce0940f for instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 on n-h1-860687-2 Oct 10 10:53:37.684865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b1d233-bf33-4817-b2a5-8a803b249f18", "name": "network-vif-plugged", "status": "completed", "tag": "b079f181-a34b-472c-91e5-81890fee6aa0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:37.694894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8a29a58d-fc53-44e2-a86d-ee0c00493e18 req-043f39ea-11f0-4f03-8c91-cd9c31df7465 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126505 Oct 10 10:53:37.698971 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1733/3351] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:37.716520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:37.717583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:37.718433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.719626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.725947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.738377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.747788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.748695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.751217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:37.751936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:37.764308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:37.775960 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] Creating event network-vif-plugged:b079f181-a34b-472c-91e5-81890fee6aa0 for instance b5b1d233-bf33-4817-b2a5-8a803b249f18 on n-h2-860687-2 Oct 10 10:53:37.791309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2d182ff2-183c-4fea-92a4-098785793c9e req-148ac3e9-7b6f-43ce-b00e-2f75782b1015 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127763 Oct 10 10:53:37.792321 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1619/3352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:37.829184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f677c462c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:38.342511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:53:38.343390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:53:38.343866 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.343866 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6 HTTP/1.1 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '495ba65d-ff3e-4663-b9b4-0f223749d1a6'} Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:53:38.346039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-6b4caa2d-dd77-4a34-a939-847196d23dd0'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:38.350529 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53b51f3d-cd90-4353-b790-e2602cb29196 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6" status: 404 len: 194 microversion: 2.1 time: 0.554132 Oct 10 10:53:38.369796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1620/3353] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:53:37 2022] GET /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6 => generated 194 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:38.392187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:38.394034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:38.406933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:38.409735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:38.410208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:38.411043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:38.412413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:38.413598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:38.665854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:38.673659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d7eb4e3e-fc78-4772-a203-07e786ed4fc4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.973411 Oct 10 10:53:38.674473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1734/3354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:37 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:38.679862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e796c292-fb50-4941-9c82-8b113122bb2f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67777d3700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:38.791857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:38.800005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34dd40a5-d4c5-44f3-a802-46cc204dc07e tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.429040 Oct 10 10:53:38.814287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1621/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:38 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:38.825062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:38.826307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:38.850974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:38.851515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:38.853508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:38.854421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:38.855111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:38.857789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:38.896171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 HTTP/1.1 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b87c0cf1-2c55-4c71-9409-c4aac3ca6d55'} Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:38.897717 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:38.902386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:38.911949 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5de0a855-e87c-43e3-bf82-f74d7704a9c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 404 len: 111 microversion: 2.1 time: 0.083542 Oct 10 10:53:38.912725 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1622/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:38 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:38.917705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:38.983686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:38.983686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:38.983686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.030571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] Creating event network-changed:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:53:39.043174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0c95485e-c687-4748-8f5d-fae018d41a4d req-6b5d910e-e9ef-4aba-a0d7-5c63dd5bee98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125141 Oct 10 10:53:39.044148 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1623/3357] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:39.056290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1e17898-7a0c-4ed7-9067-aaceb769eb5a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6780cf8e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.147021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1e17898-7a0c-4ed7-9067-aaceb769eb5a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.101610 Oct 10 10:53:39.147878 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1624/3358] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:39 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:39.155790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.159847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:39.172477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.180559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.181426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.182340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.182973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.183746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.246991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:39.289476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e796c292-fb50-4941-9c82-8b113122bb2f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92" status: 202 len: 0 microversion: 2.1 time: 0.613746 Oct 10 10:53:39.290065 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1735/3359] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:53:38 2022] DELETE /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:53:39.305488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67777e1ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.416684 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4a14f9a-8494-419d-99f8-519060d3bc0c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 204 len: 0 microversion: 2.1 time: 0.263254 Oct 10 10:53:39.418417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1625/3360] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:39 2022] DELETE /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:39.428295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.432821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:39.440970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.441536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.442110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.442837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.443347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.443967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.660508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:53:39.662535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:53:39.663656 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.663656 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92 HTTP/1.1 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '07e5c8fd-3ba3-41b1-8f51-778a70b62a92'} Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:53:39.667624 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] Oct 10 10:53:39.674034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:39.682144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:53:39.682144 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-81277cbd-6d16-4b42-8530-ff9035d5914f'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:39.684012 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e7ea6da5-0409-472a-a2f4-06a83bdbd2e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92" status: 404 len: 194 microversion: 2.1 time: 0.386265 Oct 10 10:53:39.685153 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1736/3361] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:53:39 2022] GET /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92 => generated 194 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:39.702652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd90784f-9b67-40ba-9306-a936205e8a59 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67777e1f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.733184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:39.747056 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eabe8e5f-0bc1-4139-9226-4f2bf42e8a2e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1496 microversion: 2.1 time: 0.323228 Oct 10 10:53:39.747858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1626/3362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:39 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1496 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:39.752738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:39.757275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:39.769581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.772777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.773422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.774437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:39.775093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:39.775802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:39.989179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:40.002143 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-380df38b-2f05-49e9-9cbf-4295b20510a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.252953 Oct 10 10:53:40.003237 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1627/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:39 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:40.008885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f", "tag": "373f9694-a97f-42b3-9360-a2710261c365"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:40.021088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:40.022674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:40.023358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:40.039510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] Creating event network-changed:373f9694-a97f-42b3-9360-a2710261c365 for instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f on n-h2-860687-2 Oct 10 10:53:40.046097 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e32956da-58f6-4bf2-bc2f-dedf629cb08f req-247b7429-86ff-4a23-bf09-bfe2adf67093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041432 Oct 10 10:53:40.047391 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1628/3364] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:40.054602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:40.056193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:40.067016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:40.068434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:40.069379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:40.070558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:40.071374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:40.072409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:40.105288 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd90784f-9b67-40ba-9306-a936205e8a59 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.415925 Oct 10 10:53:40.106019 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1737/3365] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:53:39 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:40.127873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42135f72-1590-4d0c-8e94-5d036fc19f84 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6777852ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2032253834", "description": "tempest-description-94359556"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:40.343411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:40.360499 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3ef6187-4437-45be-b252-cddee2e41790 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1523 microversion: 2.1 time: 0.311615 Oct 10 10:53:40.362518 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1629/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:40 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:40.380820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bc8dc36-53b9-4c37-860e-7570556b6be6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cd95b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:40.468895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bc8dc36-53b9-4c37-860e-7570556b6be6 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1455 microversion: 2.1 time: 0.105142 Oct 10 10:53:40.483344 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1630/3367] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:40 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:40.497692 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42135f72-1590-4d0c-8e94-5d036fc19f84 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.375545 Oct 10 10:53:40.498585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1738/3368] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:40.520883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35a73005-0e0a-4f30-9172-48cf288606fe tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6780cf8820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1160902166", "description": "tempest-description-552927738"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:40.754188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:40.781850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:40.782515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:40.803841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35a73005-0e0a-4f30-9172-48cf288606fe tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.288527 Oct 10 10:53:40.804449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:40.805279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:40.805656 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1631/3369] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:53:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:40.806118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:40.807114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:40.807752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:40.808370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:41.032422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:41.033131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:41.045335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:41.047098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:41.048004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:41.067837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:41.068342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:41.068977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:41.359533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:42.186870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:42.196624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f3b09d2-6104-4bef-9b65-748083a80f2f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 200 len: 1496 microversion: 2.1 time: 1.424191 Oct 10 10:53:42.197217 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1739/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:40 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 1496 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:42.223835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-724395489", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "6c23d851-00be-46d7-bf0e-2ac8fd1fc196"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:42.259567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:42.273616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59a74b0b-96b1-479d-b198-7a909031a823 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 1.246210 Oct 10 10:53:42.293267 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1632/3371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:41 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:42.306136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:42.306777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:42.341433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:42.343264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:42.344607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:42.346977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:42.347663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:42.349052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:42.365782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] validate_networks() for [('6c23d851-00be-46d7-bf0e-2ac8fd1fc196', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:42.904320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:42.921723 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99d3492a-83d3-4d87-abc3-1dddcdb32658 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1508 microversion: 2.1 time: 0.626081 Oct 10 10:53:42.922349 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1633/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:42 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1508 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:42.930223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3cea91e-e586-4f49-bcb5-c611e7cfa9a0 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777acfc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:42.992543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3cea91e-e586-4f49-bcb5-c611e7cfa9a0 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1464 microversion: 2.1 time: 0.067882 Oct 10 10:53:43.002417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1634/3373] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:42 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:43.008496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fac89db-b9ce-4b1e-965a-2e3e3641b01d", "name": "network-vif-deleted", "tag": "8d39a1e0-8fef-495f-a172-9e07645f2bc2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:43.017984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.018535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.019059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.032541 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] Creating event network-vif-deleted:8d39a1e0-8fef-495f-a172-9e07645f2bc2 for instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d on n-h2-860687-2 Oct 10 10:53:43.040449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-94f9a8f9-11a4-47e7-9180-bec5d96e0cde req-8bcfba0c-69cf-41a6-af45-4e50fa586635 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 Oct 10 10:53:43.045873 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1635/3374] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:43.051262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.052779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.061722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.062562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.063205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.064147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.064612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.065524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.373721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:43.385172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:43.386140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:43.386650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:43.387321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:43.387747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:43.389127 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b1b7085-6f03-441f-b976-76c725a97baa tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 200 len: 1508 microversion: 2.1 time: 0.341954 Oct 10 10:53:43.389796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1636/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:43.394817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d3847d8-2ad4-499e-9f47-1964cdb867dc tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677cadea60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.399459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.400220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.400914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.402120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.402810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.404644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.422727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Getting quotas for project 0e59b8262d82433a902c54c840251330. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:43.428559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Getting quotas for user 7ae91e3c6d1148b1b67838994ec1240b and project 0e59b8262d82433a902c54c840251330. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:43.443657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:43.446052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:43.449246 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d3847d8-2ad4-499e-9f47-1964cdb867dc tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 200 len: 1464 microversion: 2.1 time: 0.058086 Oct 10 10:53:43.455807 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1637/3376] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 1464 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:43.461392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.462232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.468901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.469387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.469820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.470538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.470987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.471434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.475701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:43.488147 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d HTTP/1.1 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1fac89db-b9ce-4b1e-965a-2e3e3641b01d'} Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:43.490439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f0ed5ae-0c16-49fd-b342-5a8d0b16bde0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 404 len: 111 microversion: 2.1 time: 0.035825 Oct 10 10:53:43.495548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1638/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:43.500384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.501056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.508202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.508808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.509337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.510140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.510689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.511239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.529109 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12a7197c-6a2b-440e-a206-38abd035a481 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326331 Oct 10 10:53:43.531440 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1740/3378] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:43.544975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.547241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.556773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.557536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.558228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.559380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.560050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.560684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.617879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:43.708218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:43.718259 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cc8c261-22a8-4a44-95ca-591a89bd7550 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.221241 Oct 10 10:53:43.718467 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f02f134-81c6-4d18-a261-df20f6aeb3e1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 204 len: 0 microversion: 2.1 time: 0.185436 Oct 10 10:53:43.719198 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1741/3379] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:43 2022] DELETE /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:43.731700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1639/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:43.741306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.741558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2e312a2-5ac0-4e16-9cf8-4873d01ebe14 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:43.742323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2e312a2-5ac0-4e16-9cf8-4873d01ebe14 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.742696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:43.751047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.751891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.752535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.753545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:43.754265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:43.754963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:43.828557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2e312a2-5ac0-4e16-9cf8-4873d01ebe14 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:43.860006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2e312a2-5ac0-4e16-9cf8-4873d01ebe14 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1215 microversion: 2.1 time: 0.104526 Oct 10 10:53:43.874341 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1640/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:43.883408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1093336861", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:43.978109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:44.013649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:44.022355 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e2790b5-071b-4803-9362-f4896bbee285 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1466 microversion: 2.1 time: 0.289272 Oct 10 10:53:44.022946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1742/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:43 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1466 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:44.033433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-293980643", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "83b4380d-603f-4590-b49d-99b71035f3ea"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:44.153266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] validate_networks() for [('83b4380d-603f-4590-b49d-99b71035f3ea', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:44.811618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:44.812745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:44.814128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:44.814978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:44.815650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:44.829415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:44.830930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:44.831483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:44.832636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:44.833175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:44.833785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:44.856231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:44.863060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:44.879620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:44.882224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:44.913545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:53:44.914600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:53:44.915162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:53:44.915847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:53:44.916518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:53:44.925489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:44.926154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:44.927408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:44.928159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:44.930390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa679afd-ee37-41a5-8546-4d3459a56a9a tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054961 Oct 10 10:53:44.931324 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1641/3383] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:44.936825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e8dd955-2f3d-4cdd-b4ce-37dc48f254cd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c44eaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:44.938968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:44.939583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:44.967996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:53:44.974192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Getting quotas for user 129b6fe8d95645568c521e13faa798c2 and project 84eea22787884c498d0728bc2707ad6c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:53:44.988306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:53:44.991381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:53:45.046524 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dcac31dc-3569-424e-bcf2-678209ef8dbc tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018793 Oct 10 10:53:45.054186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1743/3384] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:53:45.059404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.060038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:45.068032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:45.068532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:45.068970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:45.069674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:45.070132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:45.070560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:45.088371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e8dd955-2f3d-4cdd-b4ce-37dc48f254cd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-10T10%3A51%3A39Z" status: 200 len: 1902 microversion: 2.1 time: 0.144401 Oct 10 10:53:45.089105 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1642/3385] 10.222.0.16 () {58 vars in 1199 bytes} [Mon Oct 10 10:53:44 2022] GET /compute/v2.1/images?changes-since=2022-10-10T10%3A51%3A39Z => generated 1902 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:45.102262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.103170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:45.135366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:45.136948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:45.138053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:45.138815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:45.139638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:45.140393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:45.339476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:45.362863 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e692c84b-abf1-424f-a167-7badaf57f652 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.307414 Oct 10 10:53:45.370980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1744/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:45.385609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1c726a9-b8cc-4e73-802a-1cbbb7212fb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.385609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1c726a9-b8cc-4e73-802a-1cbbb7212fb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:45.438351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:45.446692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18092a30-5cf9-47eb-9582-f7102a32240d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1267 microversion: 2.1 time: 0.356061 Oct 10 10:53:45.450377 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1643/3387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:45.458925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5ef925e-c3b6-4fe1-934c-79a8dc159613 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.459585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5ef925e-c3b6-4fe1-934c-79a8dc159613 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:45.618474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f1c726a9-b8cc-4e73-802a-1cbbb7212fb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:45.633218 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1c726a9-b8cc-4e73-802a-1cbbb7212fb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1209 microversion: 2.1 time: 0.261077 Oct 10 10:53:45.634252 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1745/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:45.649528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0052ac9d-bbf0-4b6c-aff6-749ef9756bdd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677787af70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.655171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5ef925e-c3b6-4fe1-934c-79a8dc159613 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:45.668060 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5ef925e-c3b6-4fe1-934c-79a8dc159613 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1217 microversion: 2.1 time: 0.216550 Oct 10 10:53:45.680865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1644/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:45.754666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0052ac9d-bbf0-4b6c-aff6-749ef9756bdd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1904883208" status: 200 len: 485 microversion: 2.1 time: 0.118874 Oct 10 10:53:45.755935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1746/3390] 10.222.0.16 () {58 vars in 1231 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1904883208 => generated 485 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:45.770225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-592185e6-a33e-4b7c-9f33-95e4ddc3d9a1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777aa1820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.896862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-592185e6-a33e-4b7c-9f33-95e4ddc3d9a1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?server=835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 957 microversion: 2.1 time: 0.130276 Oct 10 10:53:45.907129 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1645/3391] 10.222.0.16 () {58 vars in 1209 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/images?server=835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 957 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:45.912406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-244ae932-215a-412b-84f1-685b5c183102 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778225e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:45.982511 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-244ae932-215a-412b-84f1-685b5c183102 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 485 microversion: 2.1 time: 0.074365 Oct 10 10:53:45.983439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1747/3392] 10.222.0.16 () {58 vars in 1317 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:45.995991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d902e7fe-bac1-433b-ae9c-2d011948b3f8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777a8fa60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.037528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-unplugged", "status": "completed", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:46.054950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.055472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.055907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.060621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d902e7fe-bac1-433b-ae9c-2d011948b3f8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 485 microversion: 2.1 time: 0.068285 Oct 10 10:53:46.070607 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1646/3393] 10.222.0.16 () {58 vars in 1303 bytes} [Mon Oct 10 10:53:45 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 485 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:46.077183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa2ae060-c347-4d31-b284-0e6eb41c9525 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777aa1dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.088142 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] Creating event network-vif-unplugged:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:53:46.094498 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7fc28c1e-1b77-4ff8-8d5e-535017e4d768 req-1c20a057-4f4b-4c1b-b74e-504a68e62870 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061701 Oct 10 10:53:46.096001 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1748/3394] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:46.231552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa2ae060-c347-4d31-b284-0e6eb41c9525 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.159317 Oct 10 10:53:46.232367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1647/3395] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:46.249541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9d1cf90-5cd0-4aef-8df8-f672fc4506a8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777863700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.358554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9d1cf90-5cd0-4aef-8df8-f672fc4506a8 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.113513 Oct 10 10:53:46.359485 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1749/3396] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:46.374488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03e3f1c4-a189-4eef-9b52-cc5db837b330 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777ab0940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.396880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.399989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:46.411191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.412368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.412817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.413544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.416465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.417003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.421945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:46.453905 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03e3f1c4-a189-4eef-9b52-cc5db837b330 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.083929 Oct 10 10:53:46.454966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1648/3397] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:46.472341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88bba220-7d14-4f12-9628-01d36a9efe05 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777acfc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.587019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88bba220-7d14-4f12-9628-01d36a9efe05 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-10T10%3A51%3A30Z" status: 200 len: 6333 microversion: 2.1 time: 0.118745 Oct 10 10:53:46.587751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1649/3398] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-10T10%3A51%3A30Z => generated 6333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:46.593171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.594599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:46.603214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.604187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.604844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.605522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.605980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.606411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.882479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:46.900351 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-328761c7-2787-4ed2-871a-eb30c808545e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1273 microversion: 2.1 time: 0.311222 Oct 10 10:53:46.901933 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1650/3399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:46.907359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6cca324-bb9c-4826-934f-a2e00e7f0224 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777a8fc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.967885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6cca324-bb9c-4826-934f-a2e00e7f0224 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1904883208" status: 200 len: 665 microversion: 2.1 time: 0.064761 Oct 10 10:53:46.968774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1651/3400] 10.222.0.16 () {58 vars in 1252 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1904883208 => generated 665 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:46.974412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:46.975574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:46.987311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.987992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.988836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:46.989732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:46.990475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:46.991103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:47.196513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:47.211158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4baf038-d4e1-4dd3-a0a8-0635a300a8a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1261 microversion: 2.1 time: 0.240970 Oct 10 10:53:47.215999 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1652/3401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:47.218890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.219590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:47.230541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:47.231135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:47.231760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:47.232606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:47.233473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:47.233968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:47.383683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:47.391523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aaf89f6e-f523-49ac-8d60-0eaf14e3ecdc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 1.002614 Oct 10 10:53:47.392106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1750/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:46 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:47.397353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00f3a075-820b-474e-837f-dd3dad9ac8dd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778d9430>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.431155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:47.438988 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43328b8a-daeb-40bf-82bb-5d47ab0eba21 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1275 microversion: 2.1 time: 0.225744 Oct 10 10:53:47.451847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1653/3403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:47.468490 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00f3a075-820b-474e-837f-dd3dad9ac8dd tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1467 microversion: 2.1 time: 0.074748 Oct 10 10:53:47.469321 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1751/3404] 10.222.0.16 () {58 vars in 1338 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1467 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:47.485809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d77ea9a4-211f-4a79-a607-88f3a2512266 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777aa4a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.543248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d77ea9a4-211f-4a79-a607-88f3a2512266 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1467 microversion: 2.1 time: 0.061230 Oct 10 10:53:47.544849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1654/3405] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2Fea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1467 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:47.561342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61519b06-b2d8-49fe-8e1b-7fa82e3aca92 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67777e18b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.701617 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61519b06-b2d8-49fe-8e1b-7fa82e3aca92 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.144301 Oct 10 10:53:47.702567 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1752/3406] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:47.728145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea6cca9b-3972-4c4b-a1a3-b85cf4e3e85e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c050670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.772075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b1d233-bf33-4817-b2a5-8a803b249f18", "name": "network-vif-deleted", "tag": "b079f181-a34b-472c-91e5-81890fee6aa0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:47.812837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:47.813337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:47.813769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:47.846820 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea6cca9b-3972-4c4b-a1a3-b85cf4e3e85e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.125091 Oct 10 10:53:47.847729 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1655/3407] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:47.864330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] Creating event network-vif-deleted:b079f181-a34b-472c-91e5-81890fee6aa0 for instance b5b1d233-bf33-4817-b2a5-8a803b249f18 on n-h2-860687-2 Oct 10 10:53:47.872315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a4d8b42-b43a-4626-8aa7-d4c7f75b3759 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677c050dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.884397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-88f3a29e-6e32-42b2-a7c4-55f46ef73f80 req-b6ec59ff-b97b-4b7b-8858-0ad3d21c0e9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117986 Oct 10 10:53:47.885808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1753/3408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:47.936330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.939878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:47.947589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a4d8b42-b43a-4626-8aa7-d4c7f75b3759 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c" status: 200 len: 784 microversion: 2.1 time: 0.084461 Oct 10 10:53:47.948909 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1656/3409] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/b0df75aa-6a93-408c-bf0f-07593ca7536c => generated 784 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:47.972092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67e13cc0-a7d0-4ec7-bde4-2b88e2baade4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777aa45e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:47.974758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:47.975993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:47.979655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:47.983526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:47.985160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:47.987311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:48.077640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67e13cc0-a7d0-4ec7-bde4-2b88e2baade4 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.115443 Oct 10 10:53:48.092119 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1657/3410] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:48.108610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a86c2be-a59b-4389-8e33-328781a3539a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f6777a81ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:48.257101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:48.268742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1f59ac87-fc4d-4de1-9bcd-6e31f2c420f2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1273 microversion: 2.1 time: 0.344421 Oct 10 10:53:48.275783 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1754/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:47 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:48.291633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:48.292295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:48.311572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:48.314378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:48.314875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:48.315341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:48.316051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:48.320976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:48.322202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:48.539190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:48.553059 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f7b569d-2a8e-46e2-bc77-3d97515b3a62 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1267 microversion: 2.1 time: 0.274624 Oct 10 10:53:48.555359 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1755/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:48 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:48.566194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:48.567804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:48.582055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:48.583441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:48.585521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:48.588212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:48.589212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:48.591940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.016297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:49.028830 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7cd4fb25-90d2-44fc-ad57-c4b99d5d7921 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.469485 Oct 10 10:53:49.029823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1756/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:48 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:49.045957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:49.049921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:49.067908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.070343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.073163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.084903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.085752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.086533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.225941 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a86c2be-a59b-4389-8e33-328781a3539a tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6" status: 204 len: 0 microversion: 2.1 time: 1.128409 Oct 10 10:53:49.226547 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1658/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:48 2022] DELETE /compute/v2.1/images/d8da4329-995f-46b5-bd30-309c42125ce6 => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:49.268201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:49.281695 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-531c76ad-83b1-48d4-bb7a-8ab593b2c856 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1275 microversion: 2.1 time: 0.248089 Oct 10 10:53:49.282328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1757/3415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:49 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:49.293393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2250513c-8c61-4262-82cb-b7cadada5975 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67778f3310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:49.649668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:49.650239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:49.661279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.663996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.669813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.670701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.672954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.672954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.720827 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2529454e-7841-4c49-a000-22e9d049a0d3 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/ips" status: 200 len: 152 microversion: 2.20 time: 0.492908 Oct 10 10:53:49.728586 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1659/3416] 10.222.0.16 () {60 vars in 1289 bytes} [Mon Oct 10 10:53:49 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/ips => generated 152 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:53:49.737861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:49.738482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:49.761369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.761865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.762299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:49.763017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:49.763483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:49.763908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:50.192954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2250513c-8c61-4262-82cb-b7cadada5975 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015" status: 204 len: 0 microversion: 2.1 time: 0.909415 Oct 10 10:53:50.194442 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1758/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:49 2022] DELETE /compute/v2.1/images/9b28b844-ee14-4574-b189-3143bd258015 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:50.201891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:50.205069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:50.242493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:50.243066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:50.243536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:50.244282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:50.244748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:50.245184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:50.586485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:50.594877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f267ecc7-3ad7-424e-a97a-fbf0276bd66a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.865164 Oct 10 10:53:50.607628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1660/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:49 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:50.611668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:50.611837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:50.630844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:50.631937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:50.633371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:50.636708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:50.637417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:50.639029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:50.769444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:50.778491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e6d6c8b-fdf2-496e-aa46-9efa83b0ac67 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.582382 Oct 10 10:53:50.791813 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1759/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:50 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:50.806967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65d3466c-1614-4840-b04e-4b484f74100e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677780b9d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:51.240700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:51.252125 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60226f6a-6a8b-431e-943d-6613be85f01d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.644647 Oct 10 10:53:51.267402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1661/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:50 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:51.274364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:51.275183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:51.283110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.283820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.284429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.285282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.286452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.287070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.570655 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65d3466c-1614-4840-b04e-4b484f74100e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429" status: 204 len: 0 microversion: 2.1 time: 0.776646 Oct 10 10:53:51.573556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1760/3421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:50 2022] DELETE /compute/v2.1/images/a58d9f62-acc9-47fc-98af-55bfff92e429 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:51.583370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f", "name": "network-vif-plugged", "status": "completed", "tag": "373f9694-a97f-42b3-9360-a2710261c365"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:51.618841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.628301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.628623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.641089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:51.650039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-babdef62-1926-4ee6-8912-aa78f18d90cb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.381162 Oct 10 10:53:51.656259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] Creating event network-vif-plugged:373f9694-a97f-42b3-9360-a2710261c365 for instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f on n-h2-860687-2 Oct 10 10:53:51.670816 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1662/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:51 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:51.672826 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-27bc2599-4370-486c-8578-8a5e9dcb3885 req-7644d5a2-bcc1-4d82-bceb-ea2d3a9cce50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097751 Oct 10 10:53:51.677217 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1761/3423] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:51.680413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c672629-1905-4baa-a014-3989e9de40d1", "tag": "92b679eb-e320-40b7-99a9-5ac8df0ad5ef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:51.688632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:51.693209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:51.699355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:51.701684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.702202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.715338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.716305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.716884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.719265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.720045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.724067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.725335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.753817 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] Creating event network-changed:92b679eb-e320-40b7-99a9-5ac8df0ad5ef for instance 7c672629-1905-4baa-a014-3989e9de40d1 on n-h1-860687-2 Oct 10 10:53:51.767720 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0270fc29-ef26-4c22-885c-7894c2a562ac req-afc8070b-2c1e-4b03-84df-4425af21509e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094373 Oct 10 10:53:51.768613 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1663/3424] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:51.786724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:51.787104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:51.788307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:51.796890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.797423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.797918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:51.798683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:51.799194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:51.799618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.021324 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf816cf9-652f-4261-9148-08436594d970 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 204 len: 0 microversion: 2.1 time: 0.342187 Oct 10 10:53:52.021972 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1762/3425] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:51 2022] DELETE /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:52.027729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:52.028701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:52.064734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.069219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.069941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.071349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.072984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.073490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.303613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:52.323385 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a401de8d-d556-4689-bae9-9e4ce6081538 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.551465 Oct 10 10:53:52.324251 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1664/3426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:51 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:52.335351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:52.336251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:52.352073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.360089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.360949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.361983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.362632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.363275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.476496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:52.484607 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93db8a92-ba46-4db6-8cf7-3f498f75b729 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.461193 Oct 10 10:53:52.485431 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1763/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:52 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:52.490800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acdef82c-fbaf-4940-95bc-f23d9bb1e08c", "tag": "193a32fe-847a-4203-9013-bae29cfca957"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:52.500550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.501297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.501916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.515941 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] Creating event network-changed:193a32fe-847a-4203-9013-bae29cfca957 for instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c on n-h1-860687-2 Oct 10 10:53:52.521453 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8f981e2e-9b34-496c-9da8-787c7270adb1 req-28a40129-6cca-4a19-a91d-8a6ad11ae26b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034705 Oct 10 10:53:52.522502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1764/3428] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:52.528372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:52.529084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:52.541825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.542325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.542951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.543854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.544504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.545097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.652232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:52.660006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea375596-5095-4b0f-b7b3-a84ac17b3ecb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1473 microversion: 2.1 time: 0.334526 Oct 10 10:53:52.661061 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1665/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:52 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:52.698624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:52.700195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:52.712348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.713904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.714575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.717423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:52.720205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:52.720903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:52.897984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:52.907962 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d0558ac-2cb7-4a91-a6c9-293c6a968303 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1314 microversion: 2.1 time: 0.383723 Oct 10 10:53:52.908556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1765/3430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:52 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:52.987931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:52.997322 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3f05051-791a-4c1d-b339-3b4717f8d508 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.311361 Oct 10 10:53:52.998314 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1666/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:52 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:53.346517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:53.347196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:53.352102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:53.352717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:53.355525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.356020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.356644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.357373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.357988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.358421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.359711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.362476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.363070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.363912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.364447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.364946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.393196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lazy-loading 'flavor' on Instance uuid e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:53:53.532443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:53.541417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3892455e-c03c-4d32-867e-582457e52f6b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.198617 Oct 10 10:53:53.542386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1766/3432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:53 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:53.547680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:53.548287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:53.554716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.555237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.555930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.556843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.557393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.557886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.656295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-504f2e6c-116d-4fbf-b840-be418c82e6b4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/action" status: 202 len: 0 microversion: 2.20 time: 0.307954 Oct 10 10:53:53.657452 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1667/3433] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:53:53 2022] POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:53.672411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:53.674220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:53.683751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.684247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.685514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.686254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.686711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.687416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.712604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:53.721232 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e0ba8ff-55f3-4016-8a74-7f44945e844c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.176996 Oct 10 10:53:53.721818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1767/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:53 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:53.726772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:53.727406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:53.733540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.734026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.734459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:53.735254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:53.735881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:53.736477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.260353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.269351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.271173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.272549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7531c3c0-e120-4b48-9c63-0dfadc7ed9e7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.609447 Oct 10 10:53:54.287727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.288919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1668/3435] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:53 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:53:54.289631 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84a87288-9797-423d-b535-20d21d40826e tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1473 microversion: 2.1 time: 0.566813 Oct 10 10:53:54.290259 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1768/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:53 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:54.296197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.297025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.297608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.298237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.304995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.305591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.306121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.306351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.306662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.307231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.307575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.307904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.308365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.309036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.309768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.310501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.313527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:54.544923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.556613 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8d6515f-0b9e-4aeb-a10a-27f010310544 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.264254 Oct 10 10:53:54.557423 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1769/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:54 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:54.559786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.564470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ffecef-8597-4c5b-b7d1-23c5f6bb2902", "tag": "6c9214ea-b1ae-4863-a551-912e0079beb4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:54.569499 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99e80e8a-c261-4f0d-94b8-8d162af890d3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1500 microversion: 2.1 time: 0.279470 Oct 10 10:53:54.570470 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1669/3438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:54 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1500 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:54.580769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.581524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.581883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.583489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.583962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.592965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.593592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.594032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.594727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.595219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.595640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.596482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] Creating event network-changed:6c9214ea-b1ae-4863-a551-912e0079beb4 for instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 on n-h1-860687-2 Oct 10 10:53:54.605447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6f908a3d-a016-4527-8a8b-5a368db687f1 req-ba48b1a6-1f89-4e95-895f-f41b35484d67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046604 Oct 10 10:53:54.606206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1770/3439] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:53:54.611321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.612124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.619333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.619828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.620269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.620971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.622159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.622547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.650921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:54.653987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:54.756057 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c09370e3-7c5a-4384-a5cd-bb05af372c0c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 204 len: 0 microversion: 2.1 time: 0.148597 Oct 10 10:53:54.758121 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1771/3440] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:54 2022] DELETE /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:54.764774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.765757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.772373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.773471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.774401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.775471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.776090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.776676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:54.844224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:54.955757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:54.966927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:54.977191 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6369f154-80a4-4690-8607-caabcb32ceee tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.405428 Oct 10 10:53:54.978178 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1670/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:54 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:54.984570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:54.985723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:54.995632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:54.996063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:54.996503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.000896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.001656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.002289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.228378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.239082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f77364bc-03b3-4294-a4b6-5246c903e308 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.477890 Oct 10 10:53:55.255098 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1772/3442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:54 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:55.305700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:55.306426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:55.313463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.314047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.314592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.315661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.316335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.316720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.492391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.502692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1740ad4-9246-46cb-bfa1-db0d3ba988c2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1506 microversion: 2.1 time: 0.522607 Oct 10 10:53:55.510984 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1671/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:54 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:55.517810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:55.518819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:55.526149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.526896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.527364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.528230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.528835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.529362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.625571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=14 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:55.659809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:53:55.724564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.734834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.736715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.738188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1efe7f86-68d4-4d34-8d7a-444168aa92fb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.440353 Oct 10 10:53:55.770670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1773/3444] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:55 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:53:55.781716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:55.782612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:55.790593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.791420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.792065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.792959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:55.793583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:55.794168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:55.919545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:55.953376 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23117e17-08b3-4f92-a03d-8374d3b1d1ac tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1473 microversion: 2.1 time: 0.440671 Oct 10 10:53:55.955724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1672/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:55 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:56.000414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:56.001116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:56.010674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.011204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.011769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.012507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.012964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.013387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.031059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:56.062561 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4bf9c07e-5659-43fd-9556-86fd6f200e73 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.282443 Oct 10 10:53:56.063320 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1774/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:55 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:56.076724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1cae6d-cdab-4da1-a40e-76f423f50903", "name": "network-vif-deleted", "tag": "3fb3eec8-ee22-422c-ae0a-de4cac573f82"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:56.087526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.088306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.088922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.103542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] Creating event network-vif-deleted:3fb3eec8-ee22-422c-ae0a-de4cac573f82 for instance ea1cae6d-cdab-4da1-a40e-76f423f50903 on n-h1-860687-2 Oct 10 10:53:56.108867 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ccf78f22-e90b-4b32-99b3-c9f3acf6285c req-45739f2a-89f3-44f5-8199-e5c001fdfc32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035938 Oct 10 10:53:56.110679 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1775/3447] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:56.222788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c672629-1905-4baa-a014-3989e9de40d1", "name": "network-vif-plugged", "status": "completed", "tag": "92b679eb-e320-40b7-99a9-5ac8df0ad5ef"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:56.232691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.233256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.233760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.248691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] Creating event network-vif-plugged:92b679eb-e320-40b7-99a9-5ac8df0ad5ef for instance 7c672629-1905-4baa-a014-3989e9de40d1 on n-h1-860687-2 Oct 10 10:53:56.260050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-da0daed0-0374-4e14-a412-0bf8567af8f3 req-f9a843e8-da1f-45de-bd88-1c58213b2f07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 Oct 10 10:53:56.260773 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1776/3448] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:56.269489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:56.271159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:56.280352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.281186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.281629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.282535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.283011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.283442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.367941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:56.379628 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10d8a961-4ee4-4963-ae84-b2598b1d2290 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.380375 Oct 10 10:53:56.380610 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1673/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:55 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:56.525775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:56.526389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:56.532750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.533237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.533674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.534367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.534824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.535396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.675475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:56.684430 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf4d9a99-29a9-4f62-8b8e-3deeff31dad6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.422232 Oct 10 10:53:56.685005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1777/3450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:56 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:56.764638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:56.765256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:56.771748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.772263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.772673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.773370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:56.773828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:56.774252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:56.997949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.006328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12a1e13e-525a-4915-af30-0187800fb183 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1506 microversion: 2.1 time: 0.484380 Oct 10 10:53:57.007096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1674/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:56 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:57.011828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:57.012427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:57.018068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.018551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.018981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.019962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.020618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.021140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.111363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.120039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92f41dc5-b4b3-421e-ab6c-1bfc7987eb86 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1303 microversion: 2.1 time: 0.111979 Oct 10 10:53:57.120631 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1675/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:57 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:57.125096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:57.125711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:57.131684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.132167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.132607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.133307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.133761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.134199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.166181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.176847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.178323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.179895 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-91b5cc3a-5fa0-4687-bd49-8203e8631941 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.419284 Oct 10 10:53:57.180466 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1778/3453] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:56 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:53:57.392221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f", "name": "network-vif-deleted", "tag": "373f9694-a97f-42b3-9360-a2710261c365"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:57.425289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.435230 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46909b27-8257-4ed6-aa39-72e396dbf204 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.313508 Oct 10 10:53:57.447658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.449484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.450398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.462312 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1676/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:57 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:57.468668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:57.470579 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] Creating event network-vif-deleted:373f9694-a97f-42b3-9360-a2710261c365 for instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f on n-h2-860687-2 Oct 10 10:53:57.475349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:57.480449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a43ab3f1-a34c-4eda-881a-b70b575d7f11 req-bce641e4-f1a5-4e27-aa78-9dff22cb7fac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093538 Oct 10 10:53:57.481959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1779/3455] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:53:57.487724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.488223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.489371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.490450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.490915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.491545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.654708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:57.663897 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21e92d69-a965-42eb-b299-776cad003cb1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.200023 Oct 10 10:53:57.664471 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1677/3456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:57 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:57.709177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:57.709877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:57.716344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.716844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.717243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:57.717931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:57.718382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:57.718807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.009593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.017566 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4dfaddb3-630a-4fdc-86a4-8e0619b2dfd8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.312912 Oct 10 10:53:58.018146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1780/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:57 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:58.039361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:58.039986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:58.048264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.048992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.049628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.050497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.051708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.052289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.089970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.091054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.091699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.092154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'fault' on Instance uuid 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:53:58.146797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:58.147725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:58.159308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.160200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.162007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.165609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.166367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.167245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.214064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.214765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.215552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.216736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lazy-loading 'fault' on Instance uuid ea1cae6d-cdab-4da1-a40e-76f423f50903 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:53:58.232615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.247357 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-821a67db-478b-4076-8ccf-ec7aa4a84246 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 200 len: 1304 microversion: 2.1 time: 0.217685 Oct 10 10:53:58.251345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1678/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:58 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 1304 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:58.262118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:58.268949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:58.280771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.281491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.282111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.283543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.284784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.285915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.295202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.312072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d76ec3cc-0cf6-456c-aa0f-f1d279afaa34 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 200 len: 1308 microversion: 2.1 time: 0.171470 Oct 10 10:53:58.330946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1781/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:58 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:53:58.461993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.464043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:58.465063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:58.473361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.475288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.476494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b817a70c-2872-4148-8d34-e77ac56de245 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.222868 Oct 10 10:53:58.476791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.477431 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1679/3460] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:58 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:58.477743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.478414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.479391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.480063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.480701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.632944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.641521 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98d52a26-9650-4647-974a-d684e147802c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.182667 Oct 10 10:53:58.643079 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1782/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:58 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:58.691663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:58.693095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:58.701861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.702338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.702962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.703688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:58.704380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:58.704901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:58.914457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:58.922673 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bf02b38-b6c6-42c7-b639-1142903c5d76 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.236942 Oct 10 10:53:58.923233 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1680/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:58 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:59.044266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.044913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.062079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.062579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.063051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.063764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.064225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.065734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.275873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.276696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.283301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.283799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.290046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.294643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.300894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.301664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.338053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:59.349649 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f HTTP/1.1 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f'} Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:59.351482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.358085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:59.359213 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9771b6c-05cf-416f-bdff-7820f735a36d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1309 microversion: 2.1 time: 0.318285 Oct 10 10:53:59.360750 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1783/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:59 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:53:59.370628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.371779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: ea1cae6d-cdab-4da1-a40e-76f423f50903] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.384107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.384874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.386204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.387581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.388272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.389799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.396048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9ba22e1-9d31-4269-9696-684cca77812a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 404 len: 111 microversion: 2.1 time: 0.083297 Oct 10 10:53:59.401430 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1681/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:59 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:53:59.420051 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] HTTP exception thrown: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Request method failure captured: Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 HTTP/1.1 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kwIPv65kqBAgfmV4EDlgQCF6sp5gi3ilXZG0JUvmDA-PQnrbU90DoyNXHcec5vxJfzaQPAnQBcrrrz9HDUARJhNUAjNrzm9AMKms39rTF3G77VBm5uzNv_8Mnp6FtSez8Av9PrJOIYdjzNeeW-oPnkNPQqeBN7VvENWj-H-p987mM Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d52c9284c44f4f6ab6e782cf2b294bcd Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d52c9284c44f4f6ab6e782cf2b294bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d52c9284c44f4f6ab6e782cf2b294bcd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d52c9284c44f4f6ab6e782cf2b294bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d52c9284c44f4f6ab6e782cf2b294bcd"}]}] Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d52c9284c44f4f6ab6e782cf2b294bcd Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListImageFiltersTestJSON-1082536848-project Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ebc20917b184775bf16d3031f597e13 Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListImageFiltersTestJSON-1082536848-project Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'ea1cae6d-cdab-4da1-a40e-76f423f50903'} Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:53:59.422460 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Returning 404 to user: Instance ea1cae6d-cdab-4da1-a40e-76f423f50903 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:53:59.429513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6bd691bb-ceae-4eb3-aa31-16165aefc647 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903" status: 404 len: 111 microversion: 2.1 time: 0.066486 Oct 10 10:53:59.430550 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1784/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:59 2022] GET /compute/v2.1/servers/ea1cae6d-cdab-4da1-a40e-76f423f50903 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:53:59.438397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.438823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.446458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.447030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.447597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.448985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.449379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.449977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.478361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:53:59.502307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.503032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.533772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.536108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.537344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.538821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.539482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.540310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.586934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99ada392-a80c-4f59-b6d7-d0fc911698cf tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 204 len: 0 microversion: 2.1 time: 0.152065 Oct 10 10:53:59.588156 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1682/3466] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:53:59 2022] DELETE /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:53:59.595039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-342850973", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:53:59.657243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:53:59.776612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:59.786296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:59.787822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:53:59.789017 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b25cdb4-ac3e-485d-8718-7754f02e2bfb tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.291175 Oct 10 10:53:59.789701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1785/3467] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:53:59 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:53:59.794372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:53:59.795027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:53:59.801750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.802572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.803267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:53:59.804197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:53:59.804911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:53:59.805587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.361092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:00.370266 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-320e35d2-d6c6-461b-8f27-593094864bc1 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1472 microversion: 2.1 time: 0.579258 Oct 10 10:54:00.370854 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1786/3468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:53:59 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:00.375917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:00.376708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:00.383799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.384279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.384712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.385390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.385846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.386259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.566023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:54:00.567126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:54:00.567838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:54:00.568483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:54:00.569113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:54:00.578298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.579155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.579943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.580736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.581422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.582121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.601148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:00.604095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:00.610771 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c5555e8-0e3c-4c64-bf30-fbb34a28bccb tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.238510 Oct 10 10:54:00.610992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:00.612035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1787/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:00 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:00.618180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:00.619137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:00.625414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:54:00.627855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:54:00.629422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.630288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.631049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.632364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.633106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.633838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.693587 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d0bc9ef-d850-4d6a-a8ff-12e5d529f86e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103739 Oct 10 10:54:00.694473 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1683/3470] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:54:00.699688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:00.700764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:00.708897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.709785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.710454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:00.713765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:00.714563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:00.715042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.004631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.021682 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9bad8b36-b787-4f64-8026-c6d386a3c945 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.408307 Oct 10 10:54:01.022292 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1788/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:00 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.038008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.041594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ffecef-8597-4c5b-b7d1-23c5f6bb2902", "name": "network-vif-plugged", "status": "completed", "tag": "6c9214ea-b1ae-4863-a551-912e0079beb4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:01.052233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.052720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.053161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.054146 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc6f650b-1150-4124-a349-5d144bdb88cf tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1490 microversion: 2.1 time: 0.358088 Oct 10 10:54:01.054803 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1684/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:00 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1490 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.059971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffe523d6-5c2b-4bed-b393-91ac7d1eb5be tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.060974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffe523d6-5c2b-4bed-b393-91ac7d1eb5be tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.064979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:01.068874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] Creating event network-vif-plugged:6c9214ea-b1ae-4863-a551-912e0079beb4 for instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 on n-h1-860687-2 Oct 10 10:54:01.075858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e974dd34-c94a-400d-a1c3-1b8dfa3b0277 req-bd35a678-b18c-4fe6-bb5a-35401a7e8ade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050932 Oct 10 10:54:01.076998 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1789/3473] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:01.083887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.095643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.108767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.109540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.110154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.111097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.111817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.112451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.227883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffe523d6-5c2b-4bed-b393-91ac7d1eb5be tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.236369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffe523d6-5c2b-4bed-b393-91ac7d1eb5be tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1214 microversion: 2.1 time: 0.180385 Oct 10 10:54:01.237477 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1685/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.243373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:01.246135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.253061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.253815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.254963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.255955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.256575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.257006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.261514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:01.338011 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7496284-72ed-4f1a-a799-8b74d8a9f112 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "PUT /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1085 microversion: 2.1 time: 0.097914 Oct 10 10:54:01.351075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1686/3475] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:54:01 2022] PUT /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1085 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.368010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.368498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.384081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.384652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.385126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.385951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.386419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.387452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.393247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.407106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.408571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.409749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-290a80b0-1815-476f-940b-f7fa2797f138 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.331180 Oct 10 10:54:01.410850 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1790/3476] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:01.423631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.424549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.432327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.433118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.433787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.434750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.435544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.436227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.599847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.607800 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d9713bb-2ca9-4d83-9a76-4da7c2c14603 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1511 microversion: 2.1 time: 0.245220 Oct 10 10:54:01.608784 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1687/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.635815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.636750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.645406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.646266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.646881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.648066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.648792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.649065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.649667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.665746 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c78c9bc-b953-41b4-ad91-740b5d727062 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1472 microversion: 2.1 time: 0.253740 Oct 10 10:54:01.672385 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1791/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.681152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.682162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.698527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.700089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.700763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.702331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.703080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.703717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.933488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.945084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98d53114-c31c-4b56-a12a-6e5a654f64bd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1511 microversion: 2.1 time: 0.314032 Oct 10 10:54:01.945772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1688/3479] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.970458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:01.971433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:01.975362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:01.982064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.982561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.983025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:01.983720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:01.983939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6bd532d7-f81a-4208-86a7-fd2f636e3eb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.310305 Oct 10 10:54:01.984171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:01.984753 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1792/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:01 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:01.989701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.019821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:02.044406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:02.045172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:02.059409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.060344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.062373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.063361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.063879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.064435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.152951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c44f102-f21e-4b83-9152-aa4706d33493 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 204 len: 0 microversion: 2.1 time: 0.184114 Oct 10 10:54:02.157313 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1689/3481] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:01 2022] DELETE /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:02.169034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:02.169751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:02.185334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.188224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.188918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.189800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.190419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.192207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.353673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.364007 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ae2fa1c3-37c1-4318-a74c-14d731b99626 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.322524 Oct 10 10:54:02.381083 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1793/3482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:02 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:02.389090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835fe6e6-5be3-40fd-83fb-d0593f585b95", "name": "network-vif-deleted", "tag": "8be2a628-239e-430b-8c51-a7ffac02941c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:02.406907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.408484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.408967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.431056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] Creating event network-vif-deleted:8be2a628-239e-430b-8c51-a7ffac02941c for instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 on n-h1-860687-2 Oct 10 10:54:02.438660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8d26762d-b584-4b12-b033-a10b6be2ca5f req-3f7cff96-508a-45f6-95ef-83ddd96ea3f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064023 Oct 10 10:54:02.439331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1794/3483] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:02.446962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:02.447701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:02.454685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.455413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.456078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.456783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.458215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.458369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.564057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.575376 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8bc93e1f-6a5e-4552-8eba-7ebc3aea59f8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1272 microversion: 2.1 time: 0.134542 Oct 10 10:54:02.576908 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1795/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:02 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:02.583642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.592832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:02.593457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:02.595640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26e3517f-0702-464f-ba2d-e776ac2c6366 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1517 microversion: 2.1 time: 0.436843 Oct 10 10:54:02.615049 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1690/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:02 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.615735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.689842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:02.690461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:02.698796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.699701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.700320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.701623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:02.702252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:02.702841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:02.814829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.827268 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07bd163f-06fb-44f9-be43-b41f0ff90edb tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1430 microversion: 2.1 time: 0.141675 Oct 10 10:54:02.846676 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1691/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:02 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1430 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:02.876465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.893056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.898053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:02.900162 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89afdc92-c929-4125-90a9-ed6b8c808be4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.321691 Oct 10 10:54:02.901351 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1796/3487] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:02 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:03.008573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:03.009546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:03.015790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.016373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.016874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.017655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.018285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.019104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.105745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acdef82c-fbaf-4940-95bc-f23d9bb1e08c", "name": "network-vif-plugged", "status": "completed", "tag": "193a32fe-847a-4203-9013-bae29cfca957"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:03.116475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.116947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.117385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.129176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] Creating event network-vif-plugged:193a32fe-847a-4203-9013-bae29cfca957 for instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c on n-h1-860687-2 Oct 10 10:54:03.134084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f2a236ac-245c-4e7b-ae3e-1d077b1af0db req-5b377e7f-8ef4-4668-90d7-84268de1ba93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Oct 10 10:54:03.134930 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1797/3488] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:54:03.266287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:03.274680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ce4038e-88a5-44de-bf16-4477b0b32d8b tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1317 microversion: 2.1 time: 0.270885 Oct 10 10:54:03.275424 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1692/3489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:03 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:03.391780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:03.392789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:03.407858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.408453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.409024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.411229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.413894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.414443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.605213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:03.606159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:03.627262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.627919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.629899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.634178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.635087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.636014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.754526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:03.762239 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fab641d-8a37-4654-970e-a5619a6e4639 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.377667 Oct 10 10:54:03.762874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1798/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:03 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:03.776757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:03.777570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:03.784458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.785206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.786031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:03.787370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:03.788096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:03.788757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.083093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.094748 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acdabc50-dc3b-4f67-9be0-9223aae1554c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.493898 Oct 10 10:54:04.097250 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1693/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:03 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:04.109408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:04.110431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:04.118652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.120026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.120537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.121259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.121875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.122306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.158811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.159505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.160014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.160964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lazy-loading 'fault' on Instance uuid 835fe6e6-5be3-40fd-83fb-d0593f585b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:54:04.253270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.260059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebc20917b184775bf16d3031f597e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52c9284c44f4f6ab6e782cf2b294bcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.268836 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56f5a1ad-8abb-4ab0-92e6-0a0fd8b3a5a0 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1517 microversion: 2.1 time: 0.494695 Oct 10 10:54:04.271531 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1799/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:03 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1517 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:04.274435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b91cb151-85df-4219-b15d-cd47079d0b97 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 200 len: 1307 microversion: 2.1 time: 0.174877 Oct 10 10:54:04.275468 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1694/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:04 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:04.276819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:04.277748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:04.292901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:04.295557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.296301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.296965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.298355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.300175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.301470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.306946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:04.308213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:04.315724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.316772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.317965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.319098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.319847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.320570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.666361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.682241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.683159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.684746 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c01826b1-eb42-4779-858e-3e278d637b45 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.411903 Oct 10 10:54:04.685303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1800/3494] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:04 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:04.719391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:04.730182 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b50c3154-8c3d-4199-aebb-942bfaad0756 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1507 microversion: 2.1 time: 0.436273 Oct 10 10:54:04.730945 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1695/3495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:04 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:04.754474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:04.755130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:04.761185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.761666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.762295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.763018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.763801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.764232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.793404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:04.794501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:04.811646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.812374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.812933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:04.813656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:04.814122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:04.814559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.197859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:05.216208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46cb7b73-e899-4709-8924-f55ad28540e4 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1507 microversion: 2.1 time: 0.465912 Oct 10 10:54:05.216800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1801/3496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:04 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:05.221330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:05.221937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.230088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:05.237810 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdb5e498-0939-406a-bc44-d1eea8e55d86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1315 microversion: 2.1 time: 0.454605 Oct 10 10:54:05.241173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1696/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:04 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:05.256649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c672629-1905-4baa-a014-3989e9de40d1", "name": "network-vif-unplugged", "status": "completed", "tag": "92b679eb-e320-40b7-99a9-5ac8df0ad5ef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:05.258789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.259510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.260109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.261010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.261628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.262211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.273072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:05.281422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.282196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.282929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.308954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] Creating event network-vif-unplugged:92b679eb-e320-40b7-99a9-5ac8df0ad5ef for instance 7c672629-1905-4baa-a014-3989e9de40d1 on n-h1-860687-2 Oct 10 10:54:05.330788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b52b2217-b443-4238-89e5-1b151fbd5a40 req-86176136-20e7-4529-85cc-389962026d15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078181 Oct 10 10:54:05.331838 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1697/3498] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:05.346359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:05.349799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.365130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.366130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.366748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.367853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.368578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.369339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.457160 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea80b8d7-9190-4a9e-ada3-d0cd23380e5d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "PUT /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1079 microversion: 2.1 time: 0.121658 Oct 10 10:54:05.461120 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1698/3499] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:54:05 2022] PUT /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1079 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:05.464347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:05.465027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.479906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.480546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.481357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.482582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.484365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.484916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.547971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.550069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.551389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.552511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lazy-loading 'fault' on Instance uuid 7c672629-1905-4baa-a014-3989e9de40d1 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:54:05.634893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:05.649770 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7c06870-337e-4749-92b4-d87c7d52394c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.431745 Oct 10 10:54:05.650687 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1802/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:05 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:05.677875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:05.679475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] [instance: 835fe6e6-5be3-40fd-83fb-d0593f585b95] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.698745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.699717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.700592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.701581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.702262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.702916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.720944 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] HTTP exception thrown: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Request method failure captured: Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 HTTP/1.1 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kwIPv65kqBAgfmV4EDlgQCF6sp5gi3ilXZG0JUvmDA-PQnrbU90DoyNXHcec5vxJfzaQPAnQBcrrrz9HDUARJhNUAjNrzm9AMKms39rTF3G77VBm5uzNv_8Mnp6FtSez8Av9PrJOIYdjzNeeW-oPnkNPQqeBN7VvENWj-H-p987mM Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d52c9284c44f4f6ab6e782cf2b294bcd Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d52c9284c44f4f6ab6e782cf2b294bcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d52c9284c44f4f6ab6e782cf2b294bcd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d52c9284c44f4f6ab6e782cf2b294bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d52c9284c44f4f6ab6e782cf2b294bcd"}]}] Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d52c9284c44f4f6ab6e782cf2b294bcd Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1082536848 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ListImageFiltersTestJSON-1082536848-project Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ebc20917b184775bf16d3031f597e13 Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ListImageFiltersTestJSON-1082536848-project Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '835fe6e6-5be3-40fd-83fb-d0593f585b95'} Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:05.723507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. Oct 10 10:54:05.728798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:05.729319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:05.729319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:05.740315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae04c99d-dee9-40bd-aa1d-a4fd28d3271b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 200 len: 1320 microversion: 2.1 time: 0.278078 Oct 10 10:54:05.751032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1699/3501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:05 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:05.751236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Returning 404 to user: Instance 835fe6e6-5be3-40fd-83fb-d0593f585b95 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:05.751236 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a477db3-d9ba-4c2b-8abf-3434ca1d8656 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95" status: 404 len: 111 microversion: 2.1 time: 0.078027 Oct 10 10:54:05.751236 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1803/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:05 2022] GET /compute/v2.1/servers/835fe6e6-5be3-40fd-83fb-d0593f585b95 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:05.751781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:05.752645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.755996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c672629-1905-4baa-a014-3989e9de40d1", "name": "network-vif-deleted", "tag": "92b679eb-e320-40b7-99a9-5ac8df0ad5ef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:05.759947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.760554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.761231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.762184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.762920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.763873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.791813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.792396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.792877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.841487 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] Creating event network-vif-deleted:92b679eb-e320-40b7-99a9-5ac8df0ad5ef for instance 7c672629-1905-4baa-a014-3989e9de40d1 on n-h1-860687-2 Oct 10 10:54:05.847802 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-87b256eb-c262-4a55-8abf-e9396de77d82 req-6ee35635-521f-40c4-abc6-dce3601bf5f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104877 Oct 10 10:54:05.848633 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1700/3503] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:05.859591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:05.860496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:05.874065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.880451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.881177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:05.882715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:05.887791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:05.888422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:06.255033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:06.265330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e1dbf2c-3f3e-4587-839d-b79c71fc1b0f tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1505 microversion: 2.1 time: 0.518057 Oct 10 10:54:06.266078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1804/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:05 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:06.272379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:06.272815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-decf832b-e02e-4744-aed7-4c8e8f482c67 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67777a7e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:06.285545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:06.290746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:06.292253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e00665a1-ab65-4c92-88f4-0f6e4aa904ae tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.442323 Oct 10 10:54:06.292988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1701/3505] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:05 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:06.308528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:06.309714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:06.322483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:06.323214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:06.323937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:06.324950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:06.325565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:06.326141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:06.714971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-decf832b-e02e-4744-aed7-4c8e8f482c67 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690" status: 204 len: 0 microversion: 2.1 time: 0.447548 Oct 10 10:54:06.720222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1805/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:06 2022] DELETE /compute/v2.1/images/9353691d-bb64-4c08-b376-1328e8d3f690 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:06.728363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:06.729428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:06.736327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:06.737098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:06.737834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:06.739078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:06.739782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:06.740599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.025716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.032863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.034583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c7a3e1f-ed41-4498-aa23-bd46c9d2085a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1503 microversion: 2.1 time: 0.739834 Oct 10 10:54:07.041782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46bb89f0-a22b-4faa-bfdd-95fa793b594c tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1505 microversion: 2.1 time: 0.320289 Oct 10 10:54:07.042882 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1806/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:06 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:07.047562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:07.048329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:07.052246 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1702/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:06 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1503 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:07.059046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.059767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.060374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.061312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.061929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.062659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.066901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ee1d90d-6438-4ba4-9aa8-cecc270e5d44 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f677ce7f1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:07.260039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.270123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb7d7511-433b-4d45-b28e-1fe0d9422663 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.224568 Oct 10 10:54:07.287185 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1807/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:07 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:07.294678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:07.295943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:07.302578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.303093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.303648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.304354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.305071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.305569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.323709 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 HTTP/1.1 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7c672629-1905-4baa-a014-3989e9de40d1'} Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:07.325289 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:54:07.330434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:07.332065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:07.333030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f0aadb75-42f3-43c2-bf25-1369cf939724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 404 len: 111 microversion: 2.1 time: 0.043229 Oct 10 10:54:07.333667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1808/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:07 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:07.342959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:07.346247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:07.352989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.353495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.353954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.354650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.355185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.355818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.371385 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ee1d90d-6438-4ba4-9aa8-cecc270e5d44 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592" status: 204 len: 0 microversion: 2.1 time: 0.317929 Oct 10 10:54:07.376430 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1703/3511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:07 2022] DELETE /compute/v2.1/images/2762cbf7-42a6-4767-9516-2c6a327a0592 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:07.384777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2032253834"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:07.385732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:07.393026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.393767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.394628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.396086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.396842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.397476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.432127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:07.446194 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-219e9c1d-8278-4d5d-bbb8-316ee2d50c62 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "PUT /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1081 microversion: 2.1 time: 0.111375 Oct 10 10:54:07.446840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1809/3512] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:54:07 2022] PUT /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1081 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:07.452618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:07.453426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:07.459910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.460664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.461309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.462210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:07.462850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:07.463309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:07.573873 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Adding security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 to port 193a32fe-847a-4203-9013-bae29cfca957 Oct 10 10:54:07.943337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.952965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.954461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:07.956035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c82138a3-69a9-43c4-aeb4-0cec573d355a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.507923 Oct 10 10:54:07.957310 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1810/3513] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:07 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:07.967277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a34a3ddf-1c8e-416d-bf97-25cc5569d2e3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] Calling method '.version_select at 0x7f67777a7a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:08.038149 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ee0c40f-25c3-4953-9921-d9d1f56c794c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action" status: 202 len: 0 microversion: 2.1 time: 0.659636 Oct 10 10:54:08.045826 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1704/3514] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:54:07 2022] POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:08.059239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:08.060213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:08.080414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:08.080922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:08.081367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:08.086149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:08.086679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:08.087155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:08.346689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a34a3ddf-1c8e-416d-bf97-25cc5569d2e3 tempest-ListImageFiltersTestJSON-1082536848 tempest-ListImageFiltersTestJSON-1082536848-project] 10.222.0.16 "DELETE /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce" status: 204 len: 0 microversion: 2.1 time: 0.388201 Oct 10 10:54:08.348037 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1811/3515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:07 2022] DELETE /compute/v2.1/images/b6949169-094d-4c1c-b913-5f94c9fa5bce => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:08.353148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:08.357807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1067952065", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a9ba8438-b711-4fb6-a23e-362e3049d9ab"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:08.364144 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c758fe8-66a6-4a1b-8f41-4a2e3c4191c1 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1507 microversion: 2.1 time: 0.316695 Oct 10 10:54:08.379567 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1705/3516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:08 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:08.379567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c86870b-f556-4380-927d-029fbf5ed30d", "tag": "7e13a7f0-1aa3-400e-9724-df74903b3ef0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:08.399732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:08.400368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:08.401540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:08.438435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] Creating event network-changed:7e13a7f0-1aa3-400e-9724-df74903b3ef0 for instance 6c86870b-f556-4380-927d-029fbf5ed30d on n-h2-860687-2 Oct 10 10:54:08.445994 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e8737044-85ee-4efb-bd91-8db52296f4d6 req-b2f7820c-4165-4057-821d-385bba17541e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078529 Oct 10 10:54:08.446703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1706/3517] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:08.447221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] validate_networks() for [('a9ba8438-b711-4fb6-a23e-362e3049d9ab', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:54:08.469570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a7c700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:08.871928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use.", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:08.872726 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.872726 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1 HTTP/1.1 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: exception: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '5832cdaf-7a65-4f10-8c32-c62f53d319b1'} Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:08.876887 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] Oct 10 10:54:08.882107 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:08.888064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 400 to user: Security Group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 in use. Oct 10 10:54:08.888064 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-84ccdeeb-935a-46d5-af51-350de8541af7'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:08.890444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-181be8bf-66fc-42ea-89e7-8ac6326a6a7d tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1" status: 400 len: 185 microversion: 2.1 time: 0.438770 Oct 10 10:54:08.895015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1707/3518] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:08 2022] DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1 => generated 185 bytes in 443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:54:08.901417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:08.902481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:08.911570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:08.912268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:08.913035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:08.914073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:08.914736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:08.915648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.417813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:09.421094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:54:09.422629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:54:09.423229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:54:09.424116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:54:09.424739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:54:09.435308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d1e8d32-4c7b-45e9-9e20-7e9a8b463214 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.538304 Oct 10 10:54:09.436309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.437089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.437629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.438600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.439323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.439996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.452587 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1708/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:08 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:09.459684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:09.461709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:09.464432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:09.470480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Getting quotas for user 6ce5370c7da5421f88d30317525a940b and project 11535079a28041faa0f7552da0f02fe7. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:09.471557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.472651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.473427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.474301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.474919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.475851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.489701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:54:09.492403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:54:09.555850 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4164f542-32d9-4301-9567-44093224e839 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202049 Oct 10 10:54:09.556586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1812/3520] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:54:09.561009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:09.563630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:09.571152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.571913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.572445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.572885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.573499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.573931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.747484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0d2a910-c2db-4a00-b9f1-8d6ced541fa7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action" status: 202 len: 0 microversion: 2.1 time: 0.189777 Oct 10 10:54:09.754823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1813/3521] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:54:09 2022] POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:09.760053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:09.761312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:09.778076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.778680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.779349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.780768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:09.781327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:09.781851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:09.921721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:09.930594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcac1868-8e8e-4686-8315-8f9619c097d9 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1507 microversion: 2.1 time: 0.476764 Oct 10 10:54:09.931201 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1709/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:09 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:09.950319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c966285a-570b-4492-8792-b747b160ba63 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:09.951319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c966285a-570b-4492-8792-b747b160ba63 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.038172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.047318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.054208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.055704 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61397de1-d547-4e05-8953-91d941bbc20b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1742 microversion: 2.20 time: 0.304024 Oct 10 10:54:10.063286 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1814/3523] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:09 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1742 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:10.073724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:10.074700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.093336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.093991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.094450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.095332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.095797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.096229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.118510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c966285a-570b-4492-8792-b747b160ba63 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.133016 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c966285a-570b-4492-8792-b747b160ba63 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1209 microversion: 2.1 time: 0.186840 Oct 10 10:54:10.133978 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1710/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:09 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1209 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:10.143092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:10.153159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.180058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.181063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.182549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.184094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.186871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.187571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.301760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:10.500810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.502979 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e92717fe-5d5e-4c21-86aa-f27bbc1f274d tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 204 len: 0 microversion: 2.1 time: 0.359913 Oct 10 10:54:10.514622 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1711/3525] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:10 2022] DELETE /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:10.528526 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-389c300f-7162-46a9-8f13-1d18f6a1c9ff tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1574 microversion: 2.1 time: 0.463968 Oct 10 10:54:10.528924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:10.529909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.533378 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1815/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:10 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1574 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:10.540067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.540636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.541140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.541943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.542501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.543187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.544490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acdef82c-fbaf-4940-95bc-f23d9bb1e08c", "tag": "193a32fe-847a-4203-9013-bae29cfca957"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:10.568293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.571505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.572268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.589607 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] Creating event network-changed:193a32fe-847a-4203-9013-bae29cfca957 for instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c on n-h1-860687-2 Oct 10 10:54:10.597730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fb053729-02c0-4f93-aac0-0efbd01d33b5 req-47772ee4-24cd-4d1d-a057-e2352426dd4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061661 Oct 10 10:54:10.599582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:10.604852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1816/3527] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:10.610961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:10.615029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.621998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.622815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.623494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.624482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.625097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.625676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.664699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:10.751657 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Instance is already in deleting state, ignoring this request Oct 10 10:54:10.753327 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-008dc340-bcd2-4f28-af62-1d273d0e0831 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 204 len: 0 microversion: 2.1 time: 0.146892 Oct 10 10:54:10.754595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1817/3528] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:10 2022] DELETE /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:10.763583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:10.764581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:10.772331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.773160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.774246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.775181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:10.775821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:10.776236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:10.922950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.937885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-820f2aee-bba0-40e1-a2e9-470910de372f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.421471 Oct 10 10:54:10.961385 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1712/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:10 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:10.963226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:10.976180 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a7633c9-7b3b-401c-94d9-24e08443fd27 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1513 microversion: 2.1 time: 0.217547 Oct 10 10:54:10.976988 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1818/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:10 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:11.093088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.093705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:11.105926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.108398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.108398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.108841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.109294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.112051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.258903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-424e1712-1883-47a5-9d2a-3c57803e8999 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f6777a72ca0>, body: {"keypair": {"name": "tempest-keypair-616856287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjcye3M3obZPPaPYfyAZkRUNBwj42Lx5Ecn7rru6OxL++JbJrKbFaT/obyYRmp9+Q/Dmy7gjKkIJiPFLFd7UcB43rh316m+PFXPbHC3Nh6mG3bkFHBoZmda31HO+n0pIA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.279146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-424e1712-1883-47a5-9d2a-3c57803e8999 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.286772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-424e1712-1883-47a5-9d2a-3c57803e8999 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:11.313872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:11.324770 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-424e1712-1883-47a5-9d2a-3c57803e8999 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.313293 Oct 10 10:54:11.324991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:11.325678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1713/3531] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 315 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:54:11.326450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:11.328219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c081507a-a716-4951-9ef3-fcde2187772a tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1742 microversion: 2.20 time: 0.239580 Oct 10 10:54:11.328951 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1819/3532] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:11 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:11.336496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.341633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:11.344728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ed77dcb-fcb4-4ea4-a97d-e6b59e28d3eb tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f67777d3b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.351281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.351902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.352408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.353520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.354048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.354535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.361091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ed77dcb-fcb4-4ea4-a97d-e6b59e28d3eb tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-616856287" status: 200 len: 512 microversion: 2.2 time: 0.023624 Oct 10 10:54:11.361688 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1820/3533] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Oct 10 10:54:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-616856287 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:11.374002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e79b4b7-7292-492a-a0dc-097804b436ed tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777822700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.399228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e79b4b7-7292-492a-a0dc-097804b436ed tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616856287" status: 204 len: 0 microversion: 2.2 time: 0.029630 Oct 10 10:54:11.401181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1821/3534] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Oct 10 10:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616856287 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:54:11.417666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c8edb426-d13c-4b8d-bcd2-0c89bbd8978d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f6777863550>, body: {"keypair": {"name": "tempest-keypair-2026321414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBOKP2d1RakiGR8z3o2X3j70rZfvFn35rLHEC0TdqxR0qsDz6pjqI4g4q1zBiCpEMqI1cvpNt+zV9Ab0aX861n+Pz48LcOg54n99QyLnysbKJWoB+LNMmDqod0/0kJG1Q=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.437808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c8edb426-d13c-4b8d-bcd2-0c89bbd8978d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.444091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c8edb426-d13c-4b8d-bcd2-0c89bbd8978d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:11.468602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c8edb426-d13c-4b8d-bcd2-0c89bbd8978d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.056189 Oct 10 10:54:11.469806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1822/3535] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:54:11.478492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:11.495660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af7da83d-f191-4596-9a3e-779b8dbbd145 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f67778b5af0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.496072 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1278e3cf-9223-4837-9618-f2f33bff578e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1261 microversion: 2.1 time: 0.167927 Oct 10 10:54:11.500103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1714/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:11 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:11.541841 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af7da83d-f191-4596-9a3e-779b8dbbd145 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026321414" status: 204 len: 0 microversion: 2.2 time: 0.057483 Oct 10 10:54:11.542646 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1823/3537] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Oct 10 10:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026321414 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:11.559943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-846761d8-c0eb-4524-974b-b889d47b0c23 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f677ce7fb80>, body: {"keypair": {"name": "tempest-keypair-1823043883", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.565538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.570979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:11.589504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.594716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.596890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.598307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:11.602392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:11.603386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:11.611573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-846761d8-c0eb-4524-974b-b889d47b0c23 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.625683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-846761d8-c0eb-4524-974b-b889d47b0c23 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:11.694399 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-846761d8-c0eb-4524-974b-b889d47b0c23 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.145617 Oct 10 10:54:11.695598 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1715/3538] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:54:11.706108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6275f7e9-20d8-4ae9-b6dd-8eed5eba6ec8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777a72f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:11.729908 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6275f7e9-20d8-4ae9-b6dd-8eed5eba6ec8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823043883" status: 204 len: 0 microversion: 2.2 time: 0.027668 Oct 10 10:54:11.731886 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1716/3539] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Oct 10 10:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823043883 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:54:11.744997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca8332bb-3fd8-4b85-b27b-e5f723f3bd56 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f6777ae65e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1522940399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM15ybrZ0p7Smm3a0f2MBeQd9bC/lMVbzMPTtHgX21kjPbXqoucuqkFCCqUYKpiEXd9Lj1fGt3V19IF3ODVweZEf25w+zpZ/oCGEugZBo8xnsR0Wd6KF32dZhi8trMPnig=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.788455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ca8332bb-3fd8-4b85-b27b-e5f723f3bd56 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.798671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ca8332bb-3fd8-4b85-b27b-e5f723f3bd56 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:11.835697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca8332bb-3fd8-4b85-b27b-e5f723f3bd56 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095088 Oct 10 10:54:11.836564 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1717/3540] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:54:11.851873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d58f9ef-7d7b-4afc-be63-f9ee64552e0d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f6777a728b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-748999136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGTNapQSSLRVpBnjBVixXr0ki+WVp/QTWS6LZWCPO2RayGu6WzLioxvgGbTuPfIp5Ewq6TdcKsTd8lTQWgCYGd8Qv8t9LkOKmaimVvvkxtFHACI+UuuT9WSobKzXcI+BA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.872589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d58f9ef-7d7b-4afc-be63-f9ee64552e0d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.885575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d58f9ef-7d7b-4afc-be63-f9ee64552e0d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:11.942759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d58f9ef-7d7b-4afc-be63-f9ee64552e0d tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.096219 Oct 10 10:54:11.945054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1718/3541] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 10 10:54:11.958462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e79dee0-300c-4f06-b8af-f8ccb1ed6770 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f6777a755e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1493246701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIY09X/LIRAX6xlpas/xNnI1Es5IIdpk5ARL4mLuPqVn2d4aML2OToHeqWIgIBiFZHmYrLamdmlQQ2A1O2sukgzlO0xHpJZEXCpirHMAwdOAQukiIPJYB443vCtpQrlAjw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:11.976635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4e79dee0-300c-4f06-b8af-f8ccb1ed6770 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:11.983198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4e79dee0-300c-4f06-b8af-f8ccb1ed6770 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:12.010596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:12.053919 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e79dee0-300c-4f06-b8af-f8ccb1ed6770 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.100072 Oct 10 10:54:12.055067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1719/3542] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 10 10:54:12.066321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:12.067128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:12.074144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.074648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.075122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.075834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.076642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.077639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.585401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:12.598635 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16913e45-5d1f-45c0-8ec3-f1d2d445480c tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1574 microversion: 2.1 time: 1.042950 Oct 10 10:54:12.602961 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1824/3543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:11 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1574 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:12.619794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:12.620694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:12.631763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.633753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.636121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.637877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.644132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.644891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.747609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:12.758528 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70c3a683-19ba-408a-99a6-6a39134bacf7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.702329 Oct 10 10:54:12.763340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1720/3544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:12 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:12.780072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89b35b3b-6c50-4b73-b621-564ff337f62b tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777a518b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:12.795311 n-d-860687-2 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-89b35b3b-6c50-4b73-b621-564ff337f62b tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:54:12.808195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89b35b3b-6c50-4b73-b621-564ff337f62b tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.043489 Oct 10 10:54:12.809140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1721/3545] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Oct 10 10:54:12 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:12.824255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c86870b-f556-4380-927d-029fbf5ed30d", "name": "network-vif-plugged", "status": "completed", "tag": "7e13a7f0-1aa3-400e-9724-df74903b3ef0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:12.849819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129b6fe8d95645568c521e13faa798c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84eea22787884c498d0728bc2707ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:12.859377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.860300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.861019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.865586 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74b8856c-f64e-4c78-b949-69646d452d29 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 200 len: 1471 microversion: 2.1 time: 0.260628 Oct 10 10:54:12.868497 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1825/3546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:12 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:12.883236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:12.884555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:12.896280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.897390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.897843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.899269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.899742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.900172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.901204 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] Creating event network-vif-plugged:7e13a7f0-1aa3-400e-9724-df74903b3ef0 for instance 6c86870b-f556-4380-927d-029fbf5ed30d on n-h2-860687-2 Oct 10 10:54:12.918708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ce16053f-6532-41e4-a24c-497bfb92b54d req-e7cf0b80-0880-443b-8652-4f9a5c322c92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108106 Oct 10 10:54:12.921591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1722/3547] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:12.945713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:12.951281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:12.973682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.990761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.992075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:12.998285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:12.998793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:12.999282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:13.413905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:13.422353 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ed1b734-1e3d-4e83-8e61-f90d0d77ed7f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1267 microversion: 2.1 time: 0.494998 Oct 10 10:54:13.435047 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1723/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:12 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1267 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:13.435047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40f0a586-63fa-4b04-bfa6-6a04c1292531 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777ab0940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:13.469821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40f0a586-63fa-4b04-bfa6-6a04c1292531 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1493246701" status: 204 len: 0 microversion: 2.2 time: 0.045234 Oct 10 10:54:13.472923 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1724/3549] 10.222.0.16 () {60 vars in 1321 bytes} [Mon Oct 10 10:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1493246701 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:13.484229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ffecef-8597-4c5b-b7d1-23c5f6bb2902", "name": "network-vif-deleted", "tag": "6c9214ea-b1ae-4863-a551-912e0079beb4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:13.506744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:13.507577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:13.509666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:13.535206 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] Creating event network-vif-deleted:6c9214ea-b1ae-4863-a551-912e0079beb4 for instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 on n-h1-860687-2 Oct 10 10:54:13.548055 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7c6dfad8-d339-4a68-ae76-113020e37adb req-c9f9bb8a-6bd8-466d-a667-6cb8061bba46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073538 Oct 10 10:54:13.549069 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1725/3550] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:13.560473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e900790b-40dd-4bce-b7fc-f3906f1d5a07 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777a059d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:13.613393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e900790b-40dd-4bce-b7fc-f3906f1d5a07 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-748999136" status: 204 len: 0 microversion: 2.2 time: 0.057210 Oct 10 10:54:13.614220 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1726/3551] 10.222.0.16 () {60 vars in 1318 bytes} [Mon Oct 10 10:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-748999136 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:13.625922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b345c09-f8f2-4360-af6c-ec27eae05ff8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777acfc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:13.684561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b345c09-f8f2-4360-af6c-ec27eae05ff8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1522940399" status: 204 len: 0 microversion: 2.2 time: 0.065402 Oct 10 10:54:13.687784 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1727/3552] 10.222.0.16 () {60 vars in 1321 bytes} [Mon Oct 10 10:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1522940399 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:54:13.703357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:13.704318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:13.717523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:13.718032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:13.718816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:13.721560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:13.722178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:13.722630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.080067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:14.096671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:14.098676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:14.099902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-150c8070-4851-48bb-9597-056c639012bc tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 1.230310 Oct 10 10:54:14.111688 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1826/3553] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:12 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:14.129028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43f85ec5-be01-49a0-8032-b1aeca85d3f0 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f67778b5ee0>, body: {"keypair": {"name": "tempest-keypair-474632238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXKNHYzeKgWFs2PwSFvEUVDlrXv7Kqkg2v4UbTsxa8p60Pv67PqC+TnqlFMXV5qSl+ta7HDsXPHNM/3dYOS25maSDsUyvGZjOxhxI9RGvlYOoWXvvqPnXn7XPs/iDX7og=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:14.165484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-43f85ec5-be01-49a0-8032-b1aeca85d3f0 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:14.182075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-43f85ec5-be01-49a0-8032-b1aeca85d3f0 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:14.236807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43f85ec5-be01-49a0-8032-b1aeca85d3f0 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.119524 Oct 10 10:54:14.239206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1827/3554] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Oct 10 10:54:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:54:14.244601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:14.245666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:14.255784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.256537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.257202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.258202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.258984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.259617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.412766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:14.423946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdf639a2-2366-4724-902d-192c69d00ae7 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1572 microversion: 2.1 time: 0.735066 Oct 10 10:54:14.424711 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1728/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:13 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1572 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:14.446908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:14.448857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b2ffecef-8597-4c5b-b7d1-23c5f6bb2902] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:14.461748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.462252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.462693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.463753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.464388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.465009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.496755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] HTTP exception thrown: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Request method failure captured: Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 HTTP/1.1 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kxmW2pdTYYez-rw4b6IbmaVp8hMSESLGvTG12g7Xu8fe-elDOgju2_8DpJiixZw2mmhsSycdAJw_FgP7UaH58g4AMA3TyKQufNLkZPbGPZbMQbQBUFf4Z2DY4SkCbpUp5Ajho4WNka04QBG_e1N5u2cKvvIiTmlwxfxFNoKMw7kyM Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84eea22787884c498d0728bc2707ad6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84eea22787884c498d0728bc2707ad6c"}]}] Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 129b6fe8d95645568c521e13faa798c2 Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b2ffecef-8597-4c5b-b7d1-23c5f6bb2902'} Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:14.498787 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Returning 404 to user: Instance b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eab30da6-67ff-4b49-8cf7-73575185fdb0 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902" status: 404 len: 111 microversion: 2.1 time: 0.072850 Oct 10 10:54:14.504862 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1729/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:14 2022] GET /compute/v2.1/servers/b2ffecef-8597-4c5b-b7d1-23c5f6bb2902 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:14.505714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-399c7a49-4ad7-4af8-8173-26e4bcf77872 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777a968b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:14.517638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-399c7a49-4ad7-4af8-8173-26e4bcf77872 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-474632238" status: 200 len: 512 microversion: 2.2 time: 0.015538 Oct 10 10:54:14.526059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1730/3557] 10.222.0.16 () {60 vars in 1255 bytes} [Mon Oct 10 10:54:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-474632238 => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:14.536548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:14.537175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:14.545015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.546053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.546278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.547032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.547488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.548397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.696857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:14.705247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c78fa610-86b8-4c75-a441-2700a99a1e52 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1314 microversion: 2.1 time: 0.464408 Oct 10 10:54:14.707884 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1828/3558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:14 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:14.723377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1160902166"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:14.724238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:14.732515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.736266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.739928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:14.740892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:14.741538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:14.742144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.121748 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Adding security group 4fa0e419-47ea-4507-b613-7a6a7470f307 to port 193a32fe-847a-4203-9013-bae29cfca957 Oct 10 10:54:15.142370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:15.156699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f32a5ea9-9f1f-4aea-afc9-a566e243fd0e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.637414 Oct 10 10:54:15.178649 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1731/3559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:14 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:15.183958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:15.196848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:15.204568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.205289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.205886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.206822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.207503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.208081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.225536 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] HTTP exception thrown: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Request method failure captured: Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 HTTP/1.1 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kxmW2pdTYYez-rw4b6IbmaVp8hMSESLGvTG12g7Xu8fe-elDOgju2_8DpJiixZw2mmhsSycdAJw_FgP7UaH58g4AMA3TyKQufNLkZPbGPZbMQbQBUFf4Z2DY4SkCbpUp5Ajho4WNka04QBG_e1N5u2cKvvIiTmlwxfxFNoKMw7kyM Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84eea22787884c498d0728bc2707ad6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84eea22787884c498d0728bc2707ad6c"}]}] Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 129b6fe8d95645568c521e13faa798c2 Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b5b1d233-bf33-4817-b2a5-8a803b249f18'} Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:15.227064 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.232163 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.234059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Returning 404 to user: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:15.235137 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-259debd7-58a2-4100-94f4-307a2499bec5 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 404 len: 111 microversion: 2.1 time: 0.055369 Oct 10 10:54:15.239892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1732/3560] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:15 2022] DELETE /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:15.247948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4895fa58-dcec-4160-8cf5-d4586dcd39cb tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777aa1670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:15.255786 n-d-860687-2 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-4895fa58-dcec-4160-8cf5-d4586dcd39cb tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:54:15.261648 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4895fa58-dcec-4160-8cf5-d4586dcd39cb tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.020347 Oct 10 10:54:15.262826 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1733/3561] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Oct 10 10:54:15 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:15.267958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "name": "network-vif-plugged", "status": "completed", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:15.280950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.281724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.282314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.287561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:15.297548 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] Creating event network-vif-plugged:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h2-860687-2 Oct 10 10:54:15.307510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1bf9f4c8-76f0-4ef3-aae2-50db0912e166 req-bd874de9-79e9-483f-ab61-407c4970c1f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042831 Oct 10 10:54:15.308829 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1734/3562] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:15.320288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:15.321850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:15.329168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.329654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.330570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.331298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.332295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.332723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.648786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:15.664683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:15.669658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:15.686624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-940605f5-f06d-4130-bf64-c4f741824695 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.375479 Oct 10 10:54:15.689667 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1735/3563] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:15 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:15.703236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:15.705063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: b5b1d233-bf33-4817-b2a5-8a803b249f18] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:15.712673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.713485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.714307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.716876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.717583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.718264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.753323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] HTTP exception thrown: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Request method failure captured: Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 HTTP/1.1 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kxmW2pdTYYez-rw4b6IbmaVp8hMSESLGvTG12g7Xu8fe-elDOgju2_8DpJiixZw2mmhsSycdAJw_FgP7UaH58g4AMA3TyKQufNLkZPbGPZbMQbQBUFf4Z2DY4SkCbpUp5Ajho4WNka04QBG_e1N5u2cKvvIiTmlwxfxFNoKMw7kyM Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84eea22787884c498d0728bc2707ad6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84eea22787884c498d0728bc2707ad6c"}]}] Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 129b6fe8d95645568c521e13faa798c2 Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b5b1d233-bf33-4817-b2a5-8a803b249f18'} Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:15.757992 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. Oct 10 10:54:15.763646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:15.767940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Returning 404 to user: Instance b5b1d233-bf33-4817-b2a5-8a803b249f18 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:15.770008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80063467-3293-4016-adfc-3794531d3c77 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18" status: 404 len: 111 microversion: 2.1 time: 0.073751 Oct 10 10:54:15.771354 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1736/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:15 2022] GET /compute/v2.1/servers/b5b1d233-bf33-4817-b2a5-8a803b249f18 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:15.788079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-894e400e-a93c-4543-a546-ca73546e46ff tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f6777a81940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:15.838464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-894e400e-a93c-4543-a546-ca73546e46ff tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474632238" status: 204 len: 0 microversion: 2.2 time: 0.065367 Oct 10 10:54:15.845293 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1737/3565] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Oct 10 10:54:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474632238 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:15.852717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:15.856587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:15.867402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.868579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.869378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:15.870466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:15.871223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:15.871900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:16.374402 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d126db29-1d0c-43ae-a8a0-07004d80f430 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527273 Oct 10 10:54:16.376436 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1738/3566] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:54:15 2022] POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:16.382876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:16.383747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:16.412622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:16.413213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:16.414736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:16.416341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:16.416816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:16.417264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:16.466154 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2f393dc-8f5e-417b-b7d1-80eda9188d4b tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action" status: 202 len: 0 microversion: 2.1 time: 1.753863 Oct 10 10:54:16.468153 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1829/3567] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:54:14 2022] POST /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c/action => generated 0 bytes in 1757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:16.474956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:16.476457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:16.498175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:16.499501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:16.500829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:16.506219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:16.507776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:16.510163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:16.563924 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] HTTP exception thrown: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Request method failure captured: Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c HTTP/1.1 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kxmW2pdTYYez-rw4b6IbmaVp8hMSESLGvTG12g7Xu8fe-elDOgju2_8DpJiixZw2mmhsSycdAJw_FgP7UaH58g4AMA3TyKQufNLkZPbGPZbMQbQBUFf4Z2DY4SkCbpUp5Ajho4WNka04QBG_e1N5u2cKvvIiTmlwxfxFNoKMw7kyM Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84eea22787884c498d0728bc2707ad6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84eea22787884c498d0728bc2707ad6c"}]}] Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 129b6fe8d95645568c521e13faa798c2 Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'db26c176-1196-40eb-b7d7-70833826274c'} Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:16.565762 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Returning 404 to user: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f7e3d065-f49e-46e7-9bac-458e851bf009 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 404 len: 111 microversion: 2.1 time: 0.098462 Oct 10 10:54:16.572228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1830/3568] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:16 2022] DELETE /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:16.576446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Action: 'create', calling method: .version_select at 0x7f67778b51f0>, body: {"keypair": {"name": "tempest-keypair-1896955758", "type": "x509"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:16.619499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:16.621148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:16.655902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:16.693452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.processutils [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpielism9q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpielism9q/temp.key -subj /CN=6eb0939fbf2e4e0590b272488a4f68e4 -extensions v3_req_client {{(pid=128800) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 10:54:17.082349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:17.092492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9394a257-b22c-4c2f-9ce4-9d483033a682 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1501 microversion: 2.1 time: 0.714467 Oct 10 10:54:17.123374 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1739/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:16 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1501 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:17.148938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:17.151048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:17.192457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:17.192979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:17.193473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:17.194620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:17.194830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:17.195162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:17.995231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:18.006175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1aa7c774-b259-41b0-8423-b5bb45c13863 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.881590 Oct 10 10:54:18.009906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1740/3570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:17 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:18.014381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777aa1790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:18.239702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.processutils [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpielism9q/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpielism9q/temp.key -subj /CN=6eb0939fbf2e4e0590b272488a4f68e4 -extensions v3_req_client" returned: 0 in 1.545s {{(pid=128800) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 10:54:18.241404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.processutils [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpielism9q/temp.key -password pass: {{(pid=128800) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 10:54:18.317121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.processutils [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpielism9q/temp.key -password pass:" returned: 0 in 0.074s {{(pid=128800) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 10:54:18.382948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:18.389593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Getting quotas for user 6eb0939fbf2e4e0590b272488a4f68e4 and project 46575a2f852d4f29b728b99fca687692. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:18.436377 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2dc00645-02bb-4c0b-af86-10c1a2bb88e8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.863321 Oct 10 10:54:18.442723 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1831/3571] 10.222.0.16 () {62 vars in 1198 bytes} [Mon Oct 10 10:54:16 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1870 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:18.449150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acdef82c-fbaf-4940-95bc-f23d9bb1e08c", "tag": "193a32fe-847a-4203-9013-bae29cfca957"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:18.468789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.469591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.470282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.495485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] Creating event network-changed:193a32fe-847a-4203-9013-bae29cfca957 for instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c on n-h1-860687-2 Oct 10 10:54:18.512465 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-daec5738-e248-41e5-a645-423071784114 req-9b330e05-81a8-40a2-92cf-4ce6cc080342 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067895 Oct 10 10:54:18.513499 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1832/3572] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:18.520354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use.", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:18.521157 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.521157 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307 HTTP/1.1 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: exception: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4fa0e419-47ea-4507-b613-7a6a7470f307'} Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:18.523337 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] Oct 10 10:54:18.528995 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.539296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 400 to user: Security Group 4fa0e419-47ea-4507-b613-7a6a7470f307 in use. Oct 10 10:54:18.539296 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-06e75b93-96b2-44b6-8896-e034d626b85f'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:18.540588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0831a0c1-989f-48b4-8313-ed51b41bc0f1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307" status: 400 len: 185 microversion: 2.1 time: 0.529633 Oct 10 10:54:18.541685 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1741/3573] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:18 2022] DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307 => generated 185 bytes in 531 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:54:18.548682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:18.549805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] [instance: db26c176-1196-40eb-b7d7-70833826274c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:18.551455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:18.555334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:18.562655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.565554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.566776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.568263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.569279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.569838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.570581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.571088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.571591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.575087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.575636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.576144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.603158 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] HTTP exception thrown: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Request method failure captured: Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c HTTP/1.1 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kxmW2pdTYYez-rw4b6IbmaVp8hMSESLGvTG12g7Xu8fe-elDOgju2_8DpJiixZw2mmhsSycdAJw_FgP7UaH58g4AMA3TyKQufNLkZPbGPZbMQbQBUFf4Z2DY4SkCbpUp5Ajho4WNka04QBG_e1N5u2cKvvIiTmlwxfxFNoKMw7kyM Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_84eea22787884c498d0728bc2707ad6c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/84eea22787884c498d0728bc2707ad6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/84eea22787884c498d0728bc2707ad6c"}]}] Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 84eea22787884c498d0728bc2707ad6c Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-896830550 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 129b6fe8d95645568c521e13faa798c2 Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerDiskConfigTestJSON-896830550-project Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'db26c176-1196-40eb-b7d7-70833826274c'} Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:18.607925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] Returning 404 to user: Instance db26c176-1196-40eb-b7d7-70833826274c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:18.614005 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd41e60d-2393-4f7f-bfae-25fecb30b651 tempest-ServerDiskConfigTestJSON-896830550 tempest-ServerDiskConfigTestJSON-896830550-project] 10.222.0.16 "GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c" status: 404 len: 111 microversion: 2.1 time: 0.094729 Oct 10 10:54:18.622227 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1833/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:18 2022] GET /compute/v2.1/servers/db26c176-1196-40eb-b7d7-70833826274c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:18.627560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1c880a7-98fc-4685-b537-69fcada65bb8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f677782e040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:18.652768 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1c880a7-98fc-4685-b537-69fcada65bb8 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1896955758" status: 200 len: 1534 microversion: 2.2 time: 0.027387 Oct 10 10:54:18.654067 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1834/3575] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Oct 10 10:54:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1896955758 => generated 1534 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:18.676131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:18.677834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:18.694166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.700703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.701987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.702865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:18.705472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:18.706095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:18.796691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:18.820192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:19.125198 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47a52a7c-c54a-4545-bf44-e5eb99af0a35 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 204 len: 0 microversion: 2.1 time: 0.468769 Oct 10 10:54:19.132484 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1835/3576] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:18 2022] DELETE /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:19.146954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:19.154916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8df5f3b3-e6d0-491b-884f-db15d199c790 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f677778e790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:19.174041 n-d-860687-2 devstack@n-api.service[128800]: WARNING oslo_db.sqlalchemy.utils [None req-8df5f3b3-e6d0-491b-884f-db15d199c790 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 10:54:19.177153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:19.182608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:19.187043 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10ec2d30-64c9-486b-aad1-0e1e056d1fb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.644088 Oct 10 10:54:19.187642 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1742/3577] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:18 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:19.192716 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8df5f3b3-e6d0-491b-884f-db15d199c790 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.058479 Oct 10 10:54:19.197594 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1836/3578] 10.222.0.16 () {60 vars in 1177 bytes} [Mon Oct 10 10:54:19 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:19.203091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:19.203949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:19.221822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:19.226400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:19.243883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:19.244430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:19.244869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:19.245581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:19.246162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:19.246598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:19.254682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:19.257007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:19.259292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:19.260361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:19.262138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:19.262778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:19.449473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:19.582698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:19.601753 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57bf4284-b952-49b9-a9b4-efde6d26e8f6 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1647 microversion: 2.1 time: 0.396453 Oct 10 10:54:19.616284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1837/3579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:19 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1647 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:19.633937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0618d998-21f6-4a0d-afa5-8c0f740b1ce6 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] Calling method '.version_select at 0x7f677783eb80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:19.673240 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0618d998-21f6-4a0d-afa5-8c0f740b1ce6 tempest-KeyPairsV22TestJSON-1995165114 tempest-KeyPairsV22TestJSON-1995165114-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896955758" status: 204 len: 0 microversion: 2.2 time: 0.055484 Oct 10 10:54:19.674574 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1838/3580] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Oct 10 10:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896955758 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:19.686298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:19.695140 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59be59c2-28a4-499e-8aff-8ddec16395f3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.506368 Oct 10 10:54:19.696867 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1743/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:19 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:20.221624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:20.222289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:20.228968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.229463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.229904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.230644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.247575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.249835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.276026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9013d541-e48c-4e76-a301-a6369da8cefc"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:20.278593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:20.314463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.314989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.315463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.338029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.338532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.338978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.666338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:20.676687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:20.685164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:20.696582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-978a7deb-2c87-4d65-ae88-3cb719087501 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.479401 Oct 10 10:54:20.697787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1839/3582] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:20 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:20.702526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29a1652-9075-4b3c-af3e-5e1901adedd5", "tag": "a46b5cf3-fb56-4c52-b129-b79d388301c0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:20.721129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.724285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.724951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.757745 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] Creating event network-changed:a46b5cf3-fb56-4c52-b129-b79d388301c0 for instance e29a1652-9075-4b3c-af3e-5e1901adedd5 on n-h2-860687-2 Oct 10 10:54:20.768883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7437bc0e-77a6-4424-9747-77660600b9ce req-49339b11-1d75-4ea1-bca6-94a912bb2c56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069581 Oct 10 10:54:20.769798 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1840/3583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:20.777104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:20.778054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:20.788356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.789077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.789715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.790619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:20.791281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:20.791885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:20.947803 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4295718-17af-4e72-8af1-af5db01d18e3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675875 Oct 10 10:54:20.974297 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1744/3584] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:54:20 2022] POST /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:21.002620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:21.002620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:21.022670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:21.028959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:21.029483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:21.030227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:21.035750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:21.036271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:22.004603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:22.893521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:22.908849 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-edce66fb-1465-435c-9c13-6d194d45f88a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 200 len: 1647 microversion: 2.1 time: 2.133557 Oct 10 10:54:22.914805 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1841/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:20 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 1647 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:22.931554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acdef82c-fbaf-4940-95bc-f23d9bb1e08c", "name": "network-vif-deleted", "tag": "193a32fe-847a-4203-9013-bae29cfca957"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:22.967469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:22.971330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:22.973939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:23.007143 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] Creating event network-vif-deleted:193a32fe-847a-4203-9013-bae29cfca957 for instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c on n-h1-860687-2 Oct 10 10:54:23.030581 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-dcef31da-0996-4262-8a11-c988bf8e3189 req-eacccbf8-5241-4d8d-b861-c3b444e3205e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112031 Oct 10 10:54:23.038231 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1842/3586] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:23.057179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:23.058449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:23.086499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:23.088748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:23.089870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:23.092469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:23.093480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:23.094197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:23.099386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:23.111459 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66eaf0dc-0a65-4cff-84fc-132e48176091 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 2.132767 Oct 10 10:54:23.112058 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1745/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:20 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:23.771022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:23.785438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:23.792593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:23.794769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8cece097-29ba-472c-befe-b56575c75cdd tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.752717 Oct 10 10:54:23.802900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1843/3588] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:23 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:23.938476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:23.939364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:23.953280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:23.959360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:23.960031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:23.960959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:23.961592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:23.962211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:23.986248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c HTTP/1.1 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'acdef82c-fbaf-4940-95bc-f23d9bb1e08c'} Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:23.988902 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:23.993842 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:23.996066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:23.997144 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28011b56-b958-4549-8155-500daf90dc64 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 404 len: 111 microversion: 2.1 time: 0.063370 Oct 10 10:54:24.001604 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1746/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:23 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:24.006260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83d75016-2f48-483d-9c55-476eba73efa1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67778305e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:24.139584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:24.140858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:24.149231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:24.153883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:24.154607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:24.155636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:24.156332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:24.157003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:24.808073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:24.819682 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03da4658-e408-412b-b7bc-5a96fd7a439e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.683817 Oct 10 10:54:24.820866 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1747/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:24 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:24.830057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:24.846488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:24.866219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:24.869888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:24.870350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:24.871121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:24.871585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:24.872012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:25.390254 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83d75016-2f48-483d-9c55-476eba73efa1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1" status: 202 len: 0 microversion: 2.1 time: 1.387931 Oct 10 10:54:25.390864 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1844/3591] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:24 2022] DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1 => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:25.411647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:25.430414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:25.432117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:25.433583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adc2e1ba-2f6d-4087-b1e3-1d7df5143c72 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.607374 Oct 10 10:54:25.438380 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1748/3592] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:24 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:25.449583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8039dd8-9297-438c-9630-9cb8648717cf tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a20040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:25.778534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8039dd8-9297-438c-9630-9cb8648717cf tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307" status: 202 len: 0 microversion: 2.1 time: 0.338856 Oct 10 10:54:25.779268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1749/3593] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:25 2022] DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:25.791278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98e0a5cb-66b7-4798-9d40-26c43fc83fa8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'create', calling method: .version_select at 0x7f6777a20ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-751099532", "description": "tempest-description-1559032756"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:25.798078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Calling method '.version_select at 0x7f67778b5a60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:25.867832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:25.868779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:25.869475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:25.871938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:25.872664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:25.876745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:25.934355 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-39d72cc2-35d1-4fa6-b49c-312b3449417f tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.542167 Oct 10 10:54:25.935923 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1845/3594] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Oct 10 10:54:25 2022] GET /compute/v2.1/limits => generated 511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:25.951640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:25.954565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:25.968482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:25.969360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:25.970218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:25.976995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:25.977797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:25.978491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:26.344929 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98e0a5cb-66b7-4798-9d40-26c43fc83fa8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.557546 Oct 10 10:54:26.353793 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1750/3595] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:54:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:26.357696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1571036177", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:26.414170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:26.425968 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc9af7ed-e8b0-49f5-9b49-6800c7c91363 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.487122 Oct 10 10:54:26.426639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1846/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:25 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:26.445217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29a1652-9075-4b3c-af3e-5e1901adedd5", "name": "network-vif-plugged", "status": "completed", "tag": "a46b5cf3-fb56-4c52-b129-b79d388301c0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:26.458451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:26.459771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:26.460304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:26.484647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] Creating event network-vif-plugged:a46b5cf3-fb56-4c52-b129-b79d388301c0 for instance e29a1652-9075-4b3c-af3e-5e1901adedd5 on n-h2-860687-2 Oct 10 10:54:26.490626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7466dee8-08b3-4d9d-bbc5-1353ec5cfe44 req-ac4d1a78-f5ab-4c67-95d9-5a67db27725c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061138 Oct 10 10:54:26.491925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1847/3597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:26.498241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f81f7be-4872-4616-8597-b811770f0dc1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Action: 'update', calling method: .version_select at 0x7f6777898b80>, body: {"security_group": {"name": "tempest-sg-hth-606624112", "description": "tempest-description-hth-1768593322"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:26.541056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:54:27.116637 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f81f7be-4872-4616-8597-b811770f0dc1 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8" status: 200 len: 217 microversion: 2.1 time: 0.623169 Oct 10 10:54:27.117570 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1848/3598] 10.222.0.16 () {60 vars in 1290 bytes} [Mon Oct 10 10:54:26 2022] PUT /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8 => generated 217 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:27.122869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:27.123957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:27.149570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:27.150532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:27.151301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:27.152325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:27.153071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:27.156479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:27.309074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Getting quotas for project 849eaa85da6b4a71a8fbe2523f1b6f16. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:27.322365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Getting quotas for user 6bf91cec8cdc4cb99099122ee2652514 and project 849eaa85da6b4a71a8fbe2523f1b6f16. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:27.371862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Request method failure captured: Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 1752 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_nhdUDvRurCVxHeMDTRH0RhbwUtkjyOqoH85OKTttCQVccKtjJq3fxfU2MlmbxDQbeZAJr-bWhZUlnkvc_YZe4iaDKKMHa2hifGQX1QMWEpLkQfi7YjZiidU3FfkRsNORzhK5ZSNRrT56tteejqX5rliiscU-OMB0JbMZHmzP1FEnc Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 849eaa85da6b4a71a8fbe2523f1b6f16 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-949935376 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/849eaa85da6b4a71a8fbe2523f1b6f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_849eaa85da6b4a71a8fbe2523f1b6f16", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/849eaa85da6b4a71a8fbe2523f1b6f16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/849eaa85da6b4a71a8fbe2523f1b6f16"}]}] Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-949935376 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 849eaa85da6b4a71a8fbe2523f1b6f16 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-949935376 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-949935376-project Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6bf91cec8cdc4cb99099122ee2652514 Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-949935376-project Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1571036177", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:27.377188 n-d-860687-2 devstack@n-api.service[128801]: exception: Maximum number of metadata items exceeds 128 Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1571036177', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:54:27.380837 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 10 10:54:27.384616 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:27.391430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:27.395260 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b89fe4f4-f35b-4bd0-a812-0daa2e4885f3 tempest-AbsoluteLimitsNegativeTestJSON-949935376 tempest-AbsoluteLimitsNegativeTestJSON-949935376-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.048232 Oct 10 10:54:27.397394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1751/3599] 10.222.0.16 () {60 vars in 1148 bytes} [Mon Oct 10 10:54:26 2022] POST /compute/v2.1/servers => generated 87 bytes in 1051 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:54:27.403471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a38d2a38-2868-41aa-96c7-90e77d017836 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a20430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:27.467984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:27.487974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:27.500131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:27.503823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36978e55-548b-44f5-8e78-7b0c093dc500 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.384421 Oct 10 10:54:27.513929 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1849/3600] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:27 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:27.521252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:27.531064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:27.540205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a38d2a38-2868-41aa-96c7-90e77d017836 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8" status: 200 len: 217 microversion: 2.1 time: 0.115745 Oct 10 10:54:27.541914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1752/3601] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:54:27 2022] GET /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8 => generated 217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:27.552096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:27.559604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:27.560313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c44b1ef-a858-474f-aecf-da69ca414c86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a20790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:27.561848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:27.562717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:27.563904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:27.566205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:27.924414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:27.958873 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4736b73-c844-4509-af55-bff270071726 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1309 microversion: 2.1 time: 0.441966 Oct 10 10:54:27.962053 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1850/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:27 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:28.055991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c44b1ef-a858-474f-aecf-da69ca414c86 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8" status: 202 len: 0 microversion: 2.1 time: 0.500945 Oct 10 10:54:28.059906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1753/3603] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:27 2022] DELETE /compute/v2.1/os-security-groups/49c76626-64f6-451a-8ebe-b7d663032fc8 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:54:28.065212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.065958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:28.076426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.076974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.077391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.078123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.078590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.079051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.140110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c HTTP/1.1 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'acdef82c-fbaf-4940-95bc-f23d9bb1e08c'} Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:28.141884 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f60a880-389b-48eb-b94a-bc4853b3033e tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 404 len: 111 microversion: 2.1 time: 0.082466 Oct 10 10:54:28.150466 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1851/3604] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.152509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.152676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: acdef82c-fbaf-4940-95bc-f23d9bb1e08c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:28.166764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.167298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.167753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.168483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.168950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.169379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.203049 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c HTTP/1.1 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'acdef82c-fbaf-4940-95bc-f23d9bb1e08c'} Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.210024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. Oct 10 10:54:28.215325 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.218597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Instance acdef82c-fbaf-4940-95bc-f23d9bb1e08c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.225100 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f07d6d18-ef5c-4437-a362-b63b82c81825 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c" status: 404 len: 111 microversion: 2.1 time: 0.076797 Oct 10 10:54:28.226209 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1754/3605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:28 2022] GET /compute/v2.1/servers/acdef82c-fbaf-4940-95bc-f23d9bb1e08c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.235580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f677782e670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.285060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.289916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 4fa0e419-47ea-4507-b613-7a6a7470f307 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.290717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.290717 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307 HTTP/1.1 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4fa0e419-47ea-4507-b613-7a6a7470f307'} Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.293054 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] Oct 10 10:54:28.301239 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.306730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 4fa0e419-47ea-4507-b613-7a6a7470f307 does not exist Oct 10 10:54:28.306730 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-bd14ed57-e695-4fce-a280-a5b3077fe86c'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.307774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3112d3b1-c894-446d-b884-8d6977be3656 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307" status: 404 len: 194 microversion: 2.1 time: 0.077631 Oct 10 10:54:28.310058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1852/3606] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/4fa0e419-47ea-4507-b613-7a6a7470f307 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.319852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a050d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.464166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.464792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.465317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.465317 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1 HTTP/1.1 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '5832cdaf-7a65-4f10-8c32-c62f53d319b1'} Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.468514 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 5832cdaf-7a65-4f10-8c32-c62f53d319b1 does not exist Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-073c3e9a-a30c-4ad9-b7d4-abd502a48170'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4921a1f7-4c54-4f9b-8990-3000b04d9a52 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1" status: 404 len: 194 microversion: 2.1 time: 0.155748 Oct 10 10:54:28.473471 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1755/3607] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/5832cdaf-7a65-4f10-8c32-c62f53d319b1 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.479841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f67778391f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.524741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.525880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.526425 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.526425 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92 HTTP/1.1 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '07e5c8fd-3ba3-41b1-8f51-778a70b62a92'} Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.528465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] Oct 10 10:54:28.532892 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.538384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 07e5c8fd-3ba3-41b1-8f51-778a70b62a92 does not exist Oct 10 10:54:28.538384 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-5848a33f-2fae-4f78-acb5-b06ff828c1dc'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.539855 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccdf4265-00d1-4027-971f-c13d6b887d6a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92" status: 404 len: 194 microversion: 2.1 time: 0.063565 Oct 10 10:54:28.545340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.546011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:28.547960 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1853/3608] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/07e5c8fd-3ba3-41b1-8f51-778a70b62a92 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.567719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f677782e280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.569820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.570319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.575598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.576355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.576834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.577272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.639815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.640637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.641353 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.641353 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6 HTTP/1.1 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '495ba65d-ff3e-4663-b9b4-0f223749d1a6'} Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.644052 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] Oct 10 10:54:28.648546 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.652335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 495ba65d-ff3e-4663-b9b4-0f223749d1a6 does not exist Oct 10 10:54:28.652335 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c6b958eb-18b9-48f5-884e-0dfc7afe9189'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.653470 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3a1e8ab-7559-4360-8069-b67636ae11d3 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6" status: 404 len: 194 microversion: 2.1 time: 0.100271 Oct 10 10:54:28.654516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1854/3609] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/495ba65d-ff3e-4663-b9b4-0f223749d1a6 => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:54:28.667701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777839dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.729582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.730422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group 66ad2a68-70e7-41fd-a97e-28037bfafeca not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.731247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.731247 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca HTTP/1.1 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '66ad2a68-70e7-41fd-a97e-28037bfafeca'} Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.733519 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] Oct 10 10:54:28.739579 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.748342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group 66ad2a68-70e7-41fd-a97e-28037bfafeca does not exist Oct 10 10:54:28.748342 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-c7d6e75c-419b-40d7-8f0b-85c671da86c4'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.748342 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bbe02b19-26c4-42bb-bf45-332ad4d5a794 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca" status: 404 len: 194 microversion: 2.1 time: 0.083245 Oct 10 10:54:28.748342 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1855/3610] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/66ad2a68-70e7-41fd-a97e-28037bfafeca => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:28.764724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f677782e670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.897548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:28.913647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:28.914063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:54:28.914806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Neutron security group f04003da-834a-4b41-8328-20772bef6b48 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:54:28.915484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.915484 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.917166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 HTTP/1.1 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f04003da-834a-4b41-8328-20772bef6b48'} Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:54:28.917672 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Security group f04003da-834a-4b41-8328-20772bef6b48 does not exist Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-768bac32-a163-4e51-8c57-f3d250d2f757'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e06f723-9ac3-43da-b32c-d49cd6dd44c8 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48" status: 404 len: 194 microversion: 2.1 time: 0.168678 Oct 10 10:54:28.922265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1856/3611] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/os-security-groups/f04003da-834a-4b41-8328-20772bef6b48 => generated 194 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:54:28.932620 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b26aec3-bcbf-43b7-83b9-e7d2b7d15b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.391874 Oct 10 10:54:28.933760 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1756/3612] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:28 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:54:28.937443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.938073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:28.964602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.968143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.969198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.970265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:28.972961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:28.974336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:28.998001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:28.999188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.012780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.014761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.016412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.017387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.020868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.021576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.034545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:29.192293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb8b2a01-cdf2-43f4-98ba-7e857206d8e2 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 204 len: 0 microversion: 2.1 time: 0.264611 Oct 10 10:54:29.197158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1857/3613] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:28 2022] DELETE /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:29.210052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:29.211195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.226467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.228223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.231115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.232157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.233651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.235176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.371455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:29.396872 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5097c82a-d4af-4917-a41c-a207f133da8f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1490 microversion: 2.1 time: 0.402368 Oct 10 10:54:29.398299 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1757/3614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:28 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1490 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:29.426705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1452969734"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:29.430016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.446932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.448278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.449435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.451701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.453165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.455067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.552143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:29.561238 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adf99269-ad7a-462c-9e6b-14f691ea83a9 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "PUT /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1075 microversion: 2.1 time: 0.141153 Oct 10 10:54:29.562505 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1758/3615] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:54:29 2022] PUT /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1075 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:29.591176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:29.592229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.601858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.604044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.604731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.605702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.606574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:29.607284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:29.805015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:29.817884 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee8a338e-ece4-47a7-b8a5-b8e84bf0377a tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1649 microversion: 2.1 time: 0.615659 Oct 10 10:54:29.820447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1858/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:29 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1649 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:29.936508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:29.946078 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53cbf4ee-2d9b-4772-a4e6-e72ccd8f9c06 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1501 microversion: 2.1 time: 0.362893 Oct 10 10:54:29.954847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1759/3617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:29 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:29.973797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:29.978935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:29.982196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.988335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:29.993929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:29.998963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.003920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.007016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.007716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.009631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.010402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.015081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.016552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.017681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.023561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.024176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.428398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:30.442181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:30.447149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:30.449557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:30.454752 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d739928-1481-4aa2-b052-cacb2ee15967 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.494270 Oct 10 10:54:30.458540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1859/3618] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:29 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:30.483703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-870f10c3-d785-4a1a-996c-068ac84b0ee3 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1501 microversion: 2.1 time: 0.508488 Oct 10 10:54:30.503434 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1760/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:29 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1501 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:30.521200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:30.532820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.533557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.534925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.570079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 10:54:30.642624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:30.701474 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70eb354c-72ca-4f33-8ec5-63a3806009a8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "POST /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5/action" status: 202 len: 0 microversion: 2.1 time: 0.185668 Oct 10 10:54:30.702913 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1860/3620] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:54:30 2022] POST /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:54:30.712289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:30.713076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:30.723847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.724353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.724783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.731278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.732156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.732966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.851115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:30.852070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:30.868242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.868749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.869201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:30.869911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:30.870374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:30.870806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:31.229398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:31.247495 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb0b8acb-f012-496d-bad0-dd9ff0231b5b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.539427 Oct 10 10:54:31.249098 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1761/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:30 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:31.403070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:31.411914 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8fe8bacc-b6e1-42da-8062-b1872c8bf22f tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1649 microversion: 2.1 time: 0.567765 Oct 10 10:54:31.412689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1861/3622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:30 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1649 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:31.490407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:31.491988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:31.506179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:31.511172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:31.514107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:31.515037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:31.516032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:31.517875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:31.782594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d1582b-8e1f-4c1d-a264-df09c4b299a0", "name": "network-vif-deleted", "tag": "00991c4b-73a0-4011-b7b0-52f412ed1717"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:31.820389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:31.821551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:31.823311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:31.865659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] Creating event network-vif-deleted:00991c4b-73a0-4011-b7b0-52f412ed1717 for instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 on n-h1-860687-2 Oct 10 10:54:31.876903 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f717e525-2838-4d4f-8fbe-db5c41db7366 req-5c863bf0-1ba3-4cfd-b9b8-9d7e1c2a2ead service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099161 Oct 10 10:54:31.881444 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1862/3623] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:54:31.896982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:31.913790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:31.916302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:31.917983 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc6f23fa-8d3a-49c4-ba79-b984e38bf9b6 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.433866 Oct 10 10:54:31.918816 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1762/3624] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:31 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:32.278356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:32.279106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:32.301069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.304915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.307160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.308357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.309023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.310331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.441354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:32.442213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:32.460146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.463160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.464598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.465565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.467911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.472097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.576369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.580446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.584619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.585241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lazy-loading 'fault' on Instance uuid d9d1582b-8e1f-4c1d-a264-df09c4b299a0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:54:32.786636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae91e3c6d1148b1b67838994ec1240b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e59b8262d82433a902c54c840251330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:32.794432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eab4f53b-85df-4197-9a52-04138a951e96 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 200 len: 1306 microversion: 2.1 time: 0.359023 Oct 10 10:54:32.818110 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1763/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:32 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 1306 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:32.958344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:32.959028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:32.966612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.973203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.973203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.973668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:32.974086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:32.974534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:32.993375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:33.001253 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9b0f32b-63af-4e29-8805-a96728eea982 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.727993 Oct 10 10:54:33.005476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1863/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:32 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:33.307378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:33.326666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:33.332572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:33.337429 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec80e7f4-2b52-4228-be93-764dded3b4ff tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.383144 Oct 10 10:54:33.344292 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1764/3627] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:32 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:54:33.818793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:33.819457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] [instance: d9d1582b-8e1f-4c1d-a264-df09c4b299a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:33.838303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:33.838820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:33.839299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:33.840036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:33.840507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:33.841197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:33.898221 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] HTTP exception thrown: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Request method failure captured: Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 HTTP/1.1 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_l-KOZmunJM3THB6a6LANaXy6XTNEmMNEPu-WSsYUzKNAe8KTwsb4BeJrxjxnWkuZo8zKTcnxqdaeH4Zn2i8eFlOK9CXMaeDRrKZDVUQCQixaaTcytCuhoQxv806nfT_svuvKdUGry0bm-gLGU_nWKn4JiGojaWh7o87_ad7wZeads Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0e59b8262d82433a902c54c840251330", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0e59b8262d82433a902c54c840251330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0e59b8262d82433a902c54c840251330"}]}] Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0e59b8262d82433a902c54c840251330 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-657988113 Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7ae91e3c6d1148b1b67838994ec1240b Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupsTestJSON-657988113-project Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd9d1582b-8e1f-4c1d-a264-df09c4b299a0'} Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:33.900178 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Returning 404 to user: Instance d9d1582b-8e1f-4c1d-a264-df09c4b299a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:33.904778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-afd17607-864b-4e8d-8407-e4277a31e579 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0" status: 404 len: 111 microversion: 2.1 time: 0.087662 Oct 10 10:54:33.915993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb73f0ec-f820-40a1-bc01-2424384b5542 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a7a550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:33.921804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1864/3628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:33 2022] GET /compute/v2.1/servers/d9d1582b-8e1f-4c1d-a264-df09c4b299a0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:54:34.032237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:34.032866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:34.045745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:34.053817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:34.064037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:34.065168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:34.066352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:34.066966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:35.326574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:35.345624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-251a0dc3-9670-43d5-a87b-215ab6082a87 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 1.317195 Oct 10 10:54:35.347655 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1865/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:34 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:54:35.361043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:35.361916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:35.376554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:35.378687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:35.380389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:35.381534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:35.384525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:35.385148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:35.853132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:35.905338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:36.202309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb73f0ec-f820-40a1-bc01-2424384b5542 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/55c05929-f58d-43a2-92fa-89c9613c9e92" status: 202 len: 0 microversion: 2.1 time: 2.290115 Oct 10 10:54:36.202901 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1765/3630] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:33 2022] DELETE /compute/v2.1/os-security-groups/55c05929-f58d-43a2-92fa-89c9613c9e92 => generated 0 bytes in 2291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:36.212499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6c25e45-a04d-44c0-9db3-87b5a977c348 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] Calling method '.version_select at 0x7f6777a7a310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:36.411616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:36.426113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:36.427589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:36.446759 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb86615d-5c46-42b9-ad91-6bf83af6cac2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 1.079986 Oct 10 10:54:36.448563 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1866/3631] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:35 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:36.467969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:36.470477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:36.492328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:36.493167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:36.494588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:36.499998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:36.500882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:36.501804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:37.341884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:37.447755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:37.465559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec797591-570f-4582-a625-8db858566bc6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 1.013476 Oct 10 10:54:37.468588 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1867/3632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:36 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:37.481817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:37.482744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:37.502169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:37.505491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:37.506238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:37.507264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:37.519421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:37.524121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:37.731391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6c25e45-a04d-44c0-9db3-87b5a977c348 tempest-SecurityGroupsTestJSON-657988113 tempest-SecurityGroupsTestJSON-657988113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4cb3481e-e86f-4606-a049-51190c76b596" status: 202 len: 0 microversion: 2.1 time: 1.523376 Oct 10 10:54:37.731981 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1766/3633] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:54:36 2022] DELETE /compute/v2.1/os-security-groups/4cb3481e-e86f-4606-a049-51190c76b596 => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:54:37.941503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:37.954288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:37.958234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:37.963923 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-21d2d2e3-e1aa-4f3d-b78c-a1a61e9560d2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.489172 Oct 10 10:54:37.982899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1868/3634] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:37 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:38.493996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:38.494803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:38.511401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:38.527881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:38.536075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:38.539112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:38.544859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:38.545615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:38.549915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:38.991575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:38.992366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:39.012407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:39.013362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:39.021841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:39.022866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:39.023605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:39.024306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:39.393563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:39.425732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4f3e138-a47f-4ff2-8f97-9ab1e3b0f969 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.928879 Oct 10 10:54:39.426403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1767/3635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:38 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:39.654043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:39.665582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:39.669866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:39.675255 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da5c7557-3e5c-477d-b516-def330346a7e tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1737 microversion: 2.20 time: 0.685616 Oct 10 10:54:39.676188 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1869/3636] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:38 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1737 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:40.449385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:40.449976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:40.462880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:40.463418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:40.466543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:40.467533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:40.470980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:40.471916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:40.708785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:40.710143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:40.738672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:40.740979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:40.743543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:40.744610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:40.747655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:40.748433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:41.161008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:41.180099 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-210b2116-d74b-4498-ab9a-b2713c8b067d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.732445 Oct 10 10:54:41.183497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1768/3637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:40 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:41.360168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:41.374003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:41.382088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:41.386277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f940634e-5e5f-47ed-8238-7c05eb028fc9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1719 microversion: 2.20 time: 0.681107 Oct 10 10:54:41.413555 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1870/3638] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:40 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1719 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:42.226217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:42.226912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:42.243919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:42.251357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:42.252024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:42.253721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:42.254145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:42.254689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:42.422881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:42.426643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:42.433428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:42.462543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:42.463166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:42.463617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:42.466840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:42.469529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:42.470204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:42.921326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:42.930011 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78405dcf-e773-453f-83c7-7a69e684cc29 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.726927 Oct 10 10:54:42.930595 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1769/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:42 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:43.287791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:43.297383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:43.304197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:43.306867 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f21a10e5-d95c-46a8-81cc-abea2d23ba73 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1719 microversion: 2.20 time: 0.886994 Oct 10 10:54:43.325973 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1871/3640] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:42 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1719 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:54:43.453326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1374102639", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "11abe73d-7bf6-4bbe-b58c-468c4ab22b45"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:43.537692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] validate_networks() for [('11abe73d-7bf6-4bbe-b58c-468c4ab22b45', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:54:43.954852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:43.956135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:43.990973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:43.991661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:43.996996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:44.000899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:44.006603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:44.008907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:44.499514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:54:44.500567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:54:44.501265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:54:44.501854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:54:44.502520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:54:44.522286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:44.526602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:44.527297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:44.528269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:44.530446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:44.531511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:44.618293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Getting quotas for project 83ce62fedf9b4825b27f030dbba6bec2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:54:44.650773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Getting quotas for user e50330154c7f4aa0bc03441fcb618804 and project 83ce62fedf9b4825b27f030dbba6bec2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:54:44.719816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:54:44.729194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:54:44.836050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e9a17c9-34f9-4b31-809d-59704d00a7e8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618222 Oct 10 10:54:44.838760 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1770/3641] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:54:44.852280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:44.854088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:44.867517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:44.868262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:44.868874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:44.869756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:44.870515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:44.871171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:45.557741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:45.570719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-210bf199-165e-41cd-a9c0-a8c5d1a3fe1d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 1.620703 Oct 10 10:54:45.581360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1872/3642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:43 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:45.597518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "name": "network-vif-unplugged", "status": "completed", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:45.643450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:45.647727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:45.649118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:45.685589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_external_events [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] Unable to find a host for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14. Dropping event network-vif-unplugged {{(pid=128800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 10:54:45.687459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d4d82600-fb3d-4503-aaa6-47ef018176bb req-2ee36787-7168-4b92-bbd1-4050f459882a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.103148 Oct 10 10:54:45.693280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1873/3643] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 10:54:45.707359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-752433d1-fb3f-4284-bb45-8d1b5b547fc4 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:45.710049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-752433d1-fb3f-4284-bb45-8d1b5b547fc4 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:45.944548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-752433d1-fb3f-4284-bb45-8d1b5b547fc4 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:45.960575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-752433d1-fb3f-4284-bb45-8d1b5b547fc4 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1225 microversion: 2.1 time: 0.265058 Oct 10 10:54:45.964559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1874/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:45 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1225 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:45.980501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:45.983663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:45.998664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:45.999490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.000102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.001926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.003861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.004521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.027538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:46.035472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:46.045070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:46.046303 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfbc055c-8e36-47ba-ab18-c2f5ff6e3b02 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1662 microversion: 2.20 time: 1.205810 Oct 10 10:54:46.046873 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1771/3645] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:44 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1662 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:46.078301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3081fb91-a4d9-4485-83cc-43a08103cb72"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:46.080196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:54:46.081538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:46.101757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.111835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.115339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.116294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.116940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.117810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.350747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d135c700-edd6-4b48-8b01-dc508aa209f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 204 len: 0 microversion: 2.1 time: 0.381312 Oct 10 10:54:46.351731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1875/3646] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:45 2022] DELETE /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:46.370030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:46.376022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:46.398242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.398737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.402044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.404666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.410592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.411315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.876664 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5223447-b3c7-4db8-82a5-3a1db53127e9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.802145 Oct 10 10:54:46.877634 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1772/3647] 10.222.0.16 () {62 vars in 1364 bytes} [Mon Oct 10 10:54:46 2022] POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments => generated 188 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:54:46.888860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:46.888860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:46.901643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.905159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.910915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:46.912070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:46.912799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:46.913460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:47.095750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:47.129114 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9155660-f8ac-43a5-9790-5976ee96f3ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1553 microversion: 2.1 time: 0.770754 Oct 10 10:54:47.150321 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1876/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:46 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1553 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:47.202522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:47.203382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:47.231079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:47.247577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:47.248318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:47.251686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:47.255379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:47.261203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:47.706019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:47.718497 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7bc7383d-4db8-4b64-91a8-5b46ae43401c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1285 microversion: 2.1 time: 0.566662 Oct 10 10:54:47.725257 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1877/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:47 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1285 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:47.746655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:47.747564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:47.754916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:47.755656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:47.756280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:47.757168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:47.758064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:47.759388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:47.765770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:47.808981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:47.823385 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5618c66d-29af-4a60-b8dd-54d9404b7724 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.943907 Oct 10 10:54:47.825108 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1773/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:46 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:47.931171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a660743-d9ec-430a-acf9-ea8fd16499d9 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a961f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2056354233", "description": "tempest-description-1129486672"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:48.338097 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04e0e171-27e0-4aad-bd3b-831e63df7403 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments/3081fb91-a4d9-4485-83cc-43a08103cb72" status: 202 len: 0 microversion: 2.20 time: 0.596547 Oct 10 10:54:48.388396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1878/3651] 10.222.0.16 () {60 vars in 1457 bytes} [Mon Oct 10 10:54:47 2022] DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments/3081fb91-a4d9-4485-83cc-43a08103cb72 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:48.413197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:48.414187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:48.421885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:48.423531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:48.424940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:48.425934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:48.426571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:48.427273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.149567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:49.164018 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-14788bec-373c-4ba4-afa8-7e2c261b9532 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1553 microversion: 2.1 time: 0.774219 Oct 10 10:54:49.164852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1879/3652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:48 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1553 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:49.182389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:49.183051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:49.193168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.193662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.202825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.204104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.206990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.207709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.354886 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a660743-d9ec-430a-acf9-ea8fd16499d9 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.512597 Oct 10 10:54:49.357367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1774/3653] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:54:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:49.368888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:49.370758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:49.401969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.402988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.404291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.405303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.406348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.407042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.444657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:49.566798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:49.579674 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41d97bfc-5154-4554-9fad-b95949f4054c tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1283 microversion: 2.1 time: 0.220402 Oct 10 10:54:49.584333 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1775/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:49 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:49.600767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:49.605227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:49.685781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.694764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.700445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:49.701999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:49.710303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:49.713051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:50.043818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128800) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 10:54:50.215128 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d20fdbb3-a37a-465e-b940-ec877b249c16 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/action" status: 202 len: 0 microversion: 2.20 time: 1.048983 Oct 10 10:54:50.217135 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1880/3655] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:54:49 2022] POST /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/action => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:54:50.243491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47b1dd45-bf96-4a4f-bd41-7658ffcd2f5f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6780c64310>, body: {"security_group_rule": {"parent_group_id": "7bfe071e-95cd-4365-9f31-cd37d84d17f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:50.350819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:50.363107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61b1ead2-fd0c-44cf-8be6-4bc9a29cc160 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.768125 Oct 10 10:54:50.367352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1776/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:49 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:50.378653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:50.381332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:50.396929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:50.397396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:50.397831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:50.398534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:50.398985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:50.399425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:50.464521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'flavor' on Instance uuid 2abe118a-f500-425e-93eb-942ff0e4501c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:54:50.903870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a4cbc1f-3f98-44ca-9268-ce988e9eafd0 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/action" status: 200 len: 32 microversion: 2.1 time: 0.535003 Oct 10 10:54:50.909847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1777/3657] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:54:50 2022] POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/action => generated 32 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:54:50.917323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:50.918278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:50.926741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:50.927495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:50.928099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:50.928962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:50.929846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:50.930743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:51.344763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:51.356971 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4254387f-cd04-4dde-89ac-75380edb0056 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1345 microversion: 2.1 time: 0.445552 Oct 10 10:54:51.375471 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1778/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:50 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1345 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:51.381017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:51.381631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:51.386423 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47b1dd45-bf96-4a4f-bd41-7658ffcd2f5f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.168159 Oct 10 10:54:51.395745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1881/3659] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:51.403608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c86870b-f556-4380-927d-029fbf5ed30d", "name": "network-vif-deleted", "tag": "7e13a7f0-1aa3-400e-9724-df74903b3ef0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:51.480394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:51.480893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:51.481336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:51.482057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:51.482519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:51.482947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:51.490942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:51.491508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:51.491959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:51.548213 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] Creating event network-vif-deleted:7e13a7f0-1aa3-400e-9724-df74903b3ef0 for instance 6c86870b-f556-4380-927d-029fbf5ed30d on n-h2-860687-2 Oct 10 10:54:51.568677 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a8a0dd19-44d7-4707-b55b-00b1f19a0929 req-dc5213f8-f867-4045-86ef-634d17edbee5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170433 Oct 10 10:54:51.577424 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1882/3660] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:51.595091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:51.608997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:51.643895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:51.644504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:51.645042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:51.651233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:51.652374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:51.653156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:52.336016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:52.347531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:52.356047 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00d9a172-a080-41cf-8ad8-4581ff02a254 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.777049 Oct 10 10:54:52.358782 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1883/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:51 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:52.361682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:52.366749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:52.367778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:52.369026 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3baba45-5aa0-4222-83c8-3e2a4118a8c5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1670 microversion: 2.20 time: 0.992559 Oct 10 10:54:52.388444 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1779/3662] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:51 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1670 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:52.389244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:52.389658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:52.389658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:52.394005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:52.410063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:52.410616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:52.411485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:52.411971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:52.412410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:52.417515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:52.418032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:52.418471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:52.423272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:52.424408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:52.425127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:53.025065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:53.038717 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-643d8ef5-80cf-486c-8728-75dd943bb917 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.666892 Oct 10 10:54:53.040786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1780/3663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:52 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:53.051472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:53.060769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10f97263-3bc4-468f-a2d0-24b682f32433 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a7c820>, body: {"security_group_rule": {"parent_group_id": "7bfe071e-95cd-4365-9f31-cd37d84d17f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:53.066780 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1033d00a-e640-4819-af11-cf116f9c5afa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.705313 Oct 10 10:54:53.069491 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1884/3664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:52 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:53.085658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:53.087205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:53.101316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:53.102530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:53.105401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:53.106511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:53.107487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:53.108156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:53.294408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:53.311791 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-166d64b8-d7d1-4718-8136-feee5996048f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1345 microversion: 2.1 time: 0.240729 Oct 10 10:54:53.313793 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1885/3665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:53 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1345 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:53.336576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-10f97263-3bc4-468f-a2d0-24b682f32433 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10f97263-3bc4-468f-a2d0-24b682f32433 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 138 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "7bfe071e-95cd-4365-9f31-cd37d84d17f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: exception: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7bfe071e-95cd-4365-9f31-cd37d84d17f9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:53.339246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:53.344313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:53.344313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:53.344313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 Oct 10 10:54:53.344313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:53.344909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10f97263-3bc4-468f-a2d0-24b682f32433 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: This rule already exists in group 7bfe071e-95cd-4365-9f31-cd37d84d17f9 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:53.346397 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10f97263-3bc4-468f-a2d0-24b682f32433 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.303938 Oct 10 10:54:53.348155 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1781/3666] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:53 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:54:53.356746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a3f4148b-a09e-4dd8-844c-9af4c3f53985 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f677c0a1dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:53.386041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:53.386986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:53.398970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:53.402270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:53.403620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:53.408453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:53.409189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:53.409819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:54.166196 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a3f4148b-a09e-4dd8-844c-9af4c3f53985 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/e2f1b232-23d6-4897-b5e0-14cf99b6887f" status: 202 len: 0 microversion: 2.1 time: 0.813734 Oct 10 10:54:54.167399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1886/3667] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Oct 10 10:54:53 2022] DELETE /compute/v2.1/os-security-group-rules/e2f1b232-23d6-4897-b5e0-14cf99b6887f => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:54:54.172429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:54.173247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:54.193259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:54.194131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:54.194767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:54.195696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:54.196518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:54.197115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:54.572950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:54.599363 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9932f700-cb74-459a-864f-5be733a69b32 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 1.217351 Oct 10 10:54:54.607077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1782/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:53 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:54.609167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:54.615745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:54.616627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:54.635766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:54.636639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:54.637348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:54.638304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:54.639024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:54.639744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:54.699893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:55.083870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:55.122028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:55.137612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:55.142382 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5eb12a6f-15be-4701-955d-ee93fea6b07f tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.973794 Oct 10 10:54:55.149748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1887/3669] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:54 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:55.175679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:55.177858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:55.212683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:55.213347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:55.213818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:55.214574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:55.219218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:55.223107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:55.298993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:55.309963 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c71c140-a6c1-4edd-9a6b-216f736bfaf4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1511 microversion: 2.1 time: 0.701399 Oct 10 10:54:55.312236 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1783/3670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:54 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:55.322781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46ba68b6-4d35-4d16-89c7-058ec020d0d9 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a20040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2065199131", "description": "tempest-description-1647856800"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:55.944652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:55.960156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3decc92-bda6-4587-8ece-3acbe14349db tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.808946 Oct 10 10:54:55.966588 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1888/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:55 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:55.983853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:55.984879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:56.006391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:56.013833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.014640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.017783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.019664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.021721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.023711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.251492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:56.265383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-49f247f3-1304-4137-b243-f6e0d2251bac tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1345 microversion: 2.1 time: 0.296553 Oct 10 10:54:56.266929 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1889/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:55 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1345 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:56.290990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:56.303963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:56.311186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.311898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.312521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.313425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.314054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.315258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.378861 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46ba68b6-4d35-4d16-89c7-058ec020d0d9 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.064190 Oct 10 10:54:56.379530 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1784/3673] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:54:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:56.383941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:56.413389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.414166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.414769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.438777 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] Creating event network-changed:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h1-860687-2 Oct 10 10:54:56.446708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-38f71cd6-33ed-44f6-88f8-d15bc5117e3c req-7fb82c54-573f-4160-85d6-48033be600de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065865 Oct 10 10:54:56.450145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1785/3674] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:56.474280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634577f5-5c26-4747-b8d4-d4d1678bb032", "tag": "5840ad63-8d6d-475a-87c6-f10674c49b63"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:56.484511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.484871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.485300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.510373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] Creating event network-changed:5840ad63-8d6d-475a-87c6-f10674c49b63 for instance 634577f5-5c26-4747-b8d4-d4d1678bb032 on n-h1-860687-2 Oct 10 10:54:56.517981 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-20748a40-b2fd-4651-8549-39b9d46fb894 req-96130720-aa19-4b31-b5a8-4ff808358ffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065510 Oct 10 10:54:56.518610 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1786/3675] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:56.543433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:56.544141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:56.575554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.576284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.576751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.577464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.577921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.578344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.689108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:56.702316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-069b7ea6-50a3-4648-835d-8aba1320ae49 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.415133 Oct 10 10:54:56.711547 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1890/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:56 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:56.727748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:56.732652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:56.744958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.748796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.749545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:56.752998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:56.754705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:56.756369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.213904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.229048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.236746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.239017 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccbf122b-1a4e-4512-8aa9-b7a9f9d1e434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.719159 Oct 10 10:54:57.239946 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1787/3677] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:56 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:57.247280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-247efda9-d283-4124-a157-97dcc3d50317 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f67779c9af0>, body: {"security_group_rule": {"parent_group_id": "cc198794-d547-4c73-8567-b02b6175dd01", "ip_protocol": "tcp", "from_port": 1900458370, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:57.264101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.278137 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-782cd67b-7feb-4fba-a3e4-1e03427107a4 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1488 microversion: 2.1 time: 0.565100 Oct 10 10:54:57.278743 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1891/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:56 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1488 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:57.314150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:57.315225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:57.329147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.331729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.332787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.335969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.336966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.337644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.365026 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-247efda9-d283-4124-a157-97dcc3d50317 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Invalid port range 1900458370:22. Former value cannot be greater than the later Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-247efda9-d283-4124-a157-97dcc3d50317 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 146 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "cc198794-d547-4c73-8567-b02b6175dd01", "ip_protocol": "tcp", "from_port": 1900458370, "to_port": 22}} Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid port range 1900458370:22. Former value cannot be greater than the later Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cc198794-d547-4c73-8567-b02b6175dd01', 'ip_protocol': 'tcp', 'from_port': 1900458370, 'to_port': 22}}} Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1900458370:22. Former value cannot be greater than the later Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1900458370:22. Former value cannot be greater than the later Oct 10 10:54:57.370687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1900458370:22. Former value cannot be greater than the later Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-247efda9-d283-4124-a157-97dcc3d50317 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: Invalid port range 1900458370:22. Former value cannot be greater than the later {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:57.375886 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-247efda9-d283-4124-a157-97dcc3d50317 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.131339 Oct 10 10:54:57.377614 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1788/3679] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:57 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:54:57.385438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:57.386165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:57.403384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.403886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.404330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.405039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.408057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.410485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.596905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.600868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:57.607227 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2962ae9e-5c75-43fa-ae3e-2c2a2463514c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1345 microversion: 2.1 time: 0.228308 Oct 10 10:54:57.607899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1789/3680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:57 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:57.612619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-983274018"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:57.615195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:57.621687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.622241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.622813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.623596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.624129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.624729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.626115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c1a7c2e-6293-4349-b763-8b3b3dcfda76 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.323090 Oct 10 10:54:57.627795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1892/3681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:57 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:57.633180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb1e4374-4a81-4deb-88b8-e865a8fe8724 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6780c9f3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1722732639", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:57.635385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-eb1e4374-4a81-4deb-88b8-e865a8fe8724 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Security group id should be uuid Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb1e4374-4a81-4deb-88b8-e865a8fe8724 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 131 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1722732639", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group id should be uuid Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1722732639', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:57.637176 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:57.642165 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 10 10:54:57.642165 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:57.644969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb1e4374-4a81-4deb-88b8-e865a8fe8724 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: Security group id should be uuid {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:57.645826 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb1e4374-4a81-4deb-88b8-e865a8fe8724 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016795 Oct 10 10:54:57.646410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1893/3682] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:57 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:54:57.656014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9eb559f5-8bb1-42dc-8fe8-197436438a2d tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777b4e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-200793809", "description": "tempest-description-327522766"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:57.751124 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2127e697-23df-4c0b-a2f0-17ef8275ca1c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "PUT /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1060 microversion: 2.1 time: 0.141541 Oct 10 10:54:57.769023 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1790/3683] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:54:57 2022] PUT /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1060 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:57.776710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:57.777543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:57.786690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.787512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.788347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:57.789755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:57.790457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:57.791074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.050611 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9eb559f5-8bb1-42dc-8fe8-197436438a2d tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.398724 Oct 10 10:54:58.051530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1894/3684] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:54:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:58.058023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:58.059871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:58.074039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.074667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.075261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.076329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.077020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.077786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.093036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:58.116317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bccb355b-3ddb-44dc-8b20-11325c82e76f tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.333023 Oct 10 10:54:58.117378 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1791/3685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:57 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:58.131126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d11f595f-aff7-404b-b4b2-a6d3e94b3028 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f677cadeb80>, body: {"security_group_rule": {"parent_group_id": "f4d5717b-a5fa-4229-b805-6028b399e903", "ip_protocol": "tempest-999-1281362821", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:58.248990 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d11f595f-aff7-404b-b4b2-a6d3e94b3028 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Invalid IP protocol tempest-999-1281362821. Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d11f595f-aff7-404b-b4b2-a6d3e94b3028 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 157 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "f4d5717b-a5fa-4229-b805-6028b399e903", "ip_protocol": "tempest-999-1281362821", "from_port": 22, "to_port": 22}} Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid IP protocol tempest-999-1281362821. Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f4d5717b-a5fa-4229-b805-6028b399e903', 'ip_protocol': 'tempest-999-1281362821', 'from_port': 22, 'to_port': 22}}} Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1281362821. Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1281362821. Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:58.250694 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1281362821. Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d11f595f-aff7-404b-b4b2-a6d3e94b3028 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: Invalid IP protocol tempest-999-1281362821. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d11f595f-aff7-404b-b4b2-a6d3e94b3028 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.132962 Oct 10 10:54:58.255759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1792/3686] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:58 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:54:58.279811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c96844c7-5874-4cb0-878e-c667500de914 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a7a940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-93643759", "description": "tempest-description-1515185251"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:58.394532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:58.410687 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45c7b19f-0ad9-400c-8af2-1f6dc2687e88 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1487 microversion: 2.1 time: 0.356782 Oct 10 10:54:58.413681 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1895/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:58 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1487 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:58.429827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:58.431206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:58.443828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.444699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.445782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.446987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.447679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.448819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.456920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:58.654846 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c96844c7-5874-4cb0-878e-c667500de914 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.388597 Oct 10 10:54:58.655841 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1793/3688] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:54:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:54:58.660492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:58.661319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:58.683606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.684929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.685108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.685835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:58.686300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:58.686735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:58.951982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:58.974489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:58.979083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:58.982052 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-885b3677-f6d1-419a-ad61-56d13f5b0ff9 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.564732 Oct 10 10:54:58.984070 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1896/3689] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:54:58 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:54:58.994186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:58.995161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:59.006862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.008171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.010359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.011510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.012463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.013659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.169160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:59.181753 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5ca3f6b-2729-4080-b152-5deee27eb73d tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1487 microversion: 2.1 time: 0.521715 Oct 10 10:54:59.182663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1794/3690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:58 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1487 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:59.191806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:59.192694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:59.197679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.198200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.202906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.203690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.206361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.207313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'fault' on Instance uuid 6c86870b-f556-4380-927d-029fbf5ed30d {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:54:59.209020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.209896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.210499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.211096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.316590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:59.328593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f2156c8-c43b-4f08-a098-7e6fa52b300c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 200 len: 1304 microversion: 2.1 time: 0.342110 Oct 10 10:54:59.329737 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1897/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:58 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:59.337970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be2e3eac-8ea5-4faa-99f3-86392cb9983f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f67778e54c0>, body: {"security_group_rule": {"parent_group_id": "da29febc-daea-4a37-a177-58fd4086c681", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:54:59.561984 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-be2e3eac-8ea5-4faa-99f3-86392cb9983f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be2e3eac-8ea5-4faa-99f3-86392cb9983f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 138 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: {"security_group_rule": {"parent_group_id": "da29febc-daea-4a37-a177-58fd4086c681", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'da29febc-daea-4a37-a177-58fd4086c681', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 10:54:59.565341 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:54:59.570949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be2e3eac-8ea5-4faa-99f3-86392cb9983f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:54:59.575447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be2e3eac-8ea5-4faa-99f3-86392cb9983f tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.240207 Oct 10 10:54:59.575447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1898/3692] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:54:59 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:54:59.585041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:59.586843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:59.601043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:54:59.608240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:54:59.623158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ee598c7-0849-4220-9e1d-23ce2e4bc5e9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.434226 Oct 10 10:54:59.623942 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1795/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:59 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:54:59.631715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.640633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.641181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.646174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:54:59.646957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:54:59.657649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.658342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.658855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.659542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.660053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.660496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.661221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:54:59.661686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:54:59.662116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:54:59.806522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:00.150048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f43bca26-b4b1-4180-a973-31a9c34ca8cb tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 204 len: 0 microversion: 2.1 time: 0.520532 Oct 10 10:55:00.153686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1796/3694] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:54:59 2022] DELETE /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:55:00.177322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f1fed9e-87a6-4164-859b-dee9ee543895 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a75f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1719010559", "description": "tempest-description-551060401"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:00.628730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:00.637567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-acddad6a-1b01-4340-a201-5bbb14fd7107 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 1.063802 Oct 10 10:55:00.638154 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1899/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:54:59 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:00.696232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:00.696843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:00.719541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:00.720065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:00.721436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:00.724098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:00.725620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:00.726282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:00.749706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f1fed9e-87a6-4164-859b-dee9ee543895 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.594626 Oct 10 10:55:00.750771 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1797/3696] 10.222.0.16 () {60 vars in 1180 bytes} [Mon Oct 10 10:55:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:00.756900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:00.758007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:00.776999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:00.780429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:00.784144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:00.785823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:00.787141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:00.788099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.090767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:01.111565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:01.115903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:01.117939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aeacda8d-783f-4253-806d-164b674ae999 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.453930 Oct 10 10:55:01.119576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1900/3697] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:00 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:01.125237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:01.126240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:01.136450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.137394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.138585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.144360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.145399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.146368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.180163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d HTTP/1.1 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '6c86870b-f556-4380-927d-029fbf5ed30d'} Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.181810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.187888 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.193453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:01.194589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe8b283e-c817-4b29-8283-2b1b74bdab4b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 404 len: 111 microversion: 2.1 time: 0.073510 Oct 10 10:55:01.211472 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1901/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:01 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:01.233561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:01.235974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:01.263353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.264119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.264811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.266223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.269690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:01.270717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.279539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.287896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91f7a7e5-fbf8-4d1e-aa8d-ecea5f6c4a6c tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1493 microversion: 2.1 time: 0.535859 Oct 10 10:55:01.292600 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1798/3699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:00 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1493 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:01.303087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d30e0ee-d63f-4d47-811e-f3e0a943fe8a tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6777a753a0>, body: {"security_group_rule": {"parent_group_id": "2b4c773d-6bbc-4ac5-a7a0-522b23252d44", "ip_protocol": "tcp", "from_port": 22, "to_port": 237906623}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:01.673140 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9d30e0ee-d63f-4d47-811e-f3e0a943fe8a tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d30e0ee-d63f-4d47-811e-f3e0a943fe8a tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 145 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "2b4c773d-6bbc-4ac5-a7a0-522b23252d44", "ip_protocol": "tcp", "from_port": 22, "to_port": 237906623}} Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b4c773d-6bbc-4ac5-a7a0-522b23252d44', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 237906623}}} Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 Oct 10 10:55:01.676021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d30e0ee-d63f-4d47-811e-f3e0a943fe8a tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 400 to user: Invalid port range 22:237906623. Valid TCP ports should be between 1-65535 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d30e0ee-d63f-4d47-811e-f3e0a943fe8a tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.383517 Oct 10 10:55:01.681411 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1799/3700] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:55:01 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:55:01.682881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:01.698869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:01.720338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.720878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.721321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.722036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.722686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.723467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.744342 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d/os-volume_attachments HTTP/1.1 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '6c86870b-f556-4380-927d-029fbf5ed30d'} Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:01.746296 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:01.752733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:01.758680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9fa7e31-2dac-4266-99f1-5e60e02b9292 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071977 Oct 10 10:55:01.770865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1800/3701] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:55:01 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d/os-volume_attachments => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:01.772795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:01.773412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:01.787603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.800710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.801336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:01.802204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:01.802757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:01.805502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:02.200286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:02.256639 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cea9d0e0-e152-4259-9c4f-e1e7a1936970 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 1.029929 Oct 10 10:55:02.261741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1902/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:01 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:02.312749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Action: 'create', calling method: .version_select at 0x7f6780d3d790>, body: {"security_group_rule": {"parent_group_id": "921dbac1-11fa-48ed-bd5a-cb936244b234", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:02.508955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG neutronclient.v2_0.client [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist", "detail": ""}} {{(pid=128800) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:55:02.509727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.security_group_api [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Neutron security group 921dbac1-11fa-48ed-bd5a-cb936244b234 not found {{(pid=128800) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 10:55:02.510379 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.510379 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 138 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: {"security_group_rule": {"parent_group_id": "921dbac1-11fa-48ed-bd5a-cb936244b234", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: exception: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'security_group_rule': {'parent_group_id': '921dbac1-11fa-48ed-bd5a-cb936244b234', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:55:02.512533 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 404 to user: Security group 921dbac1-11fa-48ed-bd5a-cb936244b234 does not exist Oct 10 10:55:02.519081 n-d-860687-2 devstack@n-api.service[128800]: Neutron server returns request_ids: ['req-1a9874e9-a70b-4097-ad62-af336f4972ca'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:02.524227 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27272705-519c-4178-a0a1-59e70af87743 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.247076 Oct 10 10:55:02.528026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1903/3703] 10.222.0.16 () {60 vars in 1195 bytes} [Mon Oct 10 10:55:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:02.533771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:02.534397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:02.586162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:02.589099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:02.591396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:02.594022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:02.594781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:02.600551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:02.692051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:02.703749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d849b0ab-6099-48fc-8b8a-e6c4b214ed3a tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.934366 Oct 10 10:55:02.725416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1801/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:01 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:02.731502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:02.737625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:02.749372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:02.753356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:02.754525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:02.757700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:02.759406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:02.762533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:03.601066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:03.612201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:03.615377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:03.619069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57e3e47c-3704-4789-abf3-c39b696fadd5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 1.089870 Oct 10 10:55:03.630123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:03.640060 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-832bc834-fb0b-4404-b916-a8aa34c49bb8 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 200 len: 1493 microversion: 2.1 time: 0.913175 Oct 10 10:55:03.668745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1904/3705] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:02 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:03.684229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055498145", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:03.686931 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1802/3706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:02 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 1493 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:03.716833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f6777a20e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:03.862508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:03.868847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 10:55:03.869443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Neutron security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc not found {{(pid=128801) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 10 10:55:03.871217 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] HTTP exception thrown: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.871217 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Request method failure captured: Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-group-rules/a4f04613-7831-4392-a1dd-3f1f88d968dc HTTP/1.1 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_n3jicvNR-04NVnIl86j7EggKdaMaPKVS8VPXquEFriLVWGJm64L6mB_Nce4XaXYhoRibaK0i_zOkvkcVkNN22ISbfDCEVNaa_zkPj5ZipDSYkxehfliw109DnNAjo2UEP4fMLcwjYgJD39fBZkFjM0_P8a2epCKCalC0nEQF-I7D8 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5d352222de654829a82747e1a3e95b69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5d352222de654829a82747e1a3e95b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5d352222de654829a82747e1a3e95b69"}]}] Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5d352222de654829a82747e1a3e95b69 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c080fc2b581a4ac38d4f55ea9f8d3992 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: exception: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a4f04613-7831-4392-a1dd-3f1f88d968dc'} Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 10:55:03.873578 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Returning 404 to user: Security group rule a4f04613-7831-4392-a1dd-3f1f88d968dc does not exist Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-ec1fbe8c-3bb6-4976-82fb-6f2e56f5780c'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef14eeb2-f96e-4686-b4b8-6c7b9ae3e4bd tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/a4f04613-7831-4392-a1dd-3f1f88d968dc" status: 404 len: 199 microversion: 2.1 time: 0.181822 Oct 10 10:55:03.881125 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1803/3707] 10.222.0.16 () {58 vars in 1287 bytes} [Mon Oct 10 10:55:03 2022] DELETE /compute/v2.1/os-security-group-rules/a4f04613-7831-4392-a1dd-3f1f88d968dc => generated 199 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:03.889810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:03.889810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:03.916918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:03.917410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:03.917851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:03.918560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:03.919023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:03.943531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:04.809494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:04.825447 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80bd35f8-c06b-4c2f-a046-1061dbb227ed tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.943520 Oct 10 10:55:04.826127 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1804/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:03 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:04.838163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:04.838784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:04.865367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:04.866191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:04.869530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:04.871342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:04.871983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:04.944307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:05.280014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:05.293203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e360e11a-dbce-4dd8-9b63-4adc6be82af8 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.465811 Oct 10 10:55:05.294796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1805/3709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:04 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:05.311252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-833e5db9-041b-4b4e-bd70-f0f856146ab4 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f67779ef940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:05.589408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:55:05.589927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:55:05.590457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:55:05.591233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:55:05.591865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:55:05.604878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:05.605530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:05.606376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:05.607314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:05.607924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:05.608502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:05.632950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:05.640363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:05.662084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:55:05.669331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:55:05.809211 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69313716-9051-4e53-9b7c-393128fbb35d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138824 Oct 10 10:55:05.814520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1905/3710] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:55:05.825099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634577f5-5c26-4747-b8d4-d4d1678bb032", "name": "network-vif-plugged", "status": "completed", "tag": "5840ad63-8d6d-475a-87c6-f10674c49b63"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:05.848095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:05.848887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:05.849507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:05.937946 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] Creating event network-vif-plugged:5840ad63-8d6d-475a-87c6-f10674c49b63 for instance 634577f5-5c26-4747-b8d4-d4d1678bb032 on n-h1-860687-2 Oct 10 10:55:05.984514 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-49e4a039-cda0-4d5a-b946-ab36c4e8104e req-54826c1b-f518-4710-8d7c-49b58ef0631e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161467 Oct 10 10:55:05.990576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1906/3711] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:06.060642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-833e5db9-041b-4b4e-bd70-f0f856146ab4 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2b4c773d-6bbc-4ac5-a7a0-522b23252d44" status: 202 len: 0 microversion: 2.1 time: 0.762867 Oct 10 10:55:06.064693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1806/3712] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:55:05 2022] DELETE /compute/v2.1/os-security-groups/2b4c773d-6bbc-4ac5-a7a0-522b23252d44 => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:06.069450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:06.070569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:06.094037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.096135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.096624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.101449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.101956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.106602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.551574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d210896-44a5-4d6e-86d0-5a5797affa82 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Action: 'create', calling method: .version_select at 0x7f6780c41940>, body: {"keypair": {"name": "tempest-keypair-918181670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzMv59uhB5Ld07d7vjWepxiBruj1VOFCVVzJohKU37XmVYHaVUfIMxP8sQB07pFCV3jbRomVJsQjuwoKEavQRXmsG9TyFpz5eaI12cXa7QvDPSIgbjYCAEElw7oF1BUVg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:06.593235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2d210896-44a5-4d6e-86d0-5a5797affa82 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:06.613268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2d210896-44a5-4d6e-86d0-5a5797affa82 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for user 997ba9b96bea4e7f92e7720397521f55 and project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:06.658846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:06.671087 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2d210896-44a5-4d6e-86d0-5a5797affa82 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.676263 Oct 10 10:55:06.678585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1907/3713] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:55:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:06.678585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:06.678794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:06.685835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.686414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.687141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.687897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.688434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.689475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.706541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 HTTP/1.1 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e29a1652-9075-4b3c-af3e-5e1901adedd5'} Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:06.708849 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:06.712201 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:06.712542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:06.715246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:06.715246 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e54930c8-9965-468e-b998-b4afb54e843e tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 404 len: 111 microversion: 2.1 time: 0.040951 Oct 10 10:55:06.718619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1908/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:06 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:06.732305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:06.733988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:06.736947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-013226e6-6656-42ac-8f02-c75f1cc87466 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.671182 Oct 10 10:55:06.743340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1807/3715] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:06 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:06.744480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29a1652-9075-4b3c-af3e-5e1901adedd5", "name": "network-vif-deleted", "tag": "a46b5cf3-fb56-4c52-b129-b79d388301c0"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:06.770145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29787b22-fb9f-4240-914e-e300fb4b7cb7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:06.774758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29787b22-fb9f-4240-914e-e300fb4b7cb7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:06.787209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.787959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.788194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.851077 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] Creating event network-vif-deleted:a46b5cf3-fb56-4c52-b129-b79d388301c0 for instance e29a1652-9075-4b3c-af3e-5e1901adedd5 on n-h2-860687-2 Oct 10 10:55:06.868578 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d7d75bb5-92a3-458c-bde6-b058ecec6604 req-ec30f655-0f8e-4adb-9c20-77df57535d41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148182 Oct 10 10:55:06.870410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1909/3716] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:06.878717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:06.879972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:06.887521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.888232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.888856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.889940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:06.890729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:06.892789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:06.953350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29787b22-fb9f-4240-914e-e300fb4b7cb7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:06.969398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29787b22-fb9f-4240-914e-e300fb4b7cb7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 200 len: 1215 microversion: 2.1 time: 0.219216 Oct 10 10:55:06.972709 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1808/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:06 2022] GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:06.980089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a149d0d-d575-4a24-a25c-923c21bca841 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f67779f8700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:07.453750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:07.472505 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5a6c686-6010-4f51-b6bd-4271fbda3d33 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.600049 Oct 10 10:55:07.478602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1910/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:06 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:07.485580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:07.489314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:07.505550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:07.506310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:07.507196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:07.508303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:07.512302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:07.513093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:07.919278 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a149d0d-d575-4a24-a25c-923c21bca841 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/da29febc-daea-4a37-a177-58fd4086c681" status: 202 len: 0 microversion: 2.1 time: 0.943820 Oct 10 10:55:07.920330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1809/3719] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:55:06 2022] DELETE /compute/v2.1/os-security-groups/da29febc-daea-4a37-a177-58fd4086c681 => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:07.925881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:07.926748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:07.944981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:07.951785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:07.952547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:07.960016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:07.960653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:07.961369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:07.992966 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 HTTP/1.1 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e29a1652-9075-4b3c-af3e-5e1901adedd5'} Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:07.997736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.001005 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.014991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:08.015340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:08.016578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0753025-8a6f-4bd7-aaa6-0a20b450a269 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 404 len: 111 microversion: 2.1 time: 0.094932 Oct 10 10:55:08.017873 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1810/3720] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:07 2022] DELETE /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:08.024930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:08.025751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:08.033786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-747b7611-ee76-4a74-bf80-55b6b4da960d tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1325 microversion: 2.1 time: 0.553738 Oct 10 10:55:08.040934 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1911/3721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:07 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1325 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.055176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.084647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:08.085287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:08.091767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.092258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.092878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.094128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.094761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.095906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.133510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:08.346326 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2723dce7-b2a8-4c5b-a2a7-3ca6b90c1b79 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 204 len: 0 microversion: 2.1 time: 0.326303 Oct 10 10:55:08.347575 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1811/3722] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:08 2022] DELETE /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:55:08.362462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7540b7a5-806c-49c2-af2e-e80a4c168652 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f67779fb550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:08.483426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:08.498060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:08.499910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:08.504550 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7dd6a8b8-c51b-4a1f-960b-2dd216dc1cd4 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.446071 Oct 10 10:55:08.505134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1912/3723] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:08 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:08.514543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:08.516431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: e29a1652-9075-4b3c-af3e-5e1901adedd5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:08.528807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.530777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.534848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.535663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.536163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.536583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.568720 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 HTTP/1.1 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e29a1652-9075-4b3c-af3e-5e1901adedd5'} Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:08.578389 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. Oct 10 10:55:08.582237 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:08.583747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance e29a1652-9075-4b3c-af3e-5e1901adedd5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:08.600274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-339f96d9-64fd-482a-8b70-a455dce2aecc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5" status: 404 len: 111 microversion: 2.1 time: 0.092718 Oct 10 10:55:08.608754 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1913/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:08 2022] GET /compute/v2.1/servers/e29a1652-9075-4b3c-af3e-5e1901adedd5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:08.625165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:08.626058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:08.642468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.644889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.645569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:08.647858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:08.648494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:08.653150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.202290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:09.212816 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6fb345a-74ef-4c4a-8d8d-17341fdb785c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 200 len: 1273 microversion: 2.1 time: 0.602570 Oct 10 10:55:09.213415 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1914/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:08 2022] GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:09.219810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:09.220651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:09.278665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.279241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.279687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.280411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.280911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.281307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.730335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:09.748131 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-712fa2bb-c02b-4d69-a931-ea4d38080df3 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.528664 Oct 10 10:55:09.749702 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1915/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:09 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:09.755973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:09.760175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:09.774531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7540b7a5-806c-49c2-af2e-e80a4c168652 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f4d5717b-a5fa-4229-b805-6028b399e903" status: 202 len: 0 microversion: 2.1 time: 1.424520 Oct 10 10:55:09.775855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1812/3727] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:55:08 2022] DELETE /compute/v2.1/os-security-groups/f4d5717b-a5fa-4229-b805-6028b399e903 => generated 0 bytes in 1428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:09.780247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.781794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.782970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:09.783849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.784260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:09.786775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.787641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.791453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.810704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:09.814535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.823940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.824507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.826311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.829784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.832525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.833175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 HTTP/1.1 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7c672629-1905-4baa-a014-3989e9de40d1'} Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:09.844938 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:09.849057 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:09.850733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:09.851657 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6cd1b60-b063-4a7d-a9e2-934d93f6b709 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 404 len: 111 microversion: 2.1 time: 0.100816 Oct 10 10:55:09.858528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1916/3728] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:09 2022] DELETE /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:09.888698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:09.889984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:09.912792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.915754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.924545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:09.925822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:09.927780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:09.929052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:10.414525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:10.424020 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c11cb20d-3ef6-4983-b30e-f020be2fdc99 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1521 microversion: 2.1 time: 0.646828 Oct 10 10:55:10.435353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1813/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:09 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:10.448374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6e85426-6091-42c1-9b31-4efbf60848ea tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f6777a3c4c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:10.490810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:10.501307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:10.513044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:10.514324 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4343512b-480e-4a69-a30e-92a5350ab2d7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.650183 Oct 10 10:55:10.515502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1917/3730] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:09 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:10.521294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:10.534541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 7c672629-1905-4baa-a014-3989e9de40d1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:10.559500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:10.562846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:10.563489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:10.565037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:10.569050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:10.569774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:10.590314 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 HTTP/1.1 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7c672629-1905-4baa-a014-3989e9de40d1'} Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:10.603896 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. Oct 10 10:55:10.607418 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:10.612698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 7c672629-1905-4baa-a014-3989e9de40d1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:10.624212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7fe3a75d-17e1-405c-9fce-18355cc0b671 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1" status: 404 len: 111 microversion: 2.1 time: 0.097303 Oct 10 10:55:10.628932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1918/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:10 2022] GET /compute/v2.1/servers/7c672629-1905-4baa-a014-3989e9de40d1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:10.634827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1509385720", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ba02df2f-3c57-4257-b9e5-4788f75b9525"}], "security_groups": [{"name": "tempest-securitygroup--723028539"}], "key_name": "tempest-keypair-918181670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:10.978927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] validate_networks() for [('ba02df2f-3c57-4257-b9e5-4788f75b9525', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:11.220914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6e85426-6091-42c1-9b31-4efbf60848ea tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/cc198794-d547-4c73-8567-b02b6175dd01" status: 202 len: 0 microversion: 2.1 time: 0.784286 Oct 10 10:55:11.221908 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1814/3732] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:55:10 2022] DELETE /compute/v2.1/os-security-groups/cc198794-d547-4c73-8567-b02b6175dd01 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:11.226899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:11.227646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:11.247727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.249081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.249552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.260650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.265538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.266086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.514262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:11.532026 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6eefd7b5-7e3f-485c-932b-c2b39bce0d8b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 200 len: 1219 microversion: 2.1 time: 0.308925 Oct 10 10:55:11.532785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1815/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:11 2022] GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 1219 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:11.538156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:11.538929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:11.553310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.558523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.559219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.560208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.560867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.561473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.629863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] HTTP exception thrown: Action 999 not found Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Request method failure captured: Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032/os-instance-actions/999 HTTP/1.1 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_nyUWeFWwbM-q8d6iTytEaHc2j-OBcCSb0wRwEY1gG-Nnkj42Q5Z4gmJNUnGi0KYfCEgGUKanqqWMthBU9rdqr6XDOrdU0eRx5Tkfmancq_5VP2Sx9K4JKkB4TqiYAsrsqJY0Z2rpmk98JjG1em3feC5TGTD7vfaXJBcn4ke5RlOYs Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83ce62fedf9b4825b27f030dbba6bec2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83ce62fedf9b4825b27f030dbba6bec2"}]}] Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: e50330154c7f4aa0bc03441fcb618804 Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: exception: Action 999 not found Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '634577f5-5c26-4747-b8d4-d4d1678bb032', 'id': '999'} Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 10 10:55:11.634972 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.639287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Returning 404 to user: Action 999 not found {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:11.640349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92518401-6fe2-4bed-9756-2ed8b84f1f9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.106178 Oct 10 10:55:11.641106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1816/3734] 10.222.0.16 () {58 vars in 1308 bytes} [Mon Oct 10 10:55:11 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032/os-instance-actions/999 => generated 66 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:55:11.655609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:11.656379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:11.677188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.678049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.678748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.679768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.680479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.681144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.724362 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 HTTP/1.1 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b87c0cf1-2c55-4c71-9409-c4aac3ca6d55'} Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:11.726265 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:11.729422 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:11.731526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:11.732650 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bacf1e06-a8a3-4867-8704-17b88b61bcd5 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 404 len: 111 microversion: 2.1 time: 0.089693 Oct 10 10:55:11.733612 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1817/3735] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:11 2022] DELETE /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:11.747072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:11.748072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:11.765808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.766581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.767910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:11.772690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:11.775687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:11.776498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.413859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:12.430098 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a9488ba-c297-4259-b414-30787ac974dc tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.694633 Oct 10 10:55:12.451974 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1818/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:11 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:12.461181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ca2b8d4-70d4-47ca-8dd0-e29075bd34b1 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] Calling method '.version_select at 0x7f6777aa13a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:12.645371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:12.666170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for user 997ba9b96bea4e7f92e7720397521f55 and project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: dict_keys(['metadata_items']) {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:12.681007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:55:12.681457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:55:12.682369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:55:12.682805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:55:12.683275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:55:12.700481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.700984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.701432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.702172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.702640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.703109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.724804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:12.730703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Getting quotas for user 997ba9b96bea4e7f92e7720397521f55 and project a1c2d9b763d1409fad9c88c4404c2fa1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:12.748465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:55:12.751369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:55:12.804688 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ca2b8d4-70d4-47ca-8dd0-e29075bd34b1 tempest-SecurityGroupRulesNegativeTestJSON-1954685260 tempest-SecurityGroupRulesNegativeTestJSON-1954685260-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7bfe071e-95cd-4365-9f31-cd37d84d17f9" status: 202 len: 0 microversion: 2.1 time: 0.350883 Oct 10 10:55:12.811168 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1819/3737] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 10:55:12 2022] DELETE /compute/v2.1/os-security-groups/7bfe071e-95cd-4365-9f31-cd37d84d17f9 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:12.817550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:12.819508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:12.826418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8060442-1d4f-4e0f-9eae-96721868dd01 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.196078 Oct 10 10:55:12.827417 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1919/3738] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:55:12.833211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '.version_select at 0x7f677c0b6ca0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:12.834228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: f3ade5be-34ac-4864-a5aa-b147a1952073] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:12.835126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.838943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.840294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.842624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.843207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.845890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.847964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] HTTP exception thrown: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. Oct 10 10:55:12.853616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Request method failure captured: Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f3ade5be-34ac-4864-a5aa-b147a1952073/os-instance-actions HTTP/1.1 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_nyUWeFWwbM-q8d6iTytEaHc2j-OBcCSb0wRwEY1gG-Nnkj42Q5Z4gmJNUnGi0KYfCEgGUKanqqWMthBU9rdqr6XDOrdU0eRx5Tkfmancq_5VP2Sx9K4JKkB4TqiYAsrsqJY0Z2rpmk98JjG1em3feC5TGTD7vfaXJBcn4ke5RlOYs Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83ce62fedf9b4825b27f030dbba6bec2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83ce62fedf9b4825b27f030dbba6bec2"}]}] Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e50330154c7f4aa0bc03441fcb618804 Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'f3ade5be-34ac-4864-a5aa-b147a1952073'} Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:12.861685 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. Oct 10 10:55:12.864771 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.867689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Returning 404 to user: Instance f3ade5be-34ac-4864-a5aa-b147a1952073 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:12.868888 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a07d7cfb-67c2-4729-aae7-ca33d93b0b80 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/f3ade5be-34ac-4864-a5aa-b147a1952073/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.040325 Oct 10 10:55:12.869951 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1920/3739] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Oct 10 10:55:12 2022] GET /compute/v2.1/servers/f3ade5be-34ac-4864-a5aa-b147a1952073/os-instance-actions => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:12.878395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:12.879761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: b87c0cf1-2c55-4c71-9409-c4aac3ca6d55] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:12.888019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.888746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.889405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.890271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.890870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.892840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.920757 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 HTTP/1.1 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b87c0cf1-2c55-4c71-9409-c4aac3ca6d55'} Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:12.926348 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:12.930286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea5d6045-50b3-4216-b728-79f6f3f0dfde tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55" status: 404 len: 111 microversion: 2.1 time: 0.059241 Oct 10 10:55:12.930858 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1921/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:12 2022] GET /compute/v2.1/servers/b87c0cf1-2c55-4c71-9409-c4aac3ca6d55 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:12.941259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:12.941886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:12.960358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.960867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.961306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:12.962020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:12.967478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:12.968140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.002820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 HTTP/1.1 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4bcc6ceb-f81f-420e-a994-356384f69148'} Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:13.010288 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.014095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:13.014919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-833ddd7b-26ec-4f4c-8ec3-4e0452911abe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 404 len: 111 microversion: 2.1 time: 0.083091 Oct 10 10:55:13.015964 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1922/3741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:12 2022] GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:13.045644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44f57d2e-5e31-4a06-97ff-ae25ee66d972 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:13.046288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44f57d2e-5e31-4a06-97ff-ae25ee66d972 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:13.203802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44f57d2e-5e31-4a06-97ff-ae25ee66d972 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:13.212686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44f57d2e-5e31-4a06-97ff-ae25ee66d972 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1269 microversion: 2.1 time: 0.194633 Oct 10 10:55:13.227439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1923/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:13 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1269 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:13.233740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:13.234247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:13.242244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.242743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.243211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.244155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.244760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.245338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.280402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:13.289181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:13.400982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-574594e0-4f06-414a-bdf1-1e632abd4c9e tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "DELETE /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 204 len: 0 microversion: 2.1 time: 0.172078 Oct 10 10:55:13.402034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1924/3743] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:13 2022] DELETE /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:55:13.408556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:13.409173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:13.416432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.417248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.417708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.418560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.419424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.420573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.445537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d HTTP/1.1 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1fac89db-b9ce-4b1e-965a-2e3e3641b01d'} Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:13.448844 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c60fd7a8-e1ca-4739-8284-e7e0028aca4f tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 404 len: 111 microversion: 2.1 time: 0.047269 Oct 10 10:55:13.452104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1925/3744] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:13 2022] DELETE /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:13.459350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-659379658", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:13.642383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:13.642921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:13.653894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:13.655828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:13.657091 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c6aa773-d8cd-41f2-88f5-daa0cdd5062c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.844743 Oct 10 10:55:13.658789 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1820/3745] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:12 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:13.672248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:13.673051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:13.706088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.706594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.707299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.720962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:13.721957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:13.722841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:13.958695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:13.988756 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a1251bc-c9f1-4747-995d-5f5e2867f232 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1527 microversion: 2.1 time: 0.313466 Oct 10 10:55:13.989749 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1821/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:13 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1527 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:14.029485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.031146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.040352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.041392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.042733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.045414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.046356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.047302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.308849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:14.329195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d63d510-b25c-4a10-863a-ee2ec4f71d0d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.328460 Oct 10 10:55:14.348332 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1822/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:13 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:14.353112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.354090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1fac89db-b9ce-4b1e-965a-2e3e3641b01d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.362092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.362692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.363246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.364251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.365135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.365986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.396932 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d HTTP/1.1 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1fac89db-b9ce-4b1e-965a-2e3e3641b01d'} Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.400539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 1fac89db-b9ce-4b1e-965a-2e3e3641b01d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82a3dcb6-9908-4386-8d16-2134c446745b tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d" status: 404 len: 111 microversion: 2.1 time: 0.053944 Oct 10 10:55:14.404115 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1823/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/1fac89db-b9ce-4b1e-965a-2e3e3641b01d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:14.412931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.413716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.421002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.421497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.421938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.422826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.424474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.424919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.432332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:55:14.433343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:55:14.434042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:55:14.434650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:55:14.435322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:55:14.450216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.451070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.451754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.452684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.453345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.455892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.484149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:14.494299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:14.512257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:14.523627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0db5b907-b0a1-49e7-ab7e-9483480002f8 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1321 microversion: 2.1 time: 0.115243 Oct 10 10:55:14.528421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:55:14.530957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:55:14.536507 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1824/3749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1321 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:14.568379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.569207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.582313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.583066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.584640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.588016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.588768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.589499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.623875 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc HTTP/1.1 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '033ef583-0e0d-431d-956b-c34d688a51fc'} Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:14.628489 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.631576 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.635089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:14.638560 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-507a079c-66ec-4e2a-952f-02a7a4affcf6 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 404 len: 111 microversion: 2.1 time: 0.079905 Oct 10 10:55:14.641631 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1825/3750] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:14 2022] DELETE /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:14.650233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.654569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 033ef583-0e0d-431d-956b-c34d688a51fc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.659549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98672a82-1254-4411-a5e7-799667b62968 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204450 Oct 10 10:55:14.660235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1926/3751] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:55:14.666888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.670128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.670664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.671532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.671641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-263af6d7-488b-4a12-99fe-2f9f0fa4bd5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.672086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.672201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-263af6d7-488b-4a12-99fe-2f9f0fa4bd5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.675059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.711691 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc HTTP/1.1 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '033ef583-0e0d-431d-956b-c34d688a51fc'} Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.713259 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.717399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 033ef583-0e0d-431d-956b-c34d688a51fc could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:14.720205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2eec7504-f7ec-4f90-8611-c74f8d386bbd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc" status: 404 len: 111 microversion: 2.1 time: 0.073579 Oct 10 10:55:14.722622 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1826/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/033ef583-0e0d-431d-956b-c34d688a51fc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:14.729987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.730611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.778266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.778793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.779346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.779986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.780484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.780915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.825214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-263af6d7-488b-4a12-99fe-2f9f0fa4bd5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:14.834212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-263af6d7-488b-4a12-99fe-2f9f0fa4bd5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1214 microversion: 2.1 time: 0.166588 Oct 10 10:55:14.837438 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1927/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:14.848509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.849294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.855989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.856649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.857405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.858277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.858907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.859530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.918796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 HTTP/1.1 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a2f84222-724d-4329-a870-a6c66b2a1670'} Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:14.926973 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:14.930744 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:14.934891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:14.939295 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e2e073fd-d730-42e1-8d71-37ed0869b347 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 404 len: 111 microversion: 2.1 time: 0.097395 Oct 10 10:55:14.940607 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1928/3754] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:14 2022] DELETE /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:14.954379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:14.955687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: a2f84222-724d-4329-a870-a6c66b2a1670] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:14.976904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.977406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.977846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:14.980540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:14.980896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:14.981332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.027428 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 HTTP/1.1 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a2f84222-724d-4329-a870-a6c66b2a1670'} Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.037649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.041084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance a2f84222-724d-4329-a870-a6c66b2a1670 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:15.046570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ad39f77-b969-4fe7-af9a-e2798519a684 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670" status: 404 len: 111 microversion: 2.1 time: 0.094487 Oct 10 10:55:15.047583 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1929/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/a2f84222-724d-4329-a870-a6c66b2a1670 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:15.053913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.054542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.082624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.083173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.083619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.084551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.085814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.086282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.160218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:15.174599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:15.177779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:15.180581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e275d31-791d-4113-8988-4ed72d4f7898 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.456813 Oct 10 10:55:15.189718 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1827/3756] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:14 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:15.196964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.199061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.207921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.208492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.209045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.209844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.210641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.211184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.229692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 HTTP/1.1 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '90158b28-c0c6-4d71-b74c-7e86176af903'} Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:15.231952 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.236507 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.238374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:15.240118 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b900f39-c141-45a1-9f8b-9938427dcd51 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 404 len: 111 microversion: 2.1 time: 0.049012 Oct 10 10:55:15.241670 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1828/3757] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:15 2022] DELETE /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:15.250454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.252665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 90158b28-c0c6-4d71-b74c-7e86176af903] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.280089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.280646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.281263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.282230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.282872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.283504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.315340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 HTTP/1.1 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '90158b28-c0c6-4d71-b74c-7e86176af903'} Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:15.323482 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. Oct 10 10:55:15.326752 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:15.329483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 90158b28-c0c6-4d71-b74c-7e86176af903 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:15.330598 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95d6233d-6633-4759-8e19-ca92bb930268 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903" status: 404 len: 111 microversion: 2.1 time: 0.084865 Oct 10 10:55:15.331799 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1829/3758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:15 2022] GET /compute/v2.1/servers/90158b28-c0c6-4d71-b74c-7e86176af903 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:55:15.341645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.343556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.356674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.358579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.359509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.363450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.364183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.364846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.421257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:15.543951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-568031cb-0afc-42f7-a7d2-5575300418c7 tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 204 len: 0 microversion: 2.1 time: 0.207643 Oct 10 10:55:15.545596 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1830/3759] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:15 2022] DELETE /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:55:15.559580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.561179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.576340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.577052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.577658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.578533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.579311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.581254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.652160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:15.661759 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c59370ac-4ffa-440e-8e9b-9daeb64450ec tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1527 microversion: 2.1 time: 0.612541 Oct 10 10:55:15.662990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1930/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:15 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1527 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:15.672374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.673838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.680767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.681571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.682275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.683237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.683894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.684531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.841777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:15.851737 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d253fc8-4b17-4299-9c2b-eac1e0d2fc05 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1327 microversion: 2.1 time: 0.187353 Oct 10 10:55:15.852944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1931/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:15 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1327 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:15.857929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:15.858670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:15.866972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.867959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.868674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:15.869776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:15.870352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:15.870884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.046029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.056742 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3be5e8c7-9a60-48fa-8952-7adb7e28b182 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.509832 Oct 10 10:55:16.061307 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1831/3762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:15 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:16.071024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:16.077176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:16.088091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.089018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.094554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.095409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.095998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.096547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.275393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.285010 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ffd6772-e32b-47a3-b0fb-5e50b319da1a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1210 microversion: 2.1 time: 0.218096 Oct 10 10:55:16.288683 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1832/3763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:16 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:16.300146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:16.300785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:16.319720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.319720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.319720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.319720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.320126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.320411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.484033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.499996 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9813b117-b5b1-4977-9ed7-0663cd8a83cc tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1479 microversion: 2.1 time: 0.645872 Oct 10 10:55:16.500597 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1932/3764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:15 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1479 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:16.689927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:16.690595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:16.702179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:16.704828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.705385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.705821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.707707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.708177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.708609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.798944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.826302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.829087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:16.835333 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-035685b8-ccfb-44a2-ab48-81333aa2f212 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.544172 Oct 10 10:55:16.837402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1833/3765] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:16 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:16.877581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:16.878376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:16.888376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.898363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.899326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.900280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:16.900944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:16.901591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:16.979956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:17.739789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:17.752102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-403acea9-235b-40f1-ab13-3e984c9d0e89 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1327 microversion: 2.1 time: 0.876177 Oct 10 10:55:17.756427 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1834/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:16 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1327 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:17.764717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:17.767786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:17.783902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:17.784418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:17.784869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:17.785593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:17.786059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:17.786497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.216154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:18.229374 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-470bfcb1-f96b-4fac-8e1c-cea471fac301 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1527 microversion: 2.1 time: 1.543441 Oct 10 10:55:18.237197 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1933/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:16 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1527 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:18.247351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:18.250647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:18.266221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.267202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.267908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.278086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.283672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.285777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.476988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:18.490677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c7c8b02-af0d-4d1a-94ad-1b2e7f3d304c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.728698 Oct 10 10:55:18.492880 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1835/3768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:17 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:18.508418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:18.510404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:18.512984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:18.528664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.530495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.531586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.536426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.537824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.538860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a46e9335-4443-4310-a99a-213e4bf1e98c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1272 microversion: 2.1 time: 0.296261 Oct 10 10:55:18.540722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1934/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:18 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:18.541143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.561422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "name": "network-vif-plugged", "status": "completed", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:18.584582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.585276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.586247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.603742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] Creating event network-vif-plugged:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h1-860687-2 Oct 10 10:55:18.611235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1cc0e1c1-34c8-49ae-baa7-6e29775e2325 req-9edae4de-c08f-408d-a378-c8a81cc6f9a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064880 Oct 10 10:55:18.623121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.624029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.624643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.625260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lazy-loading 'fault' on Instance uuid 1f890705-6704-4e1e-8adf-52bbc6ca73c4 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:55:18.630935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1935/3770] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:18.663251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:18.665267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:18.673938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.674754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.675500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.676427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.677102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.678122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.732920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:18.741508 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cb0c1d2-5b22-4fb5-88c1-3c121c59d4de tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1282 microversion: 2.1 time: 0.245761 Oct 10 10:55:18.755224 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1836/3771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:18 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:18.784986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634577f5-5c26-4747-b8d4-d4d1678bb032", "name": "network-vif-deleted", "tag": "5840ad63-8d6d-475a-87c6-f10674c49b63"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:18.817577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:18.818296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:18.818904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:18.845963 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] Creating event network-vif-deleted:5840ad63-8d6d-475a-87c6-f10674c49b63 for instance 634577f5-5c26-4747-b8d4-d4d1678bb032 on n-h1-860687-2 Oct 10 10:55:18.857005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-890a5199-c8a5-414b-9818-b59a284696f9 req-2c7d4a71-d52e-4e77-981e-1b679d4dd46d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100020 Oct 10 10:55:18.866506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1837/3772] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:19.080702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f890705-6704-4e1e-8adf-52bbc6ca73c4", "name": "network-vif-deleted", "tag": "e2f7e7a9-b612-4d3b-96a8-086d4d959c74"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:19.111817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.112541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.113125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.144388 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] Creating event network-vif-deleted:e2f7e7a9-b612-4d3b-96a8-086d4d959c74 for instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 on n-h1-860687-2 Oct 10 10:55:19.151796 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4317840b-ceeb-4598-99af-c34877f2276e req-bf1d05ca-98f5-4b27-bed8-46c6ec4cd3c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283600 Oct 10 10:55:19.152687 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1838/3773] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:19.158725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:19.160324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:19.166906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.167615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.168231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.169072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.169669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.170231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.193848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:19.223218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.233810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.235293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.248820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-62419b6e-be5d-402d-8427-becb24b63746 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.615812 Oct 10 10:55:19.250342 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1936/3774] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:18 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:19.266049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:19.267387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:19.285113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.289417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.293726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.294688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.297658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.298933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.439910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.440795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.441442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.442970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lazy-loading 'fault' on Instance uuid 634577f5-5c26-4747-b8d4-d4d1678bb032 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:55:19.609124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50330154c7f4aa0bc03441fcb618804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83ce62fedf9b4825b27f030dbba6bec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.622149 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-492115d5-201e-49a0-9e65-1d251721e0d0 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 200 len: 1315 microversion: 2.1 time: 0.360469 Oct 10 10:55:19.641112 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1937/3775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:19 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:19.650390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:19.651277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:19.658239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.659057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.660220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.661839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.662575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.663262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.699310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.713439 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b9143d2-7d71-40df-9ad4-90060b5e6740 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.559253 Oct 10 10:55:19.714042 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1839/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:19 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:19.735854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:19.736895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:19.746432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.747756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.748360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.749213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.749887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.751273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.848885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:19.864235 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7841f5f5-9031-4d0a-a224-8556bf57662c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1272 microversion: 2.1 time: 0.134600 Oct 10 10:55:19.879714 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1840/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:19 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:19.886223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:19.887133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:19.894783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.895551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.896149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.897030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.897644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.898258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.956934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:19.957680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:19.958490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:19.959333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lazy-loading 'fault' on Instance uuid 1f890705-6704-4e1e-8adf-52bbc6ca73c4 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:55:20.121775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce5370c7da5421f88d30317525a940b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11535079a28041faa0f7552da0f02fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:20.133579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f689339-c37b-46c7-a688-cff6e63729dd tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 200 len: 1282 microversion: 2.1 time: 0.252407 Oct 10 10:55:20.134195 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1841/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:19 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:20.276341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:20.276977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:20.292144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.292655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.293105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.294362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.295113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.295698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.309964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:20.335096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1f8ead81-eaa9-4870-accd-bbfc1f505f30 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.678154 Oct 10 10:55:20.335799 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1938/3779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:19 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:20.612864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:20.622032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:20.625256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:20.627084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-347f74dd-be9e-47d0-b970-58f3f064039c tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.354658 Oct 10 10:55:20.627664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1842/3780] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:20 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:20.646289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:20.646913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] [instance: 634577f5-5c26-4747-b8d4-d4d1678bb032] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:20.654295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.654800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.655281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.656009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.656477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.656918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.701160 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] HTTP exception thrown: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Request method failure captured: Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 HTTP/1.1 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_nyUWeFWwbM-q8d6iTytEaHc2j-OBcCSb0wRwEY1gG-Nnkj42Q5Z4gmJNUnGi0KYfCEgGUKanqqWMthBU9rdqr6XDOrdU0eRx5Tkfmancq_5VP2Sx9K4JKkB4TqiYAsrsqJY0Z2rpmk98JjG1em3feC5TGTD7vfaXJBcn4ke5RlOYs Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_83ce62fedf9b4825b27f030dbba6bec2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/83ce62fedf9b4825b27f030dbba6bec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/83ce62fedf9b4825b27f030dbba6bec2"}]}] Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 83ce62fedf9b4825b27f030dbba6bec2 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-890477533 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e50330154c7f4aa0bc03441fcb618804 Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-890477533-project Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '634577f5-5c26-4747-b8d4-d4d1678bb032'} Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:20.703227 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. Oct 10 10:55:20.707208 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:20.711071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] Returning 404 to user: Instance 634577f5-5c26-4747-b8d4-d4d1678bb032 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:20.713278 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d130b5ca-a383-4fe5-842c-176c3e397520 tempest-InstanceActionsNegativeTestJSON-890477533 tempest-InstanceActionsNegativeTestJSON-890477533-project] 10.222.0.16 "GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032" status: 404 len: 111 microversion: 2.1 time: 0.071449 Oct 10 10:55:20.714352 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1939/3781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:20 2022] GET /compute/v2.1/servers/634577f5-5c26-4747-b8d4-d4d1678bb032 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:20.744033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:20.744663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:20.754194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.755380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.755982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.756845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.757462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.758044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.895254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:20.898836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:20.920238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.924202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.927967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:20.932736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:20.934924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:20.939128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:21.669512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:21.678938 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1759107-4c0c-4496-bcd2-cd26ec5b402f tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.939061 Oct 10 10:55:21.691315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1843/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:20 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:21.691315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cad758-e7bb-49a5-91d0-3c3897b5bfed", "tag": "8ce938c2-7952-4f03-93c0-4e89b128c2be"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:21.716942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:21.717436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:21.717874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:21.766509 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] Creating event network-changed:8ce938c2-7952-4f03-93c0-4e89b128c2be for instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed on n-h2-860687-2 Oct 10 10:55:21.796330 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c02490d2-4561-4e5c-a3a8-709f77413493 req-97cb8fd0-c22b-4451-8255-ed0a4bae465a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101569 Oct 10 10:55:21.800888 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1844/3783] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:21.807133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:21.808861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] [instance: 1f890705-6704-4e1e-8adf-52bbc6ca73c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:21.822956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:21.824415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:21.825295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:21.826876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:21.827667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:21.828307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:21.899087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] HTTP exception thrown: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Request method failure captured: Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 HTTP/1.1 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_kM3ERWvhvhIHQYYzTM45v89M5AuQTVHiwkITFMNYRcGXgqKQLsRTJeZAMX0YqPN1r0AqXy6-jEcUIjcDudZ4vIxCD5O3fWOh03eKGbpSwIxDGQBljDMcjtz2FoRLLrc1Pl03dIoBk3D93D30L-Ey85iiAwoyOu9xugEAAHg6uGwog Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11535079a28041faa0f7552da0f02fe7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11535079a28041faa0f7552da0f02fe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11535079a28041faa0f7552da0f02fe7"}]}] Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-1412193025 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 11535079a28041faa0f7552da0f02fe7 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-1412193025 Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ce5370c7da5421f88d30317525a940b Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-1412193025-project Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1f890705-6704-4e1e-8adf-52bbc6ca73c4'} Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:21.909374 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. Oct 10 10:55:21.913388 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:21.919269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] Returning 404 to user: Instance 1f890705-6704-4e1e-8adf-52bbc6ca73c4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:21.940488 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdf777e1-a847-456c-8af8-1e8561c6c2ff tempest-ServersTestJSON-1412193025 tempest-ServersTestJSON-1412193025-project] 10.222.0.16 "GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4" status: 404 len: 111 microversion: 2.1 time: 0.119732 Oct 10 10:55:21.956134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1845/3784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:21 2022] GET /compute/v2.1/servers/1f890705-6704-4e1e-8adf-52bbc6ca73c4 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:21.974803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:21.976689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:21.995768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:21.996563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:21.997438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:21.999273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:22.000332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:22.001057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:22.073878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:22.092848 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90af656f-6a59-403d-b1f9-e21ff0b97454 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 1.199476 Oct 10 10:55:22.094024 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1940/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:20 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:22.105184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:22.106260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:22.118457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:22.123250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:22.124112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:22.125993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:22.126587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:22.127214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:22.727270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:22.739705 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5810b62-e41e-461f-ae9a-f430d80c0354 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1734 microversion: 2.1 time: 0.782170 Oct 10 10:55:22.744768 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1846/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:21 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1734 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:22.757879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:22.763843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:22.771923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:22.773212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:22.773843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:22.774715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:22.775390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:22.775963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:22.979732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:22.999527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:23.001895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:23.010149 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95ef7f7d-459f-4974-87ea-255092310b95 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1728 microversion: 2.20 time: 0.913939 Oct 10 10:55:23.011536 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1941/3787] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:22 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1728 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:23.120077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:23.121736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:23.129466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:23.130633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:23.132521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:23.133400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:23.134025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:23.134776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:23.322329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:23.339215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79db9a4e-08ec-4386-8263-854c69080944 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.592495 Oct 10 10:55:23.358967 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1847/3788] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:22 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:23.768252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:23.769077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:23.787600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:23.788797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:23.789445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:23.790329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:23.790972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:23.791587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.167352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.180915 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf7c73c8-c79f-4cce-982f-fa058c919534 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 1.067012 Oct 10 10:55:24.205595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1942/3789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:23 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:24.216265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52d7e4b-18d2-4083-983d-42b8792cd244", "tag": "ba3ea267-e81d-49b2-9555-3fae823a1ee8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:24.236106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.236708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.237911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.240364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.266611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bc4e940-113e-4417-918f-5304f6aafe40 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1714 microversion: 2.1 time: 0.502104 Oct 10 10:55:24.268304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] Creating event network-changed:ba3ea267-e81d-49b2-9555-3fae823a1ee8 for instance e52d7e4b-18d2-4083-983d-42b8792cd244 on n-h1-860687-2 Oct 10 10:55:24.268577 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1848/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:23 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1714 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:24.277400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:24.278026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:24.284811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-91e560dc-4f67-4ef1-9cd1-192313c64ecb req-389ef0ad-baa2-467a-8c41-0701c38d03e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077626 Oct 10 10:55:24.287402 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1943/3791] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:24.287885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.288570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.289159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.290601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.291817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.292382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.370546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:24.371287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:24.380513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.381005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.381440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.382143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.382598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.383045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.466680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:24.830004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=30 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:24.843126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.858050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.862275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.866948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-944d2e9e-2b2b-4ec0-92f3-d141ba71dc57 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1715 microversion: 2.20 time: 0.595038 Oct 10 10:55:24.867768 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1849/3792] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:24 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1715 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:24.891394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:24.893461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:24.911035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.911746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.912301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.914169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:24.914745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:24.916668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:24.957344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:24.979156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-336cf26c-edb8-4cfa-9dae-de57a38cbb00 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.613402 Oct 10 10:55:24.981983 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1944/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:24 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:25.041959 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Cannot 'detach_volume' instance 2abe118a-f500-425e-93eb-942ff0e4501c while it is in vm_state rescued Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments/3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5 HTTP/1.1 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'detach_volume' instance 2abe118a-f500-425e-93eb-942ff0e4501c while it is in vm_state rescued Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '2abe118a-f500-425e-93eb-942ff0e4501c', 'id': '3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5'} Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2abe118a-f500-425e-93eb-942ff0e4501c in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2abe118a-f500-425e-93eb-942ff0e4501c while it is in vm_state rescued Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:25.043863 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2abe118a-f500-425e-93eb-942ff0e4501c while it is in vm_state rescued Oct 10 10:55:25.047539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:25.049985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 409 to user: Cannot 'detach_volume' instance 2abe118a-f500-425e-93eb-942ff0e4501c while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:25.051065 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-474b719f-e2f7-481b-a509-d6f26efe467b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments/3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5" status: 409 len: 152 microversion: 2.1 time: 0.181164 Oct 10 10:55:25.052118 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1850/3794] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:55:24 2022] DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments/3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5 => generated 152 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:55:25.062715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:25.065422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:25.072354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.073159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.073933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.074963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.075927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.076553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.082476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:25.188525 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d1f700e-9b90-49ec-b1c0-90cf66b517ca tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/action" status: 202 len: 0 microversion: 2.1 time: 0.131471 Oct 10 10:55:25.191127 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1945/3795] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:55:25 2022] POST /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 10:55:25.207985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:25.210197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:25.250012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.254122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.258310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:25.258655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.259733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.260687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:25.261461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.264109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.284920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.285644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.286279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.287189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:25.300779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:25.301458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:25.933911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:25.943878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bf7502d-69ef-4921-903a-b8c18c570221 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1722 microversion: 2.1 time: 0.741529 Oct 10 10:55:25.959177 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1851/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:25 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1722 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:25.988065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:26.004673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:26.005093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2c8a2585-283e-4518-b59d-dff646b1639d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 0.781487 Oct 10 10:55:26.005797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:26.019881 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1946/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:25 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:26.048793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:26.049554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:26.050185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:26.051099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:26.051715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:26.052301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:26.638214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:26.647970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fe0de3c-eb3c-4fcc-a3d2-7a987bb78f34 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.648195 Oct 10 10:55:26.649143 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1852/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:25 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:26.974104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:26.974741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:26.994802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:26.995285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:26.995755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:27.002639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:27.003462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:27.003970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:27.035450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:27.036064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:27.063562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:27.065660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:27.072613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:27.074038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:27.075534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:27.076142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:27.706625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:27.724269 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b2b69ba-6a76-455d-981b-1a01ff5bdc65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 0.688091 Oct 10 10:55:27.732385 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1853/3799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:27 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:27.741108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:27.741971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:27.759270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:27.760034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:27.760664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:27.761663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:27.762282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:27.762931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:28.157558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:28.172340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89828ccd-229a-4cbd-b2db-c3066cd514e8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1722 microversion: 2.1 time: 1.203570 Oct 10 10:55:28.173823 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1947/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:26 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1722 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:28.512382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:28.521828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-201821a3-6ef5-4363-b227-0c25eb63a541 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.787432 Oct 10 10:55:28.541106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1854/3801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:27 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:28.752722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:28.753355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:28.763154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:28.763958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:28.764558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:28.767131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:28.769338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:28.769974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.152238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:29.166408 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69e9681b-c31a-48b6-8681-6771bdf7ffa8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 0.420403 Oct 10 10:55:29.174879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1948/3802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:28 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:29.201165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:29.202172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:29.222107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.223901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.223901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.227577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.229842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.230505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.549489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:29.550462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:29.568970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.569832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.570760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.571955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.572631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.573276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.602684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:29.612082 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a155664f-ed8d-488e-b1e1-cfc2e3a9aaf9 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1728 microversion: 2.1 time: 0.414914 Oct 10 10:55:29.616625 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1855/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:29 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1728 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:29.644296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:29.645006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:29.659817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.660809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.662967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.663967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:29.666286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:29.666988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:29.883595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1aab6f5-6bae-437c-89b0-de939d7c8130 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244663 Oct 10 10:55:29.884895 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1856/3804] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:55:29 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:30.195479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:30.196106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:30.206240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:30.208391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:30.209050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:30.213793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:30.214498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:30.215143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:30.265886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:30.458549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:30.472326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec26192b-7b57-46b5-824f-d45cb2c6b111 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.927300 Oct 10 10:55:30.475739 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1949/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:29 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:30.565146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:30.577081 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6574263a-7758-4d82-9403-4a9a160f868f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 0.386252 Oct 10 10:55:30.583509 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1857/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:30 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:31.124413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52d7e4b-18d2-4083-983d-42b8792cd244", "name": "network-vif-plugged", "status": "completed", "tag": "ba3ea267-e81d-49b2-9555-3fae823a1ee8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:31.151631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:31.152136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:31.156896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:31.187752 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] Creating event network-vif-plugged:ba3ea267-e81d-49b2-9555-3fae823a1ee8 for instance e52d7e4b-18d2-4083-983d-42b8792cd244 on n-h1-860687-2 Oct 10 10:55:31.201559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5f9ceed3-68a4-49a8-954c-b0ce5b082d6f req-3b6cbeea-9109-4c10-9510-5639ffcf70ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081015 Oct 10 10:55:31.202580 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1950/3807] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:31.499026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:31.500416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:31.513902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:31.514803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:31.515950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:31.519295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:31.520023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:31.520686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:31.612116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:31.613423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:31.627178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:31.627699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:31.628210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:31.628948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:31.629423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:31.629850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:32.835424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:32.849990 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c1870c4-1ebb-4617-99cb-15b1dcf35696 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 1.350338 Oct 10 10:55:32.851962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1858/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:31 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:32.992701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:33.005229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-441a3ad7-84df-4e59-be5c-1b35d0bfb857 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1314 microversion: 2.1 time: 1.398651 Oct 10 10:55:33.010797 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1951/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:31 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1314 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:33.271398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cad758-e7bb-49a5-91d0-3c3897b5bfed", "name": "network-vif-plugged", "status": "completed", "tag": "8ce938c2-7952-4f03-93c0-4e89b128c2be"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:33.290352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:33.296663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:33.296663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:33.323174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] Creating event network-vif-plugged:8ce938c2-7952-4f03-93c0-4e89b128c2be for instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed on n-h2-860687-2 Oct 10 10:55:33.336876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eaabc61e-18bb-463c-a982-87718694a19c req-01db35ac-9d0c-4986-acf0-aaa1f8720174 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070398 Oct 10 10:55:33.339089 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1859/3810] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:33.806059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:33.826479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:33.839987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:33.841067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:33.876849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:33.878710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:33.888868 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] Creating event network-changed:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:55:33.896642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:33.899273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:33.902282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:33.904957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:33.906326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8830b25c-0f20-4122-bde3-0d1685451e69 req-4ef6c42c-d715-4cbe-ad62-e2e435df9b59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105159 Oct 10 10:55:33.911651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:33.913819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:33.914642 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1952/3811] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:33.915228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:34.038693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:34.039923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:34.051997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:34.054609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:34.055664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:34.059121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:34.059727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:34.065489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:34.678498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:34.690161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42e6f083-8afc-4a30-837d-71b8a606f2df tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1394 microversion: 2.1 time: 0.818273 Oct 10 10:55:34.713989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1860/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:33 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1394 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:34.780208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:34.793685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b4c3f2d-a0a2-4139-9bd2-20d727ed21ba tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1500 microversion: 2.1 time: 0.759544 Oct 10 10:55:34.794304 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1953/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:34 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1500 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:34.821970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:34.822845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:34.832418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:34.838248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:34.838869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:34.839821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:34.840709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:34.841296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:35.007928 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a331cc2-d2df-4017-b6db-e7d95f8441b2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244/action" status: 202 len: 0 microversion: 2.1 time: 0.188935 Oct 10 10:55:35.009752 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1861/3814] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:55:34 2022] POST /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:35.023513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:35.024680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:35.047241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:35.049771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:35.050421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:35.053205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:35.053997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:35.054706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:35.415992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:35.427039 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9254bbea-6bb8-4443-95cf-c86135a57855 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1505 microversion: 2.1 time: 0.411870 Oct 10 10:55:35.448968 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1954/3815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:35 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:35.718208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:35.718933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:35.736020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:35.736841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:35.737291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:35.738014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:35.738490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:35.738924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.155479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:36.172025 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb26b919-798a-4225-8161-b66986194963 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1575 microversion: 2.1 time: 0.456929 Oct 10 10:55:36.174007 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1862/3816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:35 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1575 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:36.186580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:36.209586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:36.212210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:36.213219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.235680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] Creating event network-changed:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:55:36.243991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e9bcd81a-836f-423e-8e04-f35cb0ca71e8 req-e370be17-9016-4bb5-9601-6d456ca4012f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065867 Oct 10 10:55:36.245600 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1863/3817] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:36.259076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.259880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:36.271448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:36.287786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:36.288552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.289984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:36.290792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:36.291471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.404116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Action: 'create', calling method: .version_select at 0x7f6780cc4ca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:36.463984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Getting quotas for project e511009495c3464782d8026705449a20. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:36.481958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Getting quotas for user a19e3dc57aff4ebf94150dbfcd1d62d0 and project e511009495c3464782d8026705449a20. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:36.488526 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83bad9f9-276b-454b-9942-45ee0b738604 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.241398 Oct 10 10:55:36.489222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1864/3818] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:55:36 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed/os-interface => generated 284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:36.495431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.496604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:36.515362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:36.517943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:36.518761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.519774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:36.522062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:36.524843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:36.578935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Getting quotas for project e511009495c3464782d8026705449a20. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:36.588394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Getting quotas for user a19e3dc57aff4ebf94150dbfcd1d62d0 and project e511009495c3464782d8026705449a20. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:36.635927 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-877d75f8-bb66-4259-ac44-95f993cf04b9 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.824985 Oct 10 10:55:36.639152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1955/3819] 10.222.0.16 () {62 vars in 1214 bytes} [Mon Oct 10 10:55:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 10:55:36.653024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f63cc30-c858-4103-8904-6946c63f5310 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.702443 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f63cc30-c858-4103-8904-6946c63f5310 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.058013 Oct 10 10:55:36.703351 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1956/3820] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Oct 10 10:55:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:55:36.717310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b826b067-ce43-4500-a17a-99ea20904c65 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.728746 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b826b067-ce43-4500-a17a-99ea20904c65 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91" status: 200 len: 235 microversion: 2.64 time: 0.018554 Oct 10 10:55:36.729961 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1957/3821] 10.222.0.16 () {60 vars in 1304 bytes} [Mon Oct 10 10:55:36 2022] GET /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 => generated 235 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:55:36.741526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0d88086-a057-429f-9e8e-867024fc951a tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.820331 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0d88086-a057-429f-9e8e-867024fc951a tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91" status: 204 len: 0 microversion: 2.64 time: 0.082809 Oct 10 10:55:36.830783 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1958/3822] 10.222.0.16 () {60 vars in 1307 bytes} [Mon Oct 10 10:55:36 2022] DELETE /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 10:55:36.835843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-271ea718-429f-41da-baae-6563b25dba01 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:36.862691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-271ea718-429f-41da-baae-6563b25dba01 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] HTTP exception thrown: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-271ea718-429f-41da-baae-6563b25dba01 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Request method failure captured: Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 HTTP/1.1 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_onU8zDYMUbjj-u5EitNcCxUEAo2-XKs7a0z6v0u_ihkMW5L9USdCA97rSizTyo4kJfseGNZq2j0C58WAKu68kPJA5Yl3xflzeJhcQ9l2HqDvuSdDhugUE7p-uibNxsyn3HGOOKOEYrGdHznYMQrucAug-yUGlC-oUv9BF9zw3ov1Q Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.64 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e511009495c3464782d8026705449a20 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerGroup264TestJSON-726437488 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e511009495c3464782d8026705449a20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e511009495c3464782d8026705449a20", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e511009495c3464782d8026705449a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e511009495c3464782d8026705449a20"}]}] Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerGroup264TestJSON-726437488 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e511009495c3464782d8026705449a20 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerGroup264TestJSON-726437488 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerGroup264TestJSON-726437488-project Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a19e3dc57aff4ebf94150dbfcd1d62d0 Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerGroup264TestJSON-726437488-project Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91'} Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:36.870306 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. Oct 10 10:55:36.874649 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:36.876199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-271ea718-429f-41da-baae-6563b25dba01 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] Returning 404 to user: Instance group fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:36.877302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-271ea718-429f-41da-baae-6563b25dba01 tempest-ServerGroup264TestJSON-726437488 tempest-ServerGroup264TestJSON-726437488-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91" status: 404 len: 117 microversion: 2.64 time: 0.045249 Oct 10 10:55:36.877896 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1959/3823] 10.222.0.16 () {60 vars in 1307 bytes} [Mon Oct 10 10:55:36 2022] DELETE /compute/v2.1/os-server-groups/fcf106ff-7c2f-47a1-ac7d-1ccb159c8f91 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:55:37.024389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:37.044917 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2356f0b5-9661-4db8-88ed-ba966979b74a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1485 microversion: 2.1 time: 0.554056 Oct 10 10:55:37.048162 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1865/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:36 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1485 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:37.075486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:37.077086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:37.113535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:37.117398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:37.118105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:37.119062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:37.119938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:37.123298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:37.192787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:37.410292 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2a37f8d-5ccb-45e5-b762-55f08204fb2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 204 len: 0 microversion: 2.1 time: 0.339052 Oct 10 10:55:37.411722 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1960/3825] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:55:37 2022] DELETE /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:55:37.416708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcbc2c35-4a88-47bf-97e2-bfa6b8c8ff85 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1552612680", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:37.421935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:37.425278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:37.427254 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fcbc2c35-4a88-47bf-97e2-bfa6b8c8ff85 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] HTTP exception thrown: min_count must be <= max_count Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcbc2c35-4a88-47bf-97e2-bfa6b8c8ff85 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Request method failure captured: Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 184 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ooaEoG5X_7GYsq5-FkU7891CuDmBqNbpXkRUSH1dVfS7Q-JeAtZhLKO4M-mzURN1eBVAG-z9uYVydss4afPW9X8nKCad4XtQL01fgqJsCf22kdZj0cio5fBwxFuO_RTfL1iNeq00I4ZJnf7IuLk-pEd1rPRaKCOyfzHenndKtowfE Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8af9e83b703450db0e33f81b2290526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8af9e83b703450db0e33f81b2290526"}]}] Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66db7d0c23434e26806408be3ab5bdff Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1552612680", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: exception: min_count must be <= max_count Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1552612680', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 10 10:55:37.429109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.434937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcbc2c35-4a88-47bf-97e2-bfa6b8c8ff85 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Returning 400 to user: min_count must be <= max_count {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:37.437743 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcbc2c35-4a88-47bf-97e2-bfa6b8c8ff85 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.347554 Oct 10 10:55:37.441070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:37.441919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1866/3826] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:37 2022] POST /compute/v2.1/servers => generated 74 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:55:37.464377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:37.464869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:37.465947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:37.466459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:37.466941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:37.519707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b66ff3eb-65cd-4b59-8550-516f7b9a0bf9 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1743380174", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "max_count": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b66ff3eb-65cd-4b59-8550-516f7b9a0bf9 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Request method failure captured: Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 168 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ooaEoG5X_7GYsq5-FkU7891CuDmBqNbpXkRUSH1dVfS7Q-JeAtZhLKO4M-mzURN1eBVAG-z9uYVydss4afPW9X8nKCad4XtQL01fgqJsCf22kdZj0cio5fBwxFuO_RTfL1iNeq00I4ZJnf7IuLk-pEd1rPRaKCOyfzHenndKtowfE Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8af9e83b703450db0e33f81b2290526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8af9e83b703450db0e33f81b2290526"}]}] Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66db7d0c23434e26806408be3ab5bdff Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1743380174", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "max_count": 0}} Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1743380174', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'max_count': 0}}} Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 0 Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:55:37.526807 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.530750 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.540453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b66ff3eb-65cd-4b59-8550-516f7b9a0bf9 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:37.543032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b66ff3eb-65cd-4b59-8550-516f7b9a0bf9 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028363 Oct 10 10:55:37.543693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1867/3827] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:55:37.642156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f65795be-2cf5-42e1-bc0d-693340431f92 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1146454846", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "max_count": 2.5}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f65795be-2cf5-42e1-bc0d-693340431f92 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Request method failure captured: Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 170 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ooaEoG5X_7GYsq5-FkU7891CuDmBqNbpXkRUSH1dVfS7Q-JeAtZhLKO4M-mzURN1eBVAG-z9uYVydss4afPW9X8nKCad4XtQL01fgqJsCf22kdZj0cio5fBwxFuO_RTfL1iNeq00I4ZJnf7IuLk-pEd1rPRaKCOyfzHenndKtowfE Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8af9e83b703450db0e33f81b2290526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8af9e83b703450db0e33f81b2290526"}]}] Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66db7d0c23434e26806408be3ab5bdff Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1146454846", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "max_count": 2.5}} Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1146454846', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'max_count': 2.5}}} Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 2.5 Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:55:37.656830 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.660552 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.664462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f65795be-2cf5-42e1-bc0d-693340431f92 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:37.667482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f65795be-2cf5-42e1-bc0d-693340431f92 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030089 Oct 10 10:55:37.669084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1868/3828] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:55:37.881132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02e64c91-2607-444d-b032-733bea3b8170 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2146203682", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02e64c91-2607-444d-b032-733bea3b8170 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Request method failure captured: Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 168 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ooaEoG5X_7GYsq5-FkU7891CuDmBqNbpXkRUSH1dVfS7Q-JeAtZhLKO4M-mzURN1eBVAG-z9uYVydss4afPW9X8nKCad4XtQL01fgqJsCf22kdZj0cio5fBwxFuO_RTfL1iNeq00I4ZJnf7IuLk-pEd1rPRaKCOyfzHenndKtowfE Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8af9e83b703450db0e33f81b2290526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8af9e83b703450db0e33f81b2290526"}]}] Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66db7d0c23434e26806408be3ab5bdff Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2146203682", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 0}} Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2146203682', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'min_count': 0}}} Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 0 Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:55:37.887385 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02e64c91-2607-444d-b032-733bea3b8170 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:37.890871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02e64c91-2607-444d-b032-733bea3b8170 tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012506 Oct 10 10:55:37.893051 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1869/3829] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:55:37.966336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13e6667-f711-4908-a526-c009ebd0b68c tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1016662404", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 2.5}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13e6667-f711-4908-a526-c009ebd0b68c tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Request method failure captured: Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 170 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ooaEoG5X_7GYsq5-FkU7891CuDmBqNbpXkRUSH1dVfS7Q-JeAtZhLKO4M-mzURN1eBVAG-z9uYVydss4afPW9X8nKCad4XtQL01fgqJsCf22kdZj0cio5fBwxFuO_RTfL1iNeq00I4ZJnf7IuLk-pEd1rPRaKCOyfzHenndKtowfE Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8af9e83b703450db0e33f81b2290526", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8af9e83b703450db0e33f81b2290526"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8af9e83b703450db0e33f81b2290526"}]}] Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e8af9e83b703450db0e33f81b2290526 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-74400197 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 66db7d0c23434e26806408be3ab5bdff Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-74400197-project Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1016662404", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 2.5}} Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1016662404', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'min_count': 2.5}}} Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 2.5 Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:55:37.973116 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13e6667-f711-4908-a526-c009ebd0b68c tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b13e6667-f711-4908-a526-c009ebd0b68c tempest-MultipleCreateNegativeTestJSON-74400197 tempest-MultipleCreateNegativeTestJSON-74400197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014073 Oct 10 10:55:37.976702 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1870/3830] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:55:38.340685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:38.349689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2983ee5-9782-495c-ac2a-f6ad1955845d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1491 microversion: 2.1 time: 0.933105 Oct 10 10:55:38.356321 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1961/3831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:37 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1491 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:39.300437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:39.301611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:39.325049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5cad758-e7bb-49a5-91d0-3c3897b5bfed", "tag": "8ce938c2-7952-4f03-93c0-4e89b128c2be"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:39.349274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:39.350052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:39.350647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:39.355551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:39.356420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:39.357195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:39.381920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:39.382653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:39.383320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:39.406414 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] Creating event network-changed:8ce938c2-7952-4f03-93c0-4e89b128c2be for instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed on n-h2-860687-2 Oct 10 10:55:39.418751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f7fa6b41-2110-4e0d-9081-6d5c3f56102d req-3a5f5b72-8104-45e7-af96-ac5b12ab56bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102697 Oct 10 10:55:39.421866 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1962/3832] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:39.436930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:39.438718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:39.450572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:39.455804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:39.456266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:39.457197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:39.457676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:39.464310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:39.816333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:39.825196 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64210a2b-d997-4689-b4a3-e69ac16e544a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1575 microversion: 2.1 time: 0.530458 Oct 10 10:55:39.829655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1871/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:39 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1575 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:39.846912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:39.858544 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e355b46-8e51-4f8e-9283-64f134809a12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1491 microversion: 2.1 time: 0.434458 Oct 10 10:55:39.859745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1963/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:39 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1491 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:40.881970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:40.882582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:40.911885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:40.915113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:40.915673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:40.916583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:40.917058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:40.917483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:41.070187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52d7e4b-18d2-4083-983d-42b8792cd244", "name": "network-vif-deleted", "tag": "ba3ea267-e81d-49b2-9555-3fae823a1ee8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:41.083612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:41.086727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:41.087491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:41.088740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:41.109298 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] Creating event network-vif-deleted:ba3ea267-e81d-49b2-9555-3fae823a1ee8 for instance e52d7e4b-18d2-4083-983d-42b8792cd244 on n-h1-860687-2 Oct 10 10:55:41.159065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3a7e6a09-f04d-4305-8139-fdb3f2c628da req-84b76eb5-0bc6-488e-b9c5-268ecfaa98a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093098 Oct 10 10:55:41.165575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1964/3835] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:41.225849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:41.233973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42f2a555-f950-41fb-8485-f1be97ab4d3a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1449 microversion: 2.1 time: 0.355809 Oct 10 10:55:41.235948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1872/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:40 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1449 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:42.272550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:42.273887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:42.290635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:42.291618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:42.292241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:42.293250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:42.293893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:42.294543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:42.342136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:42.343023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:42.343652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:42.344536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'fault' on Instance uuid e52d7e4b-18d2-4083-983d-42b8792cd244 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:55:42.458815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:42.481351 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8afdab7b-1a8b-434e-b828-5c514657f574 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 200 len: 1304 microversion: 2.1 time: 0.222381 Oct 10 10:55:42.483310 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1873/3837] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:42 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 1304 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:42.612503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e7a2066-a4db-493f-b4b8-ec4a6e31a218 tempest-ComputeTenantNetworksTest-1154831921 tempest-ComputeTenantNetworksTest-1154831921-project] Calling method '.version_select at 0x7f6780d3da60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:42.754000 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e7a2066-a4db-493f-b4b8-ec4a6e31a218 tempest-ComputeTenantNetworksTest-1154831921 tempest-ComputeTenantNetworksTest-1154831921-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.506301 Oct 10 10:55:42.754917 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1965/3838] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 10:55:42 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:42.765695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-220a18b5-ca16-41ac-8519-6c67c7faf963 tempest-ComputeTenantNetworksTest-1154831921 tempest-ComputeTenantNetworksTest-1154831921-project] Calling method '.version_select at 0x7f6777a7adc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:42.890408 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-220a18b5-ca16-41ac-8519-6c67c7faf963 tempest-ComputeTenantNetworksTest-1154831921 tempest-ComputeTenantNetworksTest-1154831921-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/3408a5e5-479a-4fc1-8d13-32ae17efb636" status: 200 len: 139 microversion: 2.1 time: 0.128220 Oct 10 10:55:42.890780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1874/3839] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:55:42 2022] GET /compute/v2.1/os-tenant-networks/3408a5e5-479a-4fc1-8d13-32ae17efb636 => generated 139 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:43.510929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:43.512098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:43.560291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:43.560824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:43.561271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:43.562417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:43.563279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:43.576681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:43.622208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 HTTP/1.1 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e52d7e4b-18d2-4083-983d-42b8792cd244'} Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:43.626805 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:55:43.631804 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:55:43.635209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:43.636902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd4d43fe-3487-4b00-80c0-e1a88e5ca8e9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 404 len: 111 microversion: 2.1 time: 0.131146 Oct 10 10:55:43.638242 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1966/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:43 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:43.898115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1608872582", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:43.995810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:44.728279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:55:44.728908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:55:44.729454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:55:44.729934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:55:44.730421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:55:44.757882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:44.762965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:44.763675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:44.765240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:44.769151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:44.769777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:44.834613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:44.855916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:44.875226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:55:44.879588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:55:44.979417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-974e1718-8350-434f-9f86-e80c3dcfac56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086262 Oct 10 10:55:44.985382 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1875/3841] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:55:44.992390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-923932b4-cae3-4b35-a854-adcb772eb38e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:44.993024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-923932b4-cae3-4b35-a854-adcb772eb38e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:45.152938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-923932b4-cae3-4b35-a854-adcb772eb38e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:45.163237 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-923932b4-cae3-4b35-a854-adcb772eb38e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1215 microversion: 2.1 time: 0.173677 Oct 10 10:55:45.175258 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1967/3842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:44 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:46.190525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:46.191428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:46.206322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02214fc7-7268-4839-a5b6-1ccf5b69c18a tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Action: 'create', calling method: .version_select at 0x7f6777a05040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1622585148"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:46.215549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:46.216161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:46.217187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:46.219783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:46.220380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:46.220915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:46.423615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:46.438148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d58d8058-eb89-4ce5-b7fe-d95239ea240b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1267 microversion: 2.1 time: 0.251856 Oct 10 10:55:46.453910 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1968/3843] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:46 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:46.880445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02214fc7-7268-4839-a5b6-1ccf5b69c18a tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.080187 Oct 10 10:55:46.892281 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1876/3844] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Oct 10 10:55:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1093 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 10:55:46.899497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6502f23-0b89-46e0-90de-c599714b6fa1 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f6777a0cc10>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:46.981198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1070189048", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "ad5bd046-b439-40e6-a1d7-834894a160de"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:47.037667 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6502f23-0b89-46e0-90de-c599714b6fa1 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 345 microversion: 2.1 time: 0.144079 Oct 10 10:55:47.038670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1969/3845] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:55:46 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:47.091498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] validate_networks() for [('ad5bd046-b439-40e6-a1d7-834894a160de', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:47.463859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:47.465253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:47.474832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:47.478909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:47.480775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:47.483556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:47.485002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:47.486808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:47.521883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:47.704682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:47.730882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4bd4fc40-29ec-4082-b6e9-dc2f71f1d089 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1273 microversion: 2.1 time: 0.272441 Oct 10 10:55:47.732333 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1970/3846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:47 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:48.053239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40c116aa-8c31-4a72-9446-ece49d78370b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677d1153a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:48.130368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40c116aa-8c31-4a72-9446-ece49d78370b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 345 microversion: 2.1 time: 0.081068 Oct 10 10:55:48.131291 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1971/3847] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:55:48 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:48.464327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:55:48.465130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:55:48.466164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:55:48.467716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:55:48.468591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:55:48.487631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:48.489215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:48.489871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:48.491114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:48.492876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:48.493997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:48.521985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Getting quotas for project f0fe822f501145eea8c66821aca0f85a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:48.530876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Getting quotas for user 376e209ca66f4c5ca0c8a279e6a28080 and project f0fe822f501145eea8c66821aca0f85a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:48.549223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:55:48.552325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:55:48.634104 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37bf7419-c712-47d2-8b0d-2cf5e755ea06 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662568 Oct 10 10:55:48.636229 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1877/3848] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:55:48.647602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82a721ad-f431-482f-8350-7809f06251ca tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:48.648815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-82a721ad-f431-482f-8350-7809f06251ca tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:48.763434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:48.764363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:48.772633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:48.773728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:48.774388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:48.775339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:48.776307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:48.776887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:48.792389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82a721ad-f431-482f-8350-7809f06251ca tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:48.800897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82a721ad-f431-482f-8350-7809f06251ca tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1219 microversion: 2.1 time: 0.157075 Oct 10 10:55:48.815556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1972/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:48 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:49.064705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:49.075589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c537c20d-0a4e-4c09-b9e3-59eb6ea1f641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.318350 Oct 10 10:55:49.079158 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1878/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:48 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:49.149355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e15d9ee1-417d-40bb-a72e-1d2c5cc9969b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f6780c7d310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:49.286894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e15d9ee1-417d-40bb-a72e-1d2c5cc9969b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 346 microversion: 2.1 time: 0.145374 Oct 10 10:55:49.291222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1973/3851] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:55:49 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:49.306265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98a10a4c-7850-4ff2-9840-d6e55e6b1e2a tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Action: 'create', calling method: .version_select at 0x7f677c44ea60>, body: {"snapshot": {"volume_id": "0b49977a-4be7-4ac6-9c0e-e8a115cef8c0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-69477753"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:49.664008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98a10a4c-7850-4ff2-9840-d6e55e6b1e2a tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.362127 Oct 10 10:55:49.665452 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1879/3852] 10.222.0.16 () {60 vars in 1162 bytes} [Mon Oct 10 10:55:49 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:49.677761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9c9c2c48-8299-46ec-9906-d6d278a55957 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f6780d361f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:49.745596 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9c9c2c48-8299-46ec-9906-d6d278a55957 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.072397 Oct 10 10:55:49.746301 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1974/3853] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:49 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:49.761207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d01f9f5-677c-4af0-84fa-72f32c5d503b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f67779fb0d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:49.833087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:49.833756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:49.850443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:49.851315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:49.855111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:49.857326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:49.857844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:49.858256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:49.916921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d01f9f5-677c-4af0-84fa-72f32c5d503b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.161238 Oct 10 10:55:49.917725 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1880/3854] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 10 10:55:49 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:49.930324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18ffdf1c-4cf6-4504-8327-ffb429cc4907 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c2bb310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:50.006396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18ffdf1c-4cf6-4504-8327-ffb429cc4907 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.079636 Oct 10 10:55:50.007988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1881/3855] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:49 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:50.063445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:50.075277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca7e9d45-2c42-47fe-a978-49e54916a33d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1215 microversion: 2.1 time: 0.247043 Oct 10 10:55:50.075881 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1975/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:49 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:50.104768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:50.105823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:50.119784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:50.121697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:50.122302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:50.124253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:50.127648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:50.128561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:50.516754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:50.526593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6be1dbfa-9c47-40e3-b727-a91e15635d04 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.427410 Oct 10 10:55:50.528193 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1882/3857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:50 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:50.586943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c1eb21-579d-4a8d-9a5f-bcc17dd4d181", "tag": "80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:50.607974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:50.611815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:50.612500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:50.640006 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] Creating event network-changed:80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9 for instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 on n-h1-860687-2 Oct 10 10:55:50.654841 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4fd10f87-8f6e-4c6c-ae1d-9101181c6020 req-189e38d0-8db7-4fc2-93e7-a0faf8339313 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071558 Oct 10 10:55:50.656786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1976/3858] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:51.022024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcbc1e99-c0ad-4dc7-bbba-f195dd45160f tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c30b430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:51.096581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcbc1e99-c0ad-4dc7-bbba-f195dd45160f tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.079628 Oct 10 10:55:51.097891 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1883/3859] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:51 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:51.105306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:51.106639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:51.122194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:51.122706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:51.123180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:51.127536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:51.127930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:51.128677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:51.336936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:51.352176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ab7dc3a-d7c2-481f-8bfa-a5070e50488a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1277 microversion: 2.1 time: 0.252605 Oct 10 10:55:51.364509 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1977/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:51 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:51.550866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:51.551867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:51.565383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:51.570137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:51.571012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:51.572220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:51.572908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:51.573584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:51.997082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:52.006361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d118042-7731-4086-a697-84e22e32060d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.460195 Oct 10 10:55:52.028664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1884/3861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:51 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:52.121169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a701da93-8b4d-4a9e-b736-847df323dad5 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c92ae50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:52.184430 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a701da93-8b4d-4a9e-b736-847df323dad5 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.077871 Oct 10 10:55:52.186305 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1978/3862] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:52 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:52.403975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:52.404618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:52.419894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:52.421226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:52.422263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:52.423243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:52.423728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:52.424176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:52.517871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:52.526850 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0bd614f-68eb-4d10-b067-5e47632d914a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1277 microversion: 2.1 time: 0.132420 Oct 10 10:55:52.527468 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1885/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:52 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:53.037934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:53.038893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:53.054962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:53.058134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:53.060476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:53.064487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:53.065417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:53.068275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:53.199857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6db682d0-f922-47f1-8489-2c412efca6de tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c39e280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:53.254857 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6db682d0-f922-47f1-8489-2c412efca6de tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 286 microversion: 2.1 time: 0.058852 Oct 10 10:55:53.261921 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1886/3864] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:53 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:53.267031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181d76d4-9161-48c3-970f-647af232886e tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c2bbe50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:53.399497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-181d76d4-9161-48c3-970f-647af232886e tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 202 len: 0 microversion: 2.1 time: 0.136125 Oct 10 10:55:53.400170 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1887/3865] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 10 10:55:53 2022] DELETE /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:53.410519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-920319e6-6520-44bd-bcc0-e956a1018ea0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c4ef820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:53.497554 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-920319e6-6520-44bd-bcc0-e956a1018ea0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.088926 Oct 10 10:55:53.501330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1888/3866] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:53 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:53.555977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:53.556964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:53.567850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:53.570752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:53.571495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:53.574144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:53.575099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:53.575785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:53.578780 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5811d663-46fd-4059-8b51-162be5970986 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.545732 Oct 10 10:55:53.579560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:53.589905 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1979/3867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:53 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:54.112283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:54.119773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:54.122810 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64d83373-54df-430c-a472-14631df27e9e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.570750 Oct 10 10:55:54.123982 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1889/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:53 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:54.514858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-422640b3-d0f3-478a-abea-2b1420e294d9 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f6780dc08b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:54.592000 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-422640b3-d0f3-478a-abea-2b1420e294d9 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.081460 Oct 10 10:55:54.594068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1980/3869] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:54 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:54.617191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:54.619162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:54.629451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:54.629937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:54.632788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:54.649720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:54.650115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:54.654015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:54.927559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:54.931086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:54.959266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:54.964425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:54.965151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:54.984669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:54.985224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:54.985676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.043781 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ed89af7-caa5-4916-9dc3-0b5624ccad36 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120396 Oct 10 10:55:55.044634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1981/3870] 10.222.0.16 () {60 vars in 1343 bytes} [Mon Oct 10 10:55:54 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:55.152467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:55.152996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:55.168747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.175305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.175892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.176764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.177247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.177683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.472744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:55.528599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e75e274-5fb3-45c3-bf73-aef6ec7023fb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.894326 Oct 10 10:55:55.532991 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1890/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:54 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:55.544865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:55.545875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:55.567595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.569173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.569785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.570705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.571500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.572075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.635073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:55:55.704179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:55.713912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65c520f2-d973-43da-b19d-2e91f9918853 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.565622 Oct 10 10:55:55.720376 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1982/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:55 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:55.729471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e41c7943-f434-40a2-bb2c-209577196d36 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677cbc6ee0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:55.785860 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf58a338-8cab-4993-a569-8fd2383e2fa7 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 204 len: 0 microversion: 2.20 time: 0.250248 Oct 10 10:55:55.791296 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1891/3873] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:55:55 2022] DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:55:55.798388 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e41c7943-f434-40a2-bb2c-209577196d36 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 200 len: 285 microversion: 2.1 time: 0.076551 Oct 10 10:55:55.801927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:55.803324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:55.804539 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1983/3874] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:55 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:55.815185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.816103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.816708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.817608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:55.818568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:55.819044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:55.978983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf851f2-4eb0-4c93-a632-3a8523e0255a", "tag": "1d4bd02c-46e9-47e0-9c39-be73a90df529"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:56.001913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:56.003626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:56.005796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:56.022590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] Creating event network-changed:1d4bd02c-46e9-47e0-9c39-be73a90df529 for instance aaf851f2-4eb0-4c93-a632-3a8523e0255a on n-h1-860687-2 Oct 10 10:55:56.029840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f2c108bb-60d6-4218-9476-d9947bf470d1 req-dd41ca18-c883-4453-b2f2-b594d193910c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054530 Oct 10 10:55:56.032763 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1984/3875] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:56.054576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:56.066818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:56.069757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:56.071225 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ae8e810-df7f-4253-bede-e639ce472572 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.277683 Oct 10 10:55:56.072396 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1892/3876] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:55 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:56.555316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:56.556047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:56.569054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:56.569566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:56.570018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:56.570737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:56.575687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:56.576334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:56.936108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b96ab36b-b0f9-4be5-b190-cce6bfd5b9bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: .version_select at 0x7f677c462ee0>, body: {"keypair": {"name": "tempest-keypair-319390018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLv6+YeuHIJxOU3zVLuVP0XkIM9GAa2JO6HbFPwoI98MVRi3CRSHz2dCBWK6LMin3h4kt/3xuWITtGFl8ybM81ipYKdI2zbPu+cKsyI9SHttnUWYbr7yaLOdxq8/2cPF8Q=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:56.973833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b96ab36b-b0f9-4be5-b190-cce6bfd5b9bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:55:56.995426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b96ab36b-b0f9-4be5-b190-cce6bfd5b9bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:55:57.002968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:57.016977 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97daab50-3bd0-4c61-a3fb-6081fe8de690 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.466220 Oct 10 10:55:57.018466 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1985/3877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:56 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:57.033507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:57.034723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:57.054043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:57.056648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:57.057560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:57.057773 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b96ab36b-b0f9-4be5-b190-cce6bfd5b9bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.345029 Oct 10 10:55:57.059304 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1893/3878] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:55:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:57.060355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:57.061753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:57.063664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:57.070987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d78327af-1086-4763-b325-0dbcfa55421b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f67779c98b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:57.119683 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d78327af-1086-4763-b325-0dbcfa55421b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] HTTP exception thrown: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d78327af-1086-4763-b325-0dbcfa55421b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Request method failure captured: Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c HTTP/1.1 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_oxxXvZ49-NiipKt9GCU54Ymnm3555zWM0hKRKzQJ9Gc8HyRbKhcj6zpQBqY4t2Ov_g-4RnmfGBAXJzboiXlmTjJ6aCWjSXaQ9ww-R66-_bRjx-yH-ujVxW8zhQ0U-GsUFo1VHdkw3tQYAvyZmsgS6k1YmcB39hlZMneFbopCroTcs Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e67bfd46ce4a97b71ed39537d327df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e67bfd46ce4a97b71ed39537d327df"}]}] Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 178cb991e6294e42ac230dcfebbc032b Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: exception: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e1871ab0-48cc-4af1-93e0-578d2331168c'} Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. (HTTP 404) (Request-ID: req-311b765d-66b0-4419-81b8-d417f65ceb90) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:55:57.141238 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d78327af-1086-4763-b325-0dbcfa55421b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Returning 404 to user: Snapshot e1871ab0-48cc-4af1-93e0-578d2331168c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d78327af-1086-4763-b325-0dbcfa55421b tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c" status: 404 len: 111 microversion: 2.1 time: 0.082607 Oct 10 10:55:57.145313 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1894/3879] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 10:55:57 2022] GET /compute/v2.1/os-snapshots/e1871ab0-48cc-4af1-93e0-578d2331168c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:55:57.152875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:57.153515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:57.165353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:57.165861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:57.166492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:57.168060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:57.169608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:57.170451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:57.559437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:57.566246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:57.568782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10493001-cf2e-45e5-af10-c0cf28399ff2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.547556 Oct 10 10:55:57.573400 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1986/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:57 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:57.578634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-252892d2-01e0-473b-b8ec-83fecff2cfd0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c0b6790>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:57.578983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:57.582104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:57.585289 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-230e4d62-1238-4147-84e4-4c279de0c10d tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1721 microversion: 2.20 time: 0.438277 Oct 10 10:55:57.585883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1895/3881] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:57 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1721 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:57.683692 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-252892d2-01e0-473b-b8ec-83fecff2cfd0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 202 len: 0 microversion: 2.1 time: 0.108926 Oct 10 10:55:57.684835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1987/3882] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:55:57 2022] DELETE /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:55:57.694760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe7a211e-9c4d-41d1-8f55-b9e2771a4709 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f67779c9a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:57.775885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe7a211e-9c4d-41d1-8f55-b9e2771a4709 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 345 microversion: 2.1 time: 0.086210 Oct 10 10:55:57.777549 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1896/3883] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:55:57 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:58.043352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:58.044159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:58.056783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.061294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.061841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.062931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.063846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.064675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.098772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c1eb21-579d-4a8d-9a5f-bcc17dd4d181", "name": "network-vif-plugged", "status": "completed", "tag": "80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:58.143376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.145632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.146229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.180280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] Creating event network-vif-plugged:80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9 for instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 on n-h1-860687-2 Oct 10 10:55:58.189895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1e5eb97b-40f2-4da0-b60e-110965426b64 req-bd04aaba-a9db-48e7-b06b-c9ee13ab9c40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096115 Oct 10 10:55:58.191217 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1897/3884] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:58.602724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:58.604989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:58.620982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:58.631868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.633052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.633527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.642567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.643886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.644369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.647685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:58.657184 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1656df0-6ad9-4e5b-aa06-dcd0e6460530 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.618948 Oct 10 10:55:58.657810 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1988/3885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:58 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:55:58.681375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:58.682000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:58.716120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.723534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.724061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.724956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:58.725471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:58.725915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:58.813721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:55:58.915452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:58.925361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:58.937673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:58.939221 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73ccf740-ca8c-4f62-ba3b-6ad9c64d9eb2 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1654 microversion: 2.20 time: 0.280416 Oct 10 10:55:58.940343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1989/3886] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:55:58 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1654 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:55:58.948363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19b7cd91-0a4a-4e59-aa07-85bf53f51ee0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c838160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:59.041024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19b7cd91-0a4a-4e59-aa07-85bf53f51ee0 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 345 microversion: 2.1 time: 0.099459 Oct 10 10:55:59.041600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1990/3887] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:55:58 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:55:59.159619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1665418692", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cc0ab125-7c93-4493-8dc8-50b886798039"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:59.240551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:55:59.268869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] validate_networks() for [('cc0ab125-7c93-4493-8dc8-50b886798039', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:55:59.281438 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25e39849-11ee-4e35-8e10-cd9abe19d718 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.656188 Oct 10 10:55:59.282649 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1898/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:58 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:55:59.593968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0eaec45-a9c8-4010-aa0c-de67f1d5eb14", "name": "network-vif-deleted", "tag": "3b5457b0-056d-477e-876d-82b7ccabf4e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:55:59.613408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:59.613892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:59.614333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:59.632255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] Creating event network-vif-deleted:3b5457b0-056d-477e-876d-82b7ccabf4e4 for instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 on n-h1-860687-2 Oct 10 10:55:59.654986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9f7a0cdd-6dad-4abe-af80-82efcb54684f req-e80960bb-c35b-41e3-aaa7-12c5507def2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064995 Oct 10 10:55:59.656397 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1899/3889] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:55:59.682899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:55:59.693023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:55:59.700319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:59.701057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:59.701660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:55:59.703265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:55:59.707965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:55:59.708619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:00.209986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:00.229755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e20335ec-e654-435e-af99-dd7433038e05 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1315 microversion: 2.1 time: 0.550749 Oct 10 10:56:00.230671 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1900/3890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:55:59 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:00.250549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:00.251802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:00.273174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:00.273813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:00.281571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:00.284552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:00.285730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:00.294059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:00.571764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:00.580959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:00.582414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4ea69b8d1c14356a46d3d1db32e0456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1556caa994a6e9b322c4da89dd453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:00.583616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e785bbe-f160-42ff-b6cf-685110d14434 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 200 len: 1364 microversion: 2.20 time: 0.348178 Oct 10 10:56:00.595905 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1901/3891] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:00 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:00.602884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25fe0997-6b1f-490c-85a1-c9a57be7fa66 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c2bbdc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:00.699540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25fe0997-6b1f-490c-85a1-c9a57be7fa66 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 200 len: 345 microversion: 2.1 time: 0.101570 Oct 10 10:56:00.702263 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1902/3892] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:56:00 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:00.709763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:00.711393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:00.719830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:00.721048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:00.721676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:00.722588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:00.723420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:00.724187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.057671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:56:01.058209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:56:01.058552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:56:01.059161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:56:01.059757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:56:01.081761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:01.082795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.083315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.083757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.084722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.084943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.085370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.099320 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc0c26fe-ca12-4304-8694-51f78429a705 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.395605 Oct 10 10:56:01.100200 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1903/3893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:00 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:01.118749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Getting quotas for project b0ffc81e13de48c4abe5816b87767473. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:56:01.126826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Getting quotas for user fac679b555fa4ef789ec8f1c0f5a32d0 and project b0ffc81e13de48c4abe5816b87767473. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:56:01.144069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:56:01.147350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:56:01.206202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48445652-2b11-47db-97dc-06476a5b66b1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.163261 Oct 10 10:56:01.207592 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1991/3894] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:56:01.221330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.222244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:01.224987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:01.253746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.254468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:01.268729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.271462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.272552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.274114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.275356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.277442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.400029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:01.410236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:01.411847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:01.413907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a952175c-f9d6-4ebf-b754-cf05463ae87e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1262 microversion: 2.26 time: 0.197880 Oct 10 10:56:01.415922 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1904/3895] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:01 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1262 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:56:01.583418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:01.604666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a72a277-5dd1-4646-ad1a-476a725b3639 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1501 microversion: 2.1 time: 0.354495 Oct 10 10:56:01.606540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1992/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:01 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1501 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:01.633128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.633999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:01.634370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:01.634737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:01.651241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.652987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.654173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.655327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.655976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.656096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.656607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.657637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.658372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:01.658846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:01.659418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.663442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:01.685681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 HTTP/1.1 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e0eaec45-a9c8-4010-aa0c-de67f1d5eb14'} Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.694986 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:01.700637 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.704846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:01.714672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61d9aa97-0514-4def-a8b3-1965c26ff01b tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 404 len: 111 microversion: 2.20 time: 0.088506 Oct 10 10:56:01.732046 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1905/3897] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:01 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:01.744842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57ef4f83-6417-4204-858d-4bb69142f351 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c4ef9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.752317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'flavor' on Instance uuid 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:01.818294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-57ef4f83-6417-4204-858d-4bb69142f351 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] HTTP exception thrown: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57ef4f83-6417-4204-858d-4bb69142f351 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Request method failure captured: Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 HTTP/1.1 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_oxxXvZ49-NiipKt9GCU54Ymnm3555zWM0hKRKzQJ9Gc8HyRbKhcj6zpQBqY4t2Ov_g-4RnmfGBAXJzboiXlmTjJ6aCWjSXaQ9ww-R66-_bRjx-yH-ujVxW8zhQ0U-GsUFo1VHdkw3tQYAvyZmsgS6k1YmcB39hlZMneFbopCroTcs Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e67bfd46ce4a97b71ed39537d327df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e67bfd46ce4a97b71ed39537d327df"}]}] Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 178cb991e6294e42ac230dcfebbc032b Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: exception: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0b49977a-4be7-4ac6-9c0e-e8a115cef8c0'} Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. (HTTP 404) (Request-ID: req-3d92d097-38ea-4a61-8ef2-e8e87663e234) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:56:01.824427 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.828066 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.831142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57ef4f83-6417-4204-858d-4bb69142f351 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Returning 404 to user: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:01.832950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57ef4f83-6417-4204-858d-4bb69142f351 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 404 len: 109 microversion: 2.1 time: 0.096605 Oct 10 10:56:01.833829 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1906/3898] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:56:01 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:01.845354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d11e2c6-7302-4dd2-a58a-62e99db8be91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '.version_select at 0x7f67779e8700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.890951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d11e2c6-7302-4dd2-a58a-62e99db8be91 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968833037" status: 204 len: 0 microversion: 2.20 time: 0.053816 Oct 10 10:56:01.897958 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1907/3899] 10.222.0.16 () {60 vars in 1259 bytes} [Mon Oct 10 10:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968833037 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:01.911288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2aef41d-3f8d-4851-ba60-f0d2b35eba46 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f677c39e940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:01.971317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a2aef41d-3f8d-4851-ba60-f0d2b35eba46 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] HTTP exception thrown: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2aef41d-3f8d-4851-ba60-f0d2b35eba46 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Request method failure captured: Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 HTTP/1.1 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_oxxXvZ49-NiipKt9GCU54Ymnm3555zWM0hKRKzQJ9Gc8HyRbKhcj6zpQBqY4t2Ov_g-4RnmfGBAXJzboiXlmTjJ6aCWjSXaQ9ww-R66-_bRjx-yH-ujVxW8zhQ0U-GsUFo1VHdkw3tQYAvyZmsgS6k1YmcB39hlZMneFbopCroTcs Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e67bfd46ce4a97b71ed39537d327df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e67bfd46ce4a97b71ed39537d327df"}]}] Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 178cb991e6294e42ac230dcfebbc032b Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: exception: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0b49977a-4be7-4ac6-9c0e-e8a115cef8c0'} Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. (HTTP 404) (Request-ID: req-ab5546d2-a1e8-4d32-ba21-d07b126cd4e3) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:56:01.973571 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2aef41d-3f8d-4851-ba60-f0d2b35eba46 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Returning 404 to user: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2aef41d-3f8d-4851-ba60-f0d2b35eba46 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 404 len: 109 microversion: 2.1 time: 0.075919 Oct 10 10:56:01.976927 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1908/3900] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 10:56:01 2022] DELETE /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:01.991234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-776691638", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4170c24-8757-45a8-8f28-ac22cc23fbd1"}], "security_groups": [{"name": "tempest-securitygroup--1309985016"}], "key_name": "tempest-keypair-319390018", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:02.159249 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-995aec73-ec97-4654-940b-7e1c0643f6cc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181/action" status: 202 len: 0 microversion: 2.1 time: 0.529490 Oct 10 10:56:02.161840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1993/3901] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:56:01 2022] POST /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:56:02.178159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23775ac3-c2d1-4942-9079-174a7bf60f32 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Calling method '.version_select at 0x7f6780dc09d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:02.246993 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-23775ac3-c2d1-4942-9079-174a7bf60f32 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] HTTP exception thrown: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23775ac3-c2d1-4942-9079-174a7bf60f32 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Request method failure captured: Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 HTTP/1.1 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_oxxXvZ49-NiipKt9GCU54Ymnm3555zWM0hKRKzQJ9Gc8HyRbKhcj6zpQBqY4t2Ov_g-4RnmfGBAXJzboiXlmTjJ6aCWjSXaQ9ww-R66-_bRjx-yH-ujVxW8zhQ0U-GsUFo1VHdkw3tQYAvyZmsgS6k1YmcB39hlZMneFbopCroTcs Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9e67bfd46ce4a97b71ed39537d327df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9e67bfd46ce4a97b71ed39537d327df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9e67bfd46ce4a97b71ed39537d327df"}]}] Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f9e67bfd46ce4a97b71ed39537d327df Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259958285 Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 178cb991e6294e42ac230dcfebbc032b Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259958285-project Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: exception: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0b49977a-4be7-4ac6-9c0e-e8a115cef8c0'} Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. (HTTP 404) (Request-ID: req-b7d713dd-2c9c-46fe-a8b2-d11323ea0823) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 10:56:02.250586 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23775ac3-c2d1-4942-9079-174a7bf60f32 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] Returning 404 to user: Volume 0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:02.254126 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23775ac3-c2d1-4942-9079-174a7bf60f32 tempest-VolumesSnapshotsTestJSON-259958285 tempest-VolumesSnapshotsTestJSON-259958285-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0" status: 404 len: 109 microversion: 2.1 time: 0.088356 Oct 10 10:56:02.259464 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1994/3902] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 10:56:02 2022] GET /compute/v2.1/os-volumes/0b49977a-4be7-4ac6-9c0e-e8a115cef8c0 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:02.270302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:02.271205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:02.296461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:02.297410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:02.298027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:02.299053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:02.299789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:02.300533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:02.317655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] validate_networks() for [('d4170c24-8757-45a8-8f28-ac22cc23fbd1', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:56:03.491231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:03.507862 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f7365430-48a2-4345-8dbf-b2ee906d8e34 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 1.249619 Oct 10 10:56:03.508945 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1995/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:02 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:03.528030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:03.529487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:03.540600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:03.541577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:03.542189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:03.545343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:03.548329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:03.549380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:03.826069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:03.870478 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3bcf6fb-2b33-4105-8407-5bc3477c6b12 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.356277 Oct 10 10:56:03.871198 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1996/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:03 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:03.880089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:03.887381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:03.896341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:03.897098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:03.897711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:03.898636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:03.899359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:03.899992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:03.930801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:03.997620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:04.016541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:04.019881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:04.022930 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72948d48-faa4-472b-9ea1-e6fce300a726 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1320 microversion: 2.26 time: 0.149662 Oct 10 10:56:04.023840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1997/3905] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:03 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:04.036633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:04.037513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:04.045922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.047232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.048070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.048945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.049881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.050465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.101961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:56:04.102566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:56:04.103077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:56:04.103539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:56:04.104004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:56:04.125189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.125744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.127348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.128143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.130593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.133412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.201004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:56:04.222311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:56:04.257077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:56:04.261266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'services' on Instance uuid 2abe118a-f500-425e-93eb-942ff0e4501c {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:04.262294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:56:04.401339 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3ede260-f3fe-4de3-a25c-0dd52b0651bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.424396 Oct 10 10:56:04.402577 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1909/3906] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:56:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:56:04.429231 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d993d272-fe01-4984-b5c8-90d8555196c8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments/3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5" status: 202 len: 0 microversion: 2.1 time: 0.366632 Oct 10 10:56:04.434439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1998/3907] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:56:04 2022] DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments/3ae7d7e5-af4f-4cb3-8276-b41c9fa92ad5 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:56:04.464620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf282c56-2873-442d-bb9a-b5ccc3319617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:04.465990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf282c56-2873-442d-bb9a-b5ccc3319617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:04.474431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:04.497312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:04.512035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.512490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.512940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.513680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.514126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.514557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.560295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf282c56-2873-442d-bb9a-b5ccc3319617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:04.589684 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf282c56-2873-442d-bb9a-b5ccc3319617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1237 microversion: 2.1 time: 0.155289 Oct 10 10:56:04.592626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1910/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:04 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:04.599615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:04.601381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:04.613598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f4e2e547-af2c-4438-b5ab-361e10c59b94 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177195 Oct 10 10:56:04.613957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.618826 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 1999/3909] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:04 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:04.620636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.622613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.624099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.625611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.626315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.628327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf851f2-4eb0-4c93-a632-3a8523e0255a", "name": "network-vif-plugged", "status": "completed", "tag": "1d4bd02c-46e9-47e0-9c39-be73a90df529"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:04.668510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.669234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.669829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.713923 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] Creating event network-vif-plugged:1d4bd02c-46e9-47e0-9c39-be73a90df529 for instance aaf851f2-4eb0-4c93-a632-3a8523e0255a on n-h1-860687-2 Oct 10 10:56:04.734359 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e0e492f5-884a-43e5-9d7f-4b3e5f8b3902 req-5f449ce3-7cf6-47ff-8170-74db13554b20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110875 Oct 10 10:56:04.739317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2000/3910] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:04.895392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:04.898194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:04.918561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.920549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.923609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:04.943459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:04.944023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:04.944493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:05.013033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.026895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-656289f8-8964-42f8-8aa1-183abba4947c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.432070 Oct 10 10:56:05.027510 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1911/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:04 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:05.060722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:05.061396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:05.093102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:05.093662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:05.094250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:05.098821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:05.102865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:05.105572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:05.450854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.462468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b7e0f30d-976f-4304-b4f3-3269da9b2aee tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.572436 Oct 10 10:56:05.474104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2001/3912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:04 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:05.614952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5654d28b-8067-425c-b23c-bf27b237d234 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:05.615612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5654d28b-8067-425c-b23c-bf27b237d234 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:05.697143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.712429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.717276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.721180 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec5d6238-e27f-4635-94b4-e73011019218 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.667076 Oct 10 10:56:05.722057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1912/3913] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:05 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:05.752565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:05.755965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5654d28b-8067-425c-b23c-bf27b237d234 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:05.768469 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5654d28b-8067-425c-b23c-bf27b237d234 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1237 microversion: 2.1 time: 0.152733 Oct 10 10:56:05.769106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2002/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:05 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:05.787010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:05.822070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:05.825306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:05.827160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:05.832652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:05.834190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:05.835668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:05.923446 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-685540eb-1bdd-44b5-8fe8-6bacdadc83e1 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197159 Oct 10 10:56:05.923984 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1913/3915] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:05 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:06.049942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:06.050827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:06.058165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.059051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.059673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.060682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.061372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.062555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.353928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:06.373929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07b8abf4-6236-4b15-8a1b-77f52c8d6c05 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1319 microversion: 2.1 time: 0.323962 Oct 10 10:56:06.377014 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2003/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:06 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:06.489631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:06.491532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:06.508614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.510940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.512730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.518114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.519118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.519752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.759233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:06.759233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:06.771161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.775116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.776366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.777290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:06.777923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:06.780794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:06.956369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:06.965708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a32d32a3-59f0-443e-be5d-3c7fa73f4666 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.481552 Oct 10 10:56:06.970991 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1914/3917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:06 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:06.990693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:06.995547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:07.028594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.029093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.029542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.030263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.030757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.040935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.117779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:07.132117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:07.134383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:07.135879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0630a9f-c0c5-474e-9f0d-0c3987791b43 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.384194 Oct 10 10:56:07.137270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2004/3918] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:06 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:07.149661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c7bc80-c54a-456f-a24a-57a3ce2ba1a2", "tag": "0242a87d-c6c2-4568-b7f6-8ef92d7daa12"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:07.196277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.197126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.198686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.226397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] Creating event network-changed:0242a87d-c6c2-4568-b7f6-8ef92d7daa12 for instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 on n-h1-860687-2 Oct 10 10:56:07.235269 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d2cfb943-c1b2-4319-b00d-95572c333136 req-a4fc1733-e7f5-4424-8d4b-0a01ea474193 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096492 Oct 10 10:56:07.239695 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2005/3919] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:07.255828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:07.265926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:07.281382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:07.282310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ad523b5-0bd8-4871-8487-85cd638bed58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1289 microversion: 2.1 time: 0.307498 Oct 10 10:56:07.283853 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1915/3920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:06 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1289 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:07.334768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.336560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.337299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.338226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.339457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.345555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.404381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:07.405281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:07.434651 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f102b2a-7bc1-4c6e-b531-f3bb68b28e89 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190797 Oct 10 10:56:07.435856 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2006/3921] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:07 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:07.438325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.441167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.441627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.449448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:07.453092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:07.453588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:07.555709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:07.828356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:07.844251 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55b07e12-fc03-48e8-9057-2313dac02c94 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1507 microversion: 2.1 time: 0.446336 Oct 10 10:56:07.859030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1916/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:07 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:07.993645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:07.994374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:08.005233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.005882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.007735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.010815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.012874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.020834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.163513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:08.165620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:08.173969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.177109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.178863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.181846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.182556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.185762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.409031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:08.424206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09bd3f8b-3c3d-4d23-a2bf-8bc09ebe95b7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.430141 Oct 10 10:56:08.444215 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2007/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:07 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:08.455609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:08.458328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:08.470263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.470947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.471611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.472587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.473204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.474042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.637907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:08.659749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8c17569-853c-4b3f-a5db-4bd5856b65ab tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1295 microversion: 2.1 time: 0.211462 Oct 10 10:56:08.661824 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2008/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:08 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:08.670245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:08.681730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:08.694224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.695057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.697146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.698139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:08.698827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:08.699435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:08.706654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:08.727473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:08.729676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:08.731080 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dceb057e-4d46-40f4-90cd-c1026995ef63 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.572663 Oct 10 10:56:08.732410 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1917/3925] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:08 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:08.802893 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-371d10f1-549c-4f65-91ee-d384335142e5 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139435 Oct 10 10:56:08.804186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2009/3926] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:08 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:09.459330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:09.459959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:09.490405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:09.490816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:09.491293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:09.496311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:09.506588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:09.507428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:09.689784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:09.691554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:09.715604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:09.716517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:09.718758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:09.726644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:09.730743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:09.731570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.000914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:10.013599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d55c4def-4cb3-4ccb-8762-634d82bc70a2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.561902 Oct 10 10:56:10.019295 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1918/3927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:09 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:10.031432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:10.032478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:10.048994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.049718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.052760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.053676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.054458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.060495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.255769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:10.270577 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3eb74ee6-d4b2-4924-b477-8b91cab5e5fe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.585168 Oct 10 10:56:10.283308 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2010/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:10.283308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:10.306667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:10.331036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.335270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.339665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.343633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.347120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.347825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.386067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:10.399824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:10.402045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:10.403819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be95a005-3436-40c9-a94f-231263e8564b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.383252 Oct 10 10:56:10.405056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1919/3929] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:10 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:10.413192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:10.414046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:10.424810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.425817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.426630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.427682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.428252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.428789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.448530 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 HTTP/1.1 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e0eaec45-a9c8-4010-aa0c-de67f1d5eb14'} Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:10.451550 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.458001 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.467254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:10.468666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65c533c8-76b9-4fc9-83e0-72fe36dd2fbf tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 404 len: 111 microversion: 2.20 time: 0.061105 Oct 10 10:56:10.470163 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1920/3930] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:56:10 2022] DELETE /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:10.473055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4b5a610-ad86-4e29-bef4-1128840283ab tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192856 Oct 10 10:56:10.476813 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2011/3931] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:10 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:10.484105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:10.486660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: e0eaec45-a9c8-4010-aa0c-de67f1d5eb14] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:10.509082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.513519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.514345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.516640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:10.517350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:10.518740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:10.551296 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 HTTP/1.1 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e0eaec45-a9c8-4010-aa0c-de67f1d5eb14'} Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.561351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. Oct 10 10:56:10.566290 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:10.568208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:10.569275 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e780dc45-2aa3-4222-9f90-7d28d6d97317 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14" status: 404 len: 111 microversion: 2.20 time: 0.094288 Oct 10 10:56:10.570160 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1921/3932] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:10 2022] GET /compute/v2.1/servers/e0eaec45-a9c8-4010-aa0c-de67f1d5eb14 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:11.040375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:11.041002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:11.060357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.062429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.062826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.064554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.065652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.067941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.105009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:11.298139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:11.298773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:11.308569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.309343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.309954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.312883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.313513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.316330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.377962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:11.386320 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6de98c09-51da-4cb3-b630-e7a90d720146 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.350038 Oct 10 10:56:11.394247 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2012/3933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:11 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:11.434651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:11.435313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:11.447130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.447638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.448086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.448806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.449273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.449706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.873519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:11.908165 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93d0f6d8-28eb-4c58-9fee-7524d9ba6328 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.611811 Oct 10 10:56:11.908801 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1922/3934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:11.915813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:11.918375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:11.932770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.934697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.945371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.946700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:11.946828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:11.948979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:11.950356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:11.962704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:11.965923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:11.968754 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d119e327-cbab-4331-93d2-a5a39e583a5c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.537723 Oct 10 10:56:11.970598 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2013/3935] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:11 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:56:11.989292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:12.008650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:12.009668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:12.010266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:12.021538 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-928b73f6-9eff-4416-b54f-a71be91e6939 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110484 Oct 10 10:56:12.022379 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1923/3936] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:11 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:12.030073 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] Creating event network-changed:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:56:12.038901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a02ee3bf-13e0-47e2-a484-f8db5db359de req-a5979cff-ddd3-40fd-9273-13ade20712d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060843 Oct 10 10:56:12.040439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2014/3937] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:12.411363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:12.412839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:12.430349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:12.430933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:12.431407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:12.432136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:12.432603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:12.436342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:12.658850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:12.667937 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf5b179c-07f6-447f-b267-d77a85540969 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.261307 Oct 10 10:56:12.668532 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1924/3938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:12 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:12.951095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:12.953311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:12.985351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:12.988014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:12.988678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:12.989289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:12.990165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:12.990864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:12.991877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.000784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:13.002083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:13.013499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.015021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.016859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.018787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.020350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.021049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.251765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:13.271634 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb9ca435-9776-4c3c-97ba-c0eec0d1a9e0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.342129 Oct 10 10:56:13.272548 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2015/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:12 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:13.281830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:13.284096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:13.290289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:13.300913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:13.302653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:13.303449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.303957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.304405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.304878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98c77886-f31e-4808-ac47-a1e3e9a7b7ef tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.309985 Oct 10 10:56:13.305129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.305861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.306467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.317135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:13.319268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1925/3940] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:12 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:13.361246 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09c62f24-8751-4023-b567-141c07d402cf tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087494 Oct 10 10:56:13.362686 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2016/3941] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:13 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:13.698010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:13.698743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:13.713192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.713690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.715657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.717345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.717868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.718318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:13.935645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:13.953908 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c5b9b6e-5157-4600-b4fe-1f1716590038 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.263809 Oct 10 10:56:13.968431 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1926/3942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:13 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:13.969467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c7bc80-c54a-456f-a24a-57a3ce2ba1a2", "name": "network-vif-plugged", "status": "completed", "tag": "0242a87d-c6c2-4568-b7f6-8ef92d7daa12"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:13.992666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:13.993272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:13.995250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.023971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] Creating event network-vif-plugged:0242a87d-c6c2-4568-b7f6-8ef92d7daa12 for instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 on n-h1-860687-2 Oct 10 10:56:14.038909 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-caee8d70-acfc-484e-8c1e-1f9d6a59bf62 req-22f85dc6-ea2e-4c07-99b7-5452cb94b0ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073428 Oct 10 10:56:14.042048 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2017/3943] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:56:14.071138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.076265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.076942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Searching by: {'deleted': False, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:56:14.104475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.105091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.105815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.114778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.117655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.118123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.179553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:56:14.215943 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2857bf3-f828-4927-bf75-db8ff180533d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.147537 Oct 10 10:56:14.217353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1927/3944] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers => generated 334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:14.230755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.237607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.239367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Searching by: {'deleted': False, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:56:14.245344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.246244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.247263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.249514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.250367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.251070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.287801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:56:14.300735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.301894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.313183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.314012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.318348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.319655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.320360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.321208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.407627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.427470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.428180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.429509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.584286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.591969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=26 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:14.607301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf246ad9-076a-4492-9adf-6811b411d793 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.308725 Oct 10 10:56:14.616633 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1928/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:14.632125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.633608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.643695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.644656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.645641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.646570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.647341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.648097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.668407 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22b8c384-1062-4df8-b239-876cd4f0169a tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.442538 Oct 10 10:56:14.670040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2018/3946] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:14.685370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.691262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.704731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.705752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.706776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.707825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.708530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.709261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.747648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fe56aaf-b4e2-4132-9f75-84b82e424c8e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076248 Oct 10 10:56:14.756127 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2019/3947] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:56:14.762730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0e01cd6-8ee5-45e7-be79-c3171359d77c tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.772254 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0e01cd6-8ee5-45e7-be79-c3171359d77c tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014106 Oct 10 10:56:14.773437 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2020/3948] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:14.850844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:14.853415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.864534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.865321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.867127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.868040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.870533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.871352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.893139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.904473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.906745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:14.908145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3e7b1bb-c145-4bf4-928a-55164adf5b94 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1362 microversion: 2.26 time: 0.290234 Oct 10 10:56:14.909904 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1929/3949] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:14.920427 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Cannot 'reboot' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action HTTP/1.1 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 28 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: {"reboot": {"type": "HARD"}} Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'reboot' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e2510fae-68a5-4540-beb0-4a596ff96a50', 'body': {'reboot': {'type': 'HARD'}}} Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:56:14.923087 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:14.927722 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:14.928540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 409 to user: Cannot 'reboot' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:14.929489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f135153-df3f-439e-a9f6-9a143f8db612 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action" status: 409 len: 145 microversion: 2.1 time: 0.085176 Oct 10 10:56:14.931244 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2021/3950] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:56:14 2022] POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:56:14.941956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:14.945358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.965992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.966494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.967163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.967995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.968458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.969046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.980377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:14.981012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:14.988934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.989635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.990436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:14.991337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:14.991948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:14.992557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.019551 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Cannot 'rebuild' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action HTTP/1.1 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 65 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'rebuild' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e2510fae-68a5-4540-beb0-4a596ff96a50', 'body': {'rebuild': {'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c'}}} Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:56:15.021556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued Oct 10 10:56:15.025682 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:15.027808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 409 to user: Cannot 'rebuild' instance e2510fae-68a5-4540-beb0-4a596ff96a50 while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:15.028885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46901610-6c88-42fc-a948-8e2628f7609e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action" status: 409 len: 146 microversion: 2.1 time: 0.092435 Oct 10 10:56:15.029903 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1930/3951] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:56:14 2022] POST /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50/action => generated 146 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:56:15.040278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.041461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.052948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.053603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.054051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.054755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.055290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.055895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.085491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:56:15.243242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58c0455f-c85a-4b34-ac6d-6e2d6f1cb9ba tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 204 len: 0 microversion: 2.1 time: 0.207467 Oct 10 10:56:15.243828 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1931/3952] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:56:15 2022] DELETE /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:56:15.265511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.266502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.273920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:15.280854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.283419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.283873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.284599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.285067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.285612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.287724 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7e604fd-d7f3-4d18-b41d-1143ef66b6c7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.312296 Oct 10 10:56:15.301016 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2022/3953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:14 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:15.309498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.310423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.318795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.319637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.320644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.321677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.322284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.323116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.323878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:56:15.327763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:15.458008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4615b2f-6eed-4a8a-804b-ff141e210bd6 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 204 len: 0 microversion: 2.1 time: 0.204283 Oct 10 10:56:15.463152 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1932/3954] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:56:15 2022] DELETE /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:56:15.481198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.482261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.509180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.509688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.510124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.510848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.515276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.515276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.564734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:15.575547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-78b189a5-e430-4e95-a4ac-3c1de3f5c535 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1688 microversion: 2.1 time: 0.272070 Oct 10 10:56:15.576205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2023/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:15 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1688 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:15.630840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.631622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.656561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.657359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.658553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.661034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.665338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.668615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.749086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:15.758914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6724221f-76af-4f7b-8b66-811aa44a7c44 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1700 microversion: 2.1 time: 0.288177 Oct 10 10:56:15.760841 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1933/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:15 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1700 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:15.903527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:15.916444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16ffcf2b-29e5-4fd8-a9ac-d4b497e54880 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.289226 Oct 10 10:56:15.917058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2024/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:15 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:15.938666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:15.939436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:15.947986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.948486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.948928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:15.949647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:15.950210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:15.950642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.171528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:16.182841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:16.185783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:16.187858 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f42d84f3-440e-4322-a20b-b94980151862 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1546 microversion: 2.26 time: 0.255611 Oct 10 10:56:16.189635 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1934/3958] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:15 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1546 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:16.215797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f6777a0ca60>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.228242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.229397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.229845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.230348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.238071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.238792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.239405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.240264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.240866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.241438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.271328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.271989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.272651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.289381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.290272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.290863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.315277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.315471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.326714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.328443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.328635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.329344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.329801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.330224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.345509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:16.378529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b5aa4a2-4838-400e-995e-cb8a006a80c0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-354676735" status: 201 len: 0 microversion: 2.26 time: 0.166805 Oct 10 10:56:16.384918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2025/3959] 10.222.0.16 () {62 vars in 1377 bytes} [Mon Oct 10 10:56:16 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-354676735 => generated 0 bytes in 174 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 10 10:56:16.392360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e216979-77b5-4189-a710-5dee0d6d252b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f6777a0cdc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.401604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e216979-77b5-4189-a710-5dee0d6d252b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.402321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e216979-77b5-4189-a710-5dee0d6d252b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.402938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e216979-77b5-4189-a710-5dee0d6d252b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.416539 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e216979-77b5-4189-a710-5dee0d6d252b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-354676735" status: 204 len: 0 microversion: 2.26 time: 0.030318 Oct 10 10:56:16.417634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2026/3960] 10.222.0.16 () {60 vars in 1358 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-354676735 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:16.427878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677c92a310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.447981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.449091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.451117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.453154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.459446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.460141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.460729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.461594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.462200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.462896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.491358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.492248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.493235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.525562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:16.567096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-149e7ef9-b6cc-4156-aff5-69f1f872ffb8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 204 len: 0 microversion: 2.26 time: 0.143848 Oct 10 10:56:16.570085 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2027/3961] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Oct 10 10:56:16 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:16.585317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-01687693-c8fc-46e7-967c-d72359f49145 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f6780de93a0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.625684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:16.626948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01687693-c8fc-46e7-967c-d72359f49145 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.631668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01687693-c8fc-46e7-967c-d72359f49145 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.632010 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3b4740f-5ceb-490d-bff0-59ce20e7c07f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.324312 Oct 10 10:56:16.632185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01687693-c8fc-46e7-967c-d72359f49145 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.645686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-01687693-c8fc-46e7-967c-d72359f49145 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 12 microversion: 2.26 time: 0.068501 Oct 10 10:56:16.645958 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1935/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:16.647083 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2028/3963] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 12 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:16.659657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677cbdc670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.659878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.660386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.668865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.669363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.670090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.673310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.673822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.674900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.683469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.683965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.685801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.686303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.700438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.700936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.701371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.702521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.702723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.703192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.767415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.767898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.768332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.783058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.783558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.783996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.818325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:16.854280 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-421e2910-f6c7-4721-8d68-4477d26293a1 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1337411824" status: 201 len: 0 microversion: 2.26 time: 0.199274 Oct 10 10:56:16.854509 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2029/3964] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Oct 10 10:56:16 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1337411824 => generated 0 bytes in 201 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 10 10:56:16.863556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.864175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:16.871792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.871968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.872284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.873083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.873556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.874597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.905079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:16.919647 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfef1953-fe8e-4dae-a6fe-b9592c9b4aff tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1688 microversion: 2.1 time: 0.271290 Oct 10 10:56:16.927664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1936/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1688 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:16.939858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10e5c802-f8b0-4683-a1ff-13ca7a8b5e6f tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677c548b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:16.961912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e5c802-f8b0-4683-a1ff-13ca7a8b5e6f tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:16.962808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e5c802-f8b0-4683-a1ff-13ca7a8b5e6f tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:16.964002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e5c802-f8b0-4683-a1ff-13ca7a8b5e6f tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:16.999935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10e5c802-f8b0-4683-a1ff-13ca7a8b5e6f tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 36 microversion: 2.26 time: 0.072919 Oct 10 10:56:17.009483 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1937/3966] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 36 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:17.015316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.016215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.023215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.024059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.024721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.025640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.026304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.026957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.090566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:17.096550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:17.109995 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72ce930f-2163-4557-bc8a-3d99a171b983 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1700 microversion: 2.1 time: 0.252628 Oct 10 10:56:17.110592 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2030/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:16 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1700 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:17.122895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677d6ca5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.133082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.133644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.134098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.134602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.143024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.143570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.144065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.145031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.148742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.149232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.178647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.179202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.179654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.212017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:17.225177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:17.231963 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30d1bbb3-e9ad-4f4d-b22c-045ac4b7e9a0 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1337411824" status: 204 len: 0 microversion: 2.26 time: 0.117002 Oct 10 10:56:17.234526 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed5e2a5e-1586-4fcc-b10f-f1a3393c306a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.222608 Oct 10 10:56:17.235069 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2031/3968] 10.222.0.16 () {60 vars in 1364 bytes} [Mon Oct 10 10:56:17 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1337411824 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:17.235168 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1938/3969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:17 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:17.246115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1a45358-b3a1-43bd-8e06-b40acb3da3bf tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677c39ec10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.253084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:17.262307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1a45358-b3a1-43bd-8e06-b40acb3da3bf tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.263125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1a45358-b3a1-43bd-8e06-b40acb3da3bf tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.263662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1a45358-b3a1-43bd-8e06-b40acb3da3bf tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.279434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1a45358-b3a1-43bd-8e06-b40acb3da3bf tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 12 microversion: 2.26 time: 0.040622 Oct 10 10:56:17.285324 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1939/3970] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:56:17 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:17.292072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677d6ca160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.308790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.309429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.310518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.313262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.326481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.326977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.332430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.333201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.334059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.334566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.376266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.376882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.377188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.392301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:17.411816 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d6909e2-65ed-4f32-8fa2-3cba97b80767 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 204 len: 0 microversion: 2.26 time: 0.124742 Oct 10 10:56:17.416492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2032/3971] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Oct 10 10:56:17 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:17.425891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f67779c9160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.437789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.438466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.438949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.439755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.453699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.454013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.454740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.455844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.456395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.456909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.490082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.490689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.491240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.503227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.503723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.505731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.539556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:17.559996 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d545c8d-4bc7-4246-abe3-ff299115e96b tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-284858608" status: 201 len: 0 microversion: 2.26 time: 0.142013 Oct 10 10:56:17.561287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1940/3972] 10.222.0.16 () {62 vars in 1377 bytes} [Mon Oct 10 10:56:17 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-284858608 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 10 10:56:17.571687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677c0a1dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.582884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.583638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.584313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.584818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.595858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.596367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.596809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.597545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.598003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.598428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.633552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.634080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.634548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.645979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.646539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.647071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.664502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.665198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.677072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.678033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.678483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.679207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.683832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.684344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.700138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:17.727157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bcffdd4-27be-4b93-954a-17cdf78cd174 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1829494436" status: 201 len: 0 microversion: 2.26 time: 0.159445 Oct 10 10:56:17.728575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2033/3973] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Oct 10 10:56:17 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1829494436 => generated 0 bytes in 162 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 10:56:17.745351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677cb99f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.767168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.767761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.770321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.771194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.784585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.785091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.785529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.786691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.786691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.790342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.847752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.848182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.848618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.875317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:17.920417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:17.922346 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3efb28b-9021-4067-9616-5b9a2aefa56c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 204 len: 0 microversion: 2.26 time: 0.188652 Oct 10 10:56:17.923029 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2034/3974] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Oct 10 10:56:17 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:17.930252 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d5b49fa-e9f7-4382-b5d3-0881ab88026c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.270746 Oct 10 10:56:17.931657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1941/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:17 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:17.934670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c4dabc1-62bc-4e8e-83eb-750d26f14adc tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677c92ae50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.951141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:17.953103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:17.968836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.969500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.969744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c4dabc1-62bc-4e8e-83eb-750d26f14adc tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.970228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c4dabc1-62bc-4e8e-83eb-750d26f14adc tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.970667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c4dabc1-62bc-4e8e-83eb-750d26f14adc tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.971303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.974345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:17.974955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:17.975533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:17.995321 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c4dabc1-62bc-4e8e-83eb-750d26f14adc tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 12 microversion: 2.26 time: 0.064333 Oct 10 10:56:18.002537 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2035/3976] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:56:17 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:18.010059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677cbbdd30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.020930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.021341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.021809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.022264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.033788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.034286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.034951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.036145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.038511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.038511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.066364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.066871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.067362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.082426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:18.101094 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-900992f3-f1bb-4847-8dbc-db3d7537fbfd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 204 len: 0 microversion: 2.26 time: 0.096157 Oct 10 10:56:18.101868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2036/3977] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Oct 10 10:56:18 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:18.114058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-plugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:18.132826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.133922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.134065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.152502 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] Creating event network-vif-plugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:56:18.158720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:18.159348 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-725df0d9-dbeb-4c60-8189-9f2d1bb0db4a req-82dcd1fc-3492-49c0-a5d7-f9ccddd52089 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050310 Oct 10 10:56:18.160398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2037/3978] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:18.166295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677cbd6f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.169266 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33b61404-2e3b-43d6-84a0-ee8ba4ca1406 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1688 microversion: 2.1 time: 0.222411 Oct 10 10:56:18.170379 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1942/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:17 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:18.176403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.177274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.180435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.180924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.181360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.181936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.190003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.194403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.194907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.195399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.196115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.196628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.196991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.203283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.203743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.204497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.204962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.205389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.256530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.257345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.258499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.283129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.283510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.283950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.338234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:18.407545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7529ac27-265e-48fa-95ef-0e736d57ad61 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-100592628" status: 201 len: 0 microversion: 2.26 time: 0.244845 Oct 10 10:56:18.409904 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2038/3980] 10.222.0.16 () {62 vars in 1377 bytes} [Mon Oct 10 10:56:18 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-100592628 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 10 10:56:18.422496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.425640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.437973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.443324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.443866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.444697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.445244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.445754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.481782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:18.495114 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20002975-036e-4fd9-8646-a5a8263fa1a7 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1700 microversion: 2.1 time: 0.320940 Oct 10 10:56:18.507726 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1943/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:18 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1700 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:18.516135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677cffb430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.528046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.528696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.529215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.529775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.537078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.537583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.538233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.539259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.539918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.540555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.575590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.576538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.577717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.592493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.593051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.593499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.623464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:18.642287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:18.656077 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-275d2bdd-e12c-4591-b8e3-8a19809db923 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.241716 Oct 10 10:56:18.656677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2039/3982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:18 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:18.664877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bca3663d-694e-419f-9034-4e68d1e050c8 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1962516259" status: 201 len: 0 microversion: 2.26 time: 0.153723 Oct 10 10:56:18.666337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1944/3983] 10.222.0.16 () {62 vars in 1380 bytes} [Mon Oct 10 10:56:18 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags/tempest-tag-1962516259 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 10:56:18.679454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Action: 'update_all', calling method: .version_select at 0x7f6780cf8790>, body: {"tags": ["tempest-tag-1975898628", "tempest-tag-1147492193"]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:18.688449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.688968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.690942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.691462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.691905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.692390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.698317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.698801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.699267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.700242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.700966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.701821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.704444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.705124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.705582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.706305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.707068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.707518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.709192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:18.733300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.733881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.734324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.734961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 HTTP/1.1 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3336aaa7-7f97-4985-8589-74926d3df687'} Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:18.736707 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:18.740182 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5992f819-a0ee-416b-8ebe-49ad64d112f5 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 404 len: 111 microversion: 2.20 time: 0.063622 Oct 10 10:56:18.741858 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2040/3984] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:56:18 2022] DELETE /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:18.747352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.748196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] [instance: 3336aaa7-7f97-4985-8589-74926d3df687] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.758147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.758657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.759150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.759858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.760651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.760862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.781143 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] HTTP exception thrown: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Request method failure captured: Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 HTTP/1.1 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_iAsEv15gT_cr0IkfuEsqNI7cT0eSHofD_o9KKQxJTT9mrm5Yhbq4fMR8Sqh9iUz6Oxuzehypf7IQmu3Fcq0KZCJhLmSc7yDl8lKvE9L7okOWxLHYF8QiiU7NS1UA1em0HFdfJSYgEPYhXPqAfafjB17DftBr4MtZQkOQZD-iWW46s Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42e1556caa994a6e9b322c4da89dd453", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42e1556caa994a6e9b322c4da89dd453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42e1556caa994a6e9b322c4da89dd453"}]}] Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 42e1556caa994a6e9b322c4da89dd453 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1345890955 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f4ea69b8d1c14356a46d3d1db32e0456 Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1345890955-project Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3336aaa7-7f97-4985-8589-74926d3df687'} Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.783543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. Oct 10 10:56:18.787808 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:18.789605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] Returning 404 to user: Instance 3336aaa7-7f97-4985-8589-74926d3df687 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:18.790494 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b25c030-b3c1-4f48-a5cb-709d15510845 tempest-AttachVolumeShelveTestJSON-1345890955 tempest-AttachVolumeShelveTestJSON-1345890955-project] 10.222.0.16 "GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687" status: 404 len: 111 microversion: 2.20 time: 0.047448 Oct 10 10:56:18.791215 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2041/3985] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:18 2022] GET /compute/v2.1/servers/3336aaa7-7f97-4985-8589-74926d3df687 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:18.795839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:18.824890 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2cf1fae-2534-4de6-9c55-0a5bb4efe25c tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 62 microversion: 2.26 time: 0.152770 Oct 10 10:56:18.834552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1945/3986] 10.222.0.16 () {62 vars in 1312 bytes} [Mon Oct 10 10:56:18 2022] PUT /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 62 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:18.837748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97b5a565-7a99-46e0-af86-8d9d6e4ed044 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f67778305e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.853540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a565-7a99-46e0-af86-8d9d6e4ed044 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.860727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a565-7a99-46e0-af86-8d9d6e4ed044 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.861348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b5a565-7a99-46e0-af86-8d9d6e4ed044 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.880377 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97b5a565-7a99-46e0-af86-8d9d6e4ed044 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 200 len: 62 microversion: 2.26 time: 0.047593 Oct 10 10:56:18.881369 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2042/3987] 10.222.0.16 () {60 vars in 1292 bytes} [Mon Oct 10 10:56:18 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 62 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:18.894213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '.version_select at 0x7f677d254d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.903561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.904442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.905507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.906153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.914967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.915559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.916438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.917296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.917990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.918710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.953878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.961447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:18.962085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:18.967884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.968900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.973017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.973512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.978377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:18.979297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:18.979768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:18.980481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.000387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lazy-loading 'flavor' on Instance uuid 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:19.027701 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22843874-0087-4c94-b77f-78e7a9267b22 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags" status: 204 len: 0 microversion: 2.26 time: 0.140270 Oct 10 10:56:19.028683 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1946/3988] 10.222.0.16 () {60 vars in 1295 bytes} [Mon Oct 10 10:56:18 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2/tags => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 10:56:19.053550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:19.076515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:19.092772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.093759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.096109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.097364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.097842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.098285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.172158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:56:19.356546 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4dec0f2-3ab7-4f6c-884b-1bd918df9910 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 204 len: 0 microversion: 2.26 time: 0.307976 Oct 10 10:56:19.357577 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1947/3989] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:56:19 2022] DELETE /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:56:19.364997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:19.366208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:19.375212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.376591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.377332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.378197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.378676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.379246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.408160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:19.420130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45e7ad87-9ff7-40c0-a773-fc90cbf8a41d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.461893 Oct 10 10:56:19.421579 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2043/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:18 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:19.431929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:19.435734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:19.452485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.453343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.453977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.455183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.456071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.456660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.478869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:19.899344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:19.913748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:19.915301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:19.919812 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8d7d615-9bbc-47e7-b81b-e745c94046ae tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1552 microversion: 2.26 time: 0.495659 Oct 10 10:56:19.920403 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2044/3991] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:19 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1552 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:19.935512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:19.936287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:19.951227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:19.951453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.952213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.953194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.955043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.956695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:19.957853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:19.962734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d88eace9-b5fb-420f-ba50-3661b2f9edb8 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1688 microversion: 2.1 time: 0.603739 Oct 10 10:56:19.966685 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1948/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:19 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1688 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:19.974883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:19.980323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:19.994809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:19.995328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:20.000067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:20.000820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:20.001295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:20.001734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:20.339195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:20.356155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85d2a04d-5c67-4fcb-89ca-60f10ea1ba9b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1700 microversion: 2.1 time: 0.432921 Oct 10 10:56:20.356891 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2045/3993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:19 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1700 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:20.441212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:20.454894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:20.456511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:20.459349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0e6a346-b618-485d-9948-e1626d724fc1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1363 microversion: 2.1 time: 0.486315 Oct 10 10:56:20.460288 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1949/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:19 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:20.470239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:20.470731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:20.473959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:20.474705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:20.475224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:20.475968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:20.802052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:20.814853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1e3e27b-c56d-4c65-8a7d-c760e8ad1ccc tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.365525 Oct 10 10:56:20.828031 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2046/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:20 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:20.954532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:20.955315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:20.982840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:20.986151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:20.986597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:20.995412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:20.996353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:20.997184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:21.001049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:21.002149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:21.009414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:21.016305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:21.018148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:21.021277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:21.022616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:21.026755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:21.446177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:21.463946 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca381571-8fe9-406b-b58d-755bbc919a8d tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1620 microversion: 2.1 time: 0.472383 Oct 10 10:56:21.468328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2047/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:20 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1620 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:21.506515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:21.510427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:21.554353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:21.555793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:21.559558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:21.562245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:21.563779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:21.564437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:21.959520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:21.971857 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46526933-80ff-4867-8604-154f0d89add3 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1633 microversion: 2.1 time: 0.485800 Oct 10 10:56:21.976412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2048/3997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:21 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1633 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:21.995748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:21.997022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:22.025624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.027479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.028465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.031505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.033134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.034568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.118196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.129309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.136070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.141517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd38c571-1a2c-4eed-87b4-2bef011b0ebd tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1552 microversion: 2.26 time: 1.192472 Oct 10 10:56:22.147733 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1950/3998] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:20 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1552 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:22.157400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:22.161103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:22.181784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.182565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.183269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.184232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.189611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.196356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.527138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.536264 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a13ae151-fe80-46b6-b535-a92416355b8d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1548 microversion: 2.1 time: 0.548323 Oct 10 10:56:22.541147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2049/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:21 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1548 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:22.550474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5cad758-e7bb-49a5-91d0-3c3897b5bfed", "name": "network-vif-deleted", "tag": "8ce938c2-7952-4f03-93c0-4e89b128c2be"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:22.581247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.584067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.585503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.613423 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] Creating event network-vif-deleted:8ce938c2-7952-4f03-93c0-4e89b128c2be for instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed on n-h2-860687-2 Oct 10 10:56:22.627082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1eb98197-dd83-4a4a-a4d0-01f9192fb9b4 req-eddada9c-b198-4e52-92ce-ed6c101ed417 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083812 Oct 10 10:56:22.628318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2050/4000] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:22.641282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:22.642282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:22.658240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.661572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.662766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.664056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.664759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.667898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.690109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.705456 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8a91823-0466-4b57-9001-51cef8fc3d3e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.555947 Oct 10 10:56:22.706460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1951/4001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:22 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:22.719728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:22.720590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:22.739988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.740990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.741649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.742581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.743390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.744239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.862475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:22.878491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-291be928-2f31-4038-ac82-721b5791f5f2 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 200 len: 1620 microversion: 2.1 time: 0.248692 Oct 10 10:56:22.882232 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2051/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:22 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 1620 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:22.899757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abe118a-f500-425e-93eb-942ff0e4501c", "name": "network-vif-deleted", "tag": "0037ece1-7af3-42bd-8e49-ed4782a1501e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:22.918927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:22.927684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:22.928144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:22.980464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] Creating event network-vif-deleted:0037ece1-7af3-42bd-8e49-ed4782a1501e for instance 2abe118a-f500-425e-93eb-942ff0e4501c on n-h2-860687-2 Oct 10 10:56:22.997653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f91144ed-0a4d-4af9-a19d-017b9061cebf req-cec2bcf2-f2a9-46d4-a701-92a8581ba1c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111739 Oct 10 10:56:23.001520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2052/4003] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:23.013995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:23.026636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:23.039701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.042643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.045697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-417365e0-b4c9-4b18-b46f-3215927eaf06 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336549 Oct 10 10:56:23.047949 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1952/4004] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 10:56:22 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/os-interface => generated 284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:23.049492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.050695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.051518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.052102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.178761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:23.180155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:23.194680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.197110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.200034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.202406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.202924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.204055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.206830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.208099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.208713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.219092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lazy-loading 'fault' on Instance uuid e5cad758-e7bb-49a5-91d0-3c3897b5bfed {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:23.925033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997ba9b96bea4e7f92e7720397521f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c2d9b763d1409fad9c88c4404c2fa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:23.936929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9f8fa29-0ea7-4916-82e3-ef7de4a7686d tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 200 len: 1359 microversion: 2.1 time: 0.930069 Oct 10 10:56:23.940084 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2053/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:23 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 1359 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:23.955736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:23.956657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:23.970317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:23.974905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.976419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.977028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:23.981465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:23.982196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:23.985304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:24.151351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:24.268154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:24.406939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:25.068970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:25.088162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:25.093707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fac679b555fa4ef789ec8f1c0f5a32d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ffc81e13de48c4abe5816b87767473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:25.099583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1dacf33-9efd-4ea9-98b9-a168e41d63e9 tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 200 len: 1552 microversion: 2.26 time: 1.926069 Oct 10 10:56:25.104645 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1953/4006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:23 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 1552 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:25.120273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:25.123729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: 2abe118a-f500-425e-93eb-942ff0e4501c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:25.139037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:25.140713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:25.142342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:25.143811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:25.148265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:25.151447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:25.154814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:25.169925 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4f14fb2-ffd4-4561-9f81-cf55ac3311d6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 1.228458 Oct 10 10:56:25.173589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2054/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:23 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:25.179630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:25.182352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] [instance: e5cad758-e7bb-49a5-91d0-3c3897b5bfed] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:25.216925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:25.218518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:25.222784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:25.225366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:25.228656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:25.232428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:25.243627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c HTTP/1.1 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2abe118a-f500-425e-93eb-942ff0e4501c'} Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.247754 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. Oct 10 10:56:25.251835 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.259017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 404 to user: Instance 2abe118a-f500-425e-93eb-942ff0e4501c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:25.260142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e67258d-7d61-4b15-85f2-1e2b5b632c8b tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c" status: 404 len: 111 microversion: 2.1 time: 0.154221 Oct 10 10:56:25.261292 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1954/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:25 2022] GET /compute/v2.1/servers/2abe118a-f500-425e-93eb-942ff0e4501c => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:25.267250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c7bc80-c54a-456f-a24a-57a3ce2ba1a2", "name": "network-vif-deleted", "tag": "0242a87d-c6c2-4568-b7f6-8ef92d7daa12"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:25.284079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:25.284879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:25.285494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:25.295157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] HTTP exception thrown: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Request method failure captured: Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed HTTP/1.1 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_oIUf7TrA20zv8_DmqjXGOK0PMPEiJqSZICRUBKbgBSotCwCCb0RafDyi8tGGX4cRB8jbzzlIk_S2jliwdikY0Pdu6bg-l3pLjLgduVDJKGLODFITbbXt6UtawTHdY55Du4G-vFAbnGHWxU36DVAyJLJON7vFyafY1o9SU3DSxm6pM Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a1c2d9b763d1409fad9c88c4404c2fa1 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersTestJSON-1937369892 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1c2d9b763d1409fad9c88c4404c2fa1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1c2d9b763d1409fad9c88c4404c2fa1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1c2d9b763d1409fad9c88c4404c2fa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1c2d9b763d1409fad9c88c4404c2fa1"}]}] Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersTestJSON-1937369892 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a1c2d9b763d1409fad9c88c4404c2fa1 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersTestJSON-1937369892 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersTestJSON-1937369892-project Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 997ba9b96bea4e7f92e7720397521f55 Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersTestJSON-1937369892-project Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e5cad758-e7bb-49a5-91d0-3c3897b5bfed'} Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:25.306481 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:25.310549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Returning 404 to user: Instance e5cad758-e7bb-49a5-91d0-3c3897b5bfed could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:25.315719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11eebe41-feb1-44a4-9869-769178f8428b tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed" status: 404 len: 111 microversion: 2.1 time: 0.135795 Oct 10 10:56:25.316368 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2055/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:25 2022] GET /compute/v2.1/servers/e5cad758-e7bb-49a5-91d0-3c3897b5bfed => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:25.330253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] Creating event network-vif-deleted:0242a87d-c6c2-4568-b7f6-8ef92d7daa12 for instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 on n-h1-860687-2 Oct 10 10:56:25.337728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f8252838-a5fe-4411-ba56-87dcc86133b9 req-7adc1199-279b-46dc-9237-769351f0bbbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074839 Oct 10 10:56:25.338781 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1955/4010] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:25.344805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ad70ba2d-32f3-41e9-8048-573e4de3e144 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '.version_select at 0x7f677cbd6940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:25.346331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d045485d-3e31-436d-8cd7-9afeff5c5686 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] Calling method '.version_select at 0x7f677d262dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:25.376652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ad70ba2d-32f3-41e9-8048-573e4de3e144 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-574850040" status: 202 len: 0 microversion: 2.1 time: 0.056451 Oct 10 10:56:25.377941 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2056/4011] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-574850040 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:56:25.397441 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d045485d-3e31-436d-8cd7-9afeff5c5686 tempest-ServersTestJSON-1937369892 tempest-ServersTestJSON-1937369892-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918181670" status: 202 len: 0 microversion: 2.1 time: 0.057226 Oct 10 10:56:25.400744 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1956/4012] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 10:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918181670 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:56:26.133959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:26.134919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] [instance: 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:26.153794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:26.156900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:26.160198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:26.164908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:26.166169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:26.169935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:26.197369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:26.198981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:26.228837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:26.230001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:26.231389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:26.236586 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] HTTP exception thrown: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. Oct 10 10:56:26.237085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:26.238468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Request method failure captured: Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 HTTP/1.1 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_o-NP4-6VmKG8LLR1BibYOTMuaOwvxVrZk3_lW5GEwCsMF5BIohJy5cl8x0my0jyT_sLNxaAKpsKWekg8kXE7D5OfnNA8KRZFDqNm1fjPBy3pftKoZAJQxyyoEWrYVbtLvP_w93I9nrSORZ59MRH5_DbFxFQ65eGVmZ4uMZN5NS_cw Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.26 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b0ffc81e13de48c4abe5816b87767473 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerTagsTestJSON-950780616 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0ffc81e13de48c4abe5816b87767473"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0ffc81e13de48c4abe5816b87767473", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0ffc81e13de48c4abe5816b87767473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0ffc81e13de48c4abe5816b87767473"}]}] Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerTagsTestJSON-950780616 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b0ffc81e13de48c4abe5816b87767473 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerTagsTestJSON-950780616 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerTagsTestJSON-950780616-project Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: fac679b555fa4ef789ec8f1c0f5a32d0 Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerTagsTestJSON-950780616-project Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '59c7bc80-c54a-456f-a24a-57a3ce2ba1a2'} Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:26.238855 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. Oct 10 10:56:26.243715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:26.245306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:26.247705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] Returning 404 to user: Instance 59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:26.249743 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b9927a65-9c14-4f14-ae16-634f5d39d98e tempest-ServerTagsTestJSON-950780616 tempest-ServerTagsTestJSON-950780616-project] 10.222.0.16 "GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2" status: 404 len: 111 microversion: 2.26 time: 0.122372 Oct 10 10:56:26.254183 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2057/4013] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:26 2022] GET /compute/v2.1/servers/59c7bc80-c54a-456f-a24a-57a3ce2ba1a2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:56:26.720850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:26.732418 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2d171f8-7618-405e-a4a8-6a132d4dab53 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1507 microversion: 2.1 time: 0.538236 Oct 10 10:56:26.735796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1957/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:26 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:26.792269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:26.810954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:26.814898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:26.816803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:26.852173 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] Creating event network-changed:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:56:26.865220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-96fc70c4-beae-40e7-b5c5-c27c705e97a0 req-4d1b8b44-3d0c-4d27-a74f-25f12dd701e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075445 Oct 10 10:56:26.867977 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2058/4015] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:27.761477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:27.762822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:27.779141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:27.780468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:27.781147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:27.782106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:27.782786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:27.783463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:28.336770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:28.347644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6200ab72-76fb-4a07-8eba-1c6391260dc3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1528 microversion: 2.1 time: 0.589951 Oct 10 10:56:28.364337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1958/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:27 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1528 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:29.392880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:29.394313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:29.407933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:29.410553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:29.412412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:29.415817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:29.418033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:29.418749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:30.146266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:30.162439 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-121d39e8-6a1e-4729-a32c-b3d3fce2a37c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1528 microversion: 2.1 time: 0.774655 Oct 10 10:56:30.165774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2059/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:29 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1528 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:31.193088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:31.193703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:31.216656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:31.219606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:31.225026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:31.226074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:31.226710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:31.227708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:31.839861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:31.850986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8772bf92-b6f2-4201-81d2-8dcfeae61cab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.661743 Oct 10 10:56:31.851608 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1959/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:31 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:32.226384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c1eb21-579d-4a8d-9a5f-bcc17dd4d181", "name": "network-vif-plugged", "status": "completed", "tag": "80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:32.250159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:32.263998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:32.267061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:32.322615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] Creating event network-vif-plugged:80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9 for instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 on n-h1-860687-2 Oct 10 10:56:32.369301 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5b72b09e-9957-4abd-a5fc-a80e7321ae84 req-80014659-a965-4c36-b317-9a3d1fdb3a90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142400 Oct 10 10:56:32.378959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2060/4019] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:32.880732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:32.881390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:32.895741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:32.906079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:32.906535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:32.908473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:32.909840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:32.911936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:33.417346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:33.434669 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2614b96b-a371-4687-9a4c-d9d6ff58643f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.559203 Oct 10 10:56:33.448416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1960/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:32 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:34.464422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:34.465514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:34.488982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:34.489489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:34.489926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:34.490646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:34.503008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:34.505720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:34.939914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:34.961014 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45ec8b81-0d73-44ab-9fac-da4168a188fd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.500797 Oct 10 10:56:34.970386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2061/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:34 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:35.996586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:35.997371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:36.023436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:36.024057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:36.024513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:36.025275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:36.025732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:36.033476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:36.134892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:36.751323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:36.760243 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8df8ab0a-9fb8-45e7-94ca-e41e7d15d9ec tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.768955 Oct 10 10:56:36.760831 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1961/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:35 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:37.801088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:37.801715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:37.821999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:37.825404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:37.831380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:37.831380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:37.834188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:37.835825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:39.460876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:39.470313 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dbe58372-ff72-42bb-b4c4-c64046e0b78c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 1.688325 Oct 10 10:56:39.470900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2062/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:37 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:40.508501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:40.511500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:40.520821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:40.522451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:40.523785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:40.525437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:40.527676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:40.528513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:41.514975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:41.527778 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8efade22-0c69-415b-8655-b843bff5353c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 1.033910 Oct 10 10:56:41.529090 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1962/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:40 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:42.557008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:42.557588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:42.604697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:42.605427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:42.608421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:42.611442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:42.615161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:42.615740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:42.858819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:42.868482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3fe31753-0c46-4b56-b6ae-1c76d649a745 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.316068 Oct 10 10:56:42.869689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2063/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:42 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:43.400238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:43.400740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:43.417347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.419444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.422676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:43.424352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.425385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.427344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:43.466727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:56:43.613011 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc236ee0-73a6-4c90-a474-5b9b5c269561 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 204 len: 0 microversion: 2.1 time: 0.217424 Oct 10 10:56:43.615932 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1963/4026] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:56:43 2022] DELETE /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:56:43.626313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:43.630271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:43.656801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.661908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.663755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:43.666904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.668042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.670583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:43.895275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:43.896158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:43.910520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.913558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.914023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:43.914757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:43.922196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:43.922625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:44.043596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:44.058590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5fd2a41-f2e8-4e08-841c-1f3bb025eb7e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1509 microversion: 2.1 time: 0.438451 Oct 10 10:56:44.059236 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2064/4027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:43 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:44.366607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:44.378941 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f767b03-190d-4580-b251-9c60eab76278 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.487666 Oct 10 10:56:44.380192 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1964/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:43 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:45.070293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1975264-8102-4ce0-a2de-6d87cced2d68", "device": "/dev/sdb"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:45.073593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:45.088979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:45.089779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:45.093140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.093850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.094676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.096907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.097382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.099481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.099974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.100412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.100702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.101353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.101817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.102245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.264064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:45.400578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:45.425715 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76b45eb9-9aee-4acc-88b1-d5fc1f8da47e tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1509 microversion: 2.1 time: 0.341320 Oct 10 10:56:45.433168 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1965/4029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:45 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:45.449560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:45.455953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:45.466220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.467554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.468335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.469243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:45.469842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:45.470404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:45.602600 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87e95ac7-c468-44d3-b378-aa4e49e9f44c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "POST /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536525 Oct 10 10:56:45.606131 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2065/4030] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:56:45 2022] POST /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:45.747758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:45.759039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79abcf04-af0a-4221-95ff-246fb197cf20 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.324518 Oct 10 10:56:45.795062 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1966/4031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:45 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:46.222695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1923015548", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:46.371134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:56:46.371563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:56:46.372037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:56:46.372771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:56:46.373325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:56:46.403345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:46.403884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:46.404897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:46.405798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:46.406369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:46.407047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:46.452740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:46.454441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:46.476511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Getting quotas for project e0298add60e54b3f8241393675926394. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:56:46.482826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:46.488347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:46.489800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Getting quotas for user c24e73c233d5466a984ae3232f596c2b and project e0298add60e54b3f8241393675926394. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:56:46.490768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:46.492753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:46.499374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:46.503654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:46.529699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:56:46.545369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:56:46.655980 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97998a3b-7520-4883-ada6-9d201ec32430 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.048313 Oct 10 10:56:46.659298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2066/4032] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 10:56:46.670794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:46.673216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:46.903168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:46.925877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1ec3df7-d0ea-497c-bf00-47c4bab90b82 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 200 len: 1467 microversion: 2.1 time: 0.479248 Oct 10 10:56:46.945131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1967/4033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:46 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 1467 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:46.968677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2510fae-68a5-4540-beb0-4a596ff96a50", "name": "network-vif-deleted", "tag": "03f94d7e-a415-45b4-ada4-e9ef72817eba"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:47.017994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:47.019951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:47.024318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:47.059722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] Creating event network-vif-deleted:03f94d7e-a415-45b4-ada4-e9ef72817eba for instance e2510fae-68a5-4540-beb0-4a596ff96a50 on n-h1-860687-2 Oct 10 10:56:47.075692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:47.087946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-669fff75-a9a7-4c93-9ebd-b521c05739c9 req-c99bde97-dd5d-42c6-90b9-269d7701b1de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123795 Oct 10 10:56:47.096327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1968/4034] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:47.098121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:47.102988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:47.113218 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b8bdd359-2689-48e4-8a39-6012ae1132f2 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1278 microversion: 2.54 time: 0.441324 Oct 10 10:56:47.115445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2067/4035] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:46 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1278 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:56:47.116296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:47.119491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:47.140572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:47.141455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:47.142255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:47.143784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:47.145172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:47.146467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:47.603372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:47.618774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66c03d93-fd52-449f-81bb-21fd228e0bdb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.520732 Oct 10 10:56:47.653050 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1969/4036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:47 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:47.983249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:47.983249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: e2510fae-68a5-4540-beb0-4a596ff96a50] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:47.989877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:47.990594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:47.991451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:47.992749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:47.993693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:47.994445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.016063 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 HTTP/1.1 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e2510fae-68a5-4540-beb0-4a596ff96a50'} Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:48.019204 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. Oct 10 10:56:48.024444 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:48.026908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 404 to user: Instance e2510fae-68a5-4540-beb0-4a596ff96a50 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:48.028920 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f53567c2-8070-4e9f-9480-493224253391 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50" status: 404 len: 111 microversion: 2.1 time: 0.055946 Oct 10 10:56:48.030400 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2068/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:47 2022] GET /compute/v2.1/servers/e2510fae-68a5-4540-beb0-4a596ff96a50 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:48.039033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:48.039668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:48.048691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:48.053361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.053930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.054378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.055139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.065259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.066000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.156406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:48.160452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:48.192515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.194522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.198706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.205217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.207675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.210748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.249977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:56:48.453007 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-855adad4-5c35-44ab-a6fb-09cf327cfafa tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 204 len: 0 microversion: 2.1 time: 0.417840 Oct 10 10:56:48.455252 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1970/4038] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:56:48 2022] DELETE /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:56:48.468689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:48.469418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:48.478620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:48.500763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.501281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:48.503226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:48.504440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94abd4ef-4173-4dda-9e3d-7fc6b0b34214 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1274 microversion: 2.54 time: 0.361259 Oct 10 10:56:48.505108 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2069/4039] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:48 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:48.505889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.506536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.507507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.510414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.511083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.652950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:48.654060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:48.663729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.665770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.667561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:48.669518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:48.672454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:48.673792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:49.626347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:49.644548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-284dd219-8d21-454a-be4b-611e09ad4763 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.996366 Oct 10 10:56:49.648164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2070/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:48 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:49.658681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:49.659561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:49.672594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:49.682944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:49.683528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:49.691351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:49.693212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:49.694092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:49.905606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:49.924368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:49.937435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:49.943938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c588aac-ff46-4c05-b11e-27c98a67a76e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1330 microversion: 2.54 time: 0.294163 Oct 10 10:56:49.959661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2071/4041] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:49 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1330 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:50.147708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:50.180968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14076b9c-c32c-454c-abde-f3dc158b97fe tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 1.718157 Oct 10 10:56:50.188149 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1971/4042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:48 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:50.676196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:50.676945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:50.694563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:50.696061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:50.703439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:50.707248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:50.709578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:50.711554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:50.975403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:50.976029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:50.988838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:50.991498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:51.002149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:51.006823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:51.007362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:51.009238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:51.299189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:51.317810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:51.325153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:51.326964 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6adbbdc8-19e9-4fab-add5-e3fa31b483f8 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1338 microversion: 2.54 time: 0.357131 Oct 10 10:56:51.327572 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1972/4043] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:50 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1338 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:51.398187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:51.399855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:51.422202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:51.427995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:51.429051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:51.431228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:51.431876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:51.433170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:51.441731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:51.459789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f204930e-29a4-4581-8b00-8d2f5e97b5e8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.788624 Oct 10 10:56:51.462920 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2072/4044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:50 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:51.958752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:51.976887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a471ec32-cd06-4e0b-ac81-2f45b445298c tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1522 microversion: 2.1 time: 0.607368 Oct 10 10:56:51.978144 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1973/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:51 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:52.257200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e5873-8bb0-495a-80c8-ce1b71859e61", "name": "network-vif-deleted", "tag": "078f09bc-6b65-4943-b53e-3c27f60906d3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:52.290185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:52.291488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:52.293525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:52.329144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] Creating event network-vif-deleted:078f09bc-6b65-4943-b53e-3c27f60906d3 for instance b69e5873-8bb0-495a-80c8-ce1b71859e61 on n-h2-860687-2 Oct 10 10:56:52.343819 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-cd114baf-86ee-4ace-a3b2-e25c7d0101d7 req-b91c7030-4492-4ce9-a23a-06efd0e7c646 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091559 Oct 10 10:56:52.347492 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2073/4046] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:56:52.358243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:52.359031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:52.378576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:52.383744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:52.384406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:52.387035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:52.390900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:52.391558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:52.487454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:52.488573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:52.505188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:52.506055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:52.506725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:52.508137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:52.508855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:52.512989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:52.627784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:52.641954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:52.647411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:52.649668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c9bdf10-f3a0-4e5b-be47-6ce5b38567cf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1336 microversion: 2.54 time: 0.296611 Oct 10 10:56:52.650403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1974/4047] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:52 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:53.014876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:53.015454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:53.034019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:53.034526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:53.035301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:53.036028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:53.036678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:53.051449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:53.121299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:53.173066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:53.178485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:53.184426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:53.185700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lazy-loading 'fault' on Instance uuid b69e5873-8bb0-495a-80c8-ce1b71859e61 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:56:53.410649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f6c75faee37446a96834935a3933cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '790c92b4ee424b9d8659fae80b9e72d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:53.425637 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf518521-e0c8-4df9-9687-764d80d4b115 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 200 len: 1312 microversion: 2.1 time: 0.420594 Oct 10 10:56:53.426351 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1975/4048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:53 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:53.468747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:53.477676 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41298998-9818-4803-8b1f-5a80607b3bc6 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.996513 Oct 10 10:56:53.491641 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2074/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:52 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:56:53.684063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:53.684805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:53.708028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:53.708766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:53.709315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:53.712536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:53.713121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:53.713625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:53.962691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:53.980294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:53.986973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:53.994965 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79ead650-d555-483e-8ddd-6fba64e7fd2a tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1357 microversion: 2.54 time: 0.309700 Oct 10 10:56:54.007849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1976/4050] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:53 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:54.042941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c5b0d794-d3a9-4d69-8df9-85d287a8824d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Action: 'create', calling method: .version_select at 0x7f677c9d3dc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-518477253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYCJ3Jhtovl/2yRl26eYo3yGEQgq1KDxEcp9l0ZAgdibkZwouSQDCfEtIAfUcRq/vA7JG9vgAs9/EKRDz2rlWvVouGBveodBtyDeo4h/gWiqM2uviRopfQo3fXu2LSUbg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:54.053354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:54.067655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c5b0d794-d3a9-4d69-8df9-85d287a8824d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Getting quotas for project e0298add60e54b3f8241393675926394. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:56:54.078976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c5b0d794-d3a9-4d69-8df9-85d287a8824d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Getting quotas for user c24e73c233d5466a984ae3232f596c2b and project e0298add60e54b3f8241393675926394. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:56:54.120577 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c5b0d794-d3a9-4d69-8df9-85d287a8824d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.081774 Oct 10 10:56:54.136882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-518477253", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:56:54.142328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2075/4051] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 10:56:54 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 10:56:54.143365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:54.151484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.152150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.152980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.154120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.155836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.156797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.278017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:56:54.278745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:56:54.279966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:56:54.281334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:56:54.282045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:56:54.416380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:54.435752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.436018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.437862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.439290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.441322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.441408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.455461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:54.456103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] [instance: b69e5873-8bb0-495a-80c8-ce1b71859e61] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:54.472606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.482390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.484773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.492871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.493395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.493859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.575074 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] HTTP exception thrown: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Request method failure captured: Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 HTTP/1.1 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_krcSCMJqHIJBiKqEARp0WxCFU7Rse1Bp77mhRQEGfIQiDmtxN7NcFgqu0TyYEn213lPkxhiyatHa1J1EGiXRKGDtVmNrMhjOVR0h-tKpMHJD0o6AuTAq1v7bvauowP1_U4twmQ14MAz5X11Ybjn_SIaQE9w0LStg_eg5IxsT8cLFA Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_790c92b4ee424b9d8659fae80b9e72d5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/790c92b4ee424b9d8659fae80b9e72d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/790c92b4ee424b9d8659fae80b9e72d5"}]}] Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 790c92b4ee424b9d8659fae80b9e72d5 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1672966097 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8f6c75faee37446a96834935a3933cd8 Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1672966097-project Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b69e5873-8bb0-495a-80c8-ce1b71859e61'} Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:54.577357 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:56:54.580988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] Returning 404 to user: Instance b69e5873-8bb0-495a-80c8-ce1b71859e61 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:56:54.586273 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d719cacf-1260-4a4f-94e1-54400a7a0bcc tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "POST /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd/action" status: 202 len: 1139 microversion: 2.54 time: 0.452767 Oct 10 10:56:54.589033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1977/4052] 10.222.0.16 () {62 vars in 1320 bytes} [Mon Oct 10 10:56:54 2022] POST /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd/action => generated 1139 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 10:56:54.615289 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bee7be89-d1e9-481d-94db-ef5f4b60f705 tempest-ServerRescueNegativeTestJSON-1672966097 tempest-ServerRescueNegativeTestJSON-1672966097-project] 10.222.0.16 "GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61" status: 404 len: 111 microversion: 2.1 time: 0.164859 Oct 10 10:56:54.615935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2076/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:54 2022] GET /compute/v2.1/servers/b69e5873-8bb0-495a-80c8-ce1b71859e61 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:56:54.643152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:54.650362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:54.650825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:54.651455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:54.664393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.664894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.669998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.671805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.673204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.675748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.676852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.678453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.691376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:54.694824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:54.699741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:54.700337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:55.087027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:55.097194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:55.106533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:55.107937 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90cc2329-90ff-45fd-8acf-cec04e77449c tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.481714 Oct 10 10:56:55.122835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2077/4054] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:54 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:55.209394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:55.218459 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2adeb0e-aa24-47c8-ae73-ea5a5d7a5a85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.612336 Oct 10 10:56:55.219084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1978/4055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:54 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:56.139480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:56.140121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:56.162847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:56.163513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:56.163976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:56.164729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:56.165198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:56.165632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:56.244464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:56.245681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:56.261647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:56.267648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:56.273023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:56.274195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:56.280975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:56.283438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:56.437457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:56:56.454235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:56.478151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:56.479801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:56.481090 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1f52df6b-9b6d-48d1-9679-ba02c20323b6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.346078 Oct 10 10:56:56.494721 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2078/4056] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:56 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:56.962011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:56.976482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8bd9d99-9f30-4227-961e-3afe0c0703b0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.736232 Oct 10 10:56:56.994734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1979/4057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:56 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:57.521731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:57.522348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:57.531757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:57.543855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:57.544682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:57.546561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:57.549645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:57.550289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:58.004881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:58.005481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:58.032907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:58.033402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:58.033844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:58.034765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:58.037755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:58.038430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:58.073346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:58.098117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:58.111444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:58.115132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ea97e91-4202-452a-b3d1-aaaf43a0fa22 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.597402 Oct 10 10:56:58.115735 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2079/4058] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:57 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:58.506177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:58.514958 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75dc7d69-9308-4087-bbfb-202f388698f2 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 0.513849 Oct 10 10:56:58.539413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1980/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:57 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:56:59.145387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:59.146014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:59.158021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.158531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.163134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:59.164843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.164843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.166861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:59.555485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:59.556102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:59.574555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.580654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.581403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:59.582335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.587171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.595762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:59.721036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:59.738278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:59.744990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:56:59.746202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-793fea81-0d87-4722-8089-d4689f05b883 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.604991 Oct 10 10:56:59.746774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2080/4060] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:56:59 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:56:59.761103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:56:59.789081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:56:59.813774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.817346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.818086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:56:59.819075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:56:59.824516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:56:59.825279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.356988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.370466 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9f85475-ae27-4a30-9c65-546bbe9eeabc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.610395 Oct 10 10:57:01.371230 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2081/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:59 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:01.376701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:01.384189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:01.408590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.409790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.411390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.416367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.416787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.417236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.524750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.533595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d92db248-c76f-4932-b62c-b419bf00bd9d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1523 microversion: 2.1 time: 1.981908 Oct 10 10:57:01.534187 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1981/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:56:59 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1523 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:01.543493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:01.544114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:01.556393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.557125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.558076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.559213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.572156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.573464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.594377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.605993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.607829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.609055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f74bc223-d4bd-4669-a7a1-632cd123b181 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.236697 Oct 10 10:57:01.618210 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2082/4063] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:01 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:01.832457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:01.855591 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41e93730-25ed-490d-8ca6-5862384a2d0b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.317054 Oct 10 10:57:01.856209 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1982/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:01 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:01.881162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:01.881853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:01.900930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.904494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.905717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:01.909519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:01.916674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:01.918071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:02.156747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:02.167317 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-026a364b-d52f-411b-ac53-d96aa1ed3894 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.290328 Oct 10 10:57:02.168645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2083/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:01 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:02.198455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2046881103"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:02.207777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:02.226518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:02.227893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:02.230398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:02.231333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:02.232011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:02.232987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:02.650710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1567912972", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1abc3d43-dcf6-4b42-9cbe-b46120bf45e2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:02.671441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:02.723251 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95df3c65-d572-4a07-960b-5b859708b9ed tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.534635 Oct 10 10:57:02.727373 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2084/4066] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:57:02 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 10 10:57:02.755678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:02.763851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:02.789772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:02.790907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:02.791828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:02.793108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:02.793591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] validate_networks() for [('1abc3d43-dcf6-4b42-9cbe-b46120bf45e2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:57:02.794906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:02.795700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:03.237556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:03.248667 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4988dada-bc79-4f31-89fe-999d8f93a5bb tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1505 microversion: 2.1 time: 0.507004 Oct 10 10:57:03.249293 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2085/4067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:02 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:03.276650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:03.277499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:03.284536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:03.285431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:03.286105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:03.287071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:03.287782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:03.288434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:03.520594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:03.533747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:03.536835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:03.538682 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42f6ca50-2d72-4ca8-a216-5ffc3a451c74 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.278132 Oct 10 10:57:03.539625 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2086/4068] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:03 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:03.941369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:03.941930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:03.942554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:03.943218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:03.944033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:03.962592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:03.963415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:03.964303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:03.967218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:03.967707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:03.969911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.025990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Getting quotas for project b2dfb46972824ec1a52fa4b595b0127a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:04.037301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Getting quotas for user c80a9162990c4720aee23a9132af0fa9 and project b2dfb46972824ec1a52fa4b595b0127a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:04.067153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:04.070214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: dc851e35-4ce6-43c9-8098-65c1d735fa87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:04.205432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=dc851e35-4ce6-43c9-8098-65c1d735fa87,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:04.286011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:04.292165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:04.295935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:04.311021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.312712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.314406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.316731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.318195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.318927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.329263 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41dc9394-3ee4-45fa-a4e1-140ffd2cf86b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.239221 Oct 10 10:57:04.329923 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1983/4069] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:57:04.363531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:04.381018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.381807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Searching by: {'deleted': False, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:57:04.408294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.408789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.409225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.409961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.410413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.410835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.448412 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e917eef-34a9-47f5-bade-d0229fa3030b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.110207 Oct 10 10:57:04.450399 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1984/4070] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:57:04 2022] GET /compute/v2.1/servers => generated 677 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:04.469304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5af2e0c-02d4-4fcd-91c4-23d89ab6f6ed tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:04.469990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5af2e0c-02d4-4fcd-91c4-23d89ab6f6ed tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:04.662916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5af2e0c-02d4-4fcd-91c4-23d89ab6f6ed tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.676506 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5af2e0c-02d4-4fcd-91c4-23d89ab6f6ed tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1220 microversion: 2.1 time: 0.214827 Oct 10 10:57:04.679113 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1985/4071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:04 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1220 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:04.696304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:04.697349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:04.720849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.722366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.724085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.731709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:04.731709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:04.731709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:04.732610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.740612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-78a30978-0519-4de1-b339-a1a0abae6ab9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1505 microversion: 2.1 time: 0.462322 Oct 10 10:57:04.763602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2087/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:04 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:04.943352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.958472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.969384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:04.970938 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee808d8e-4fb7-425e-94ea-d5cb42abf51e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.288026 Oct 10 10:57:04.972538 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1986/4073] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:04 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:05.716090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32037f5e-c955-4afa-832c-4cef2faa3381 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:05.717256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32037f5e-c955-4afa-832c-4cef2faa3381 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:05.766061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:05.767517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:05.810645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:05.811509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:05.813687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:05.819965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:05.822311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:05.824843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:05.834593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-32037f5e-c955-4afa-832c-4cef2faa3381 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:05.851929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32037f5e-c955-4afa-832c-4cef2faa3381 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1220 microversion: 2.1 time: 0.140139 Oct 10 10:57:05.875026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2088/4074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:05 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:06.001449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:06.002538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:06.048577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.049129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.050660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.051630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.057626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.058279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.342110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:06.376521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:06.387875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:06.399226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1d03ea1-74d7-423f-acf9-94203e71627e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.400354 Oct 10 10:57:06.401142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2089/4075] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:05 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:06.414284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:06.428418 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f47f76f-d5b9-40e5-bf04-3b15e7c4255f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 200 len: 1508 microversion: 2.1 time: 0.666529 Oct 10 10:57:06.433596 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1987/4076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:05 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 1508 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:06.460381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:06.461016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:06.470930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c1eb21-579d-4a8d-9a5f-bcc17dd4d181", "name": "network-vif-unplugged", "status": "completed", "tag": "80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:06.489612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.490441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.491584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.503491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.505296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.507081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.511893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.514565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.519132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.532206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_external_events [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] Unable to find a host for instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181. Dropping event network-vif-unplugged {{(pid=128801) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 10:57:06.534825 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-50f31fd0-14cc-4305-b877-2ea102856ef1 req-d6c6a534-845b-4cfe-a80a-3e32c2310aa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069441 Oct 10 10:57:06.539758 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1988/4077] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 10:57:06.617987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:06.642116 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Working on deleting snapshot 5524c9c9-3c33-4ae5-b61b-ff512134386a from shelved instance... Oct 10 10:57:06.890155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:06.891218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:06.912592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.913316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.914457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:06.916730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:06.918901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:06.919852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:07.179550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:07.201071 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc4ab672-70c7-4f96-908e-8d182275073a tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1272 microversion: 2.1 time: 0.313176 Oct 10 10:57:07.208515 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1989/4078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:06 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:07.429029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:07.430105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:07.469743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:07.470244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:07.492130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:07.492973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:07.493391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:07.493823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:07.817015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:07.827823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:07.833347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:07.846289 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3904ea68-6fe7-4fec-9c3f-848daddb799d tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.421134 Oct 10 10:57:07.851667 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1990/4079] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:07 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:08.231164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:08.233564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:08.249941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:08.252730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:08.253962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:08.257757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:08.260806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:08.261909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:08.449182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:08.464186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40ed2bd9-d8a9-47b0-a04e-6b84a1ffb08d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1278 microversion: 2.1 time: 0.237660 Oct 10 10:57:08.480519 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1991/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:08 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:08.500065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Doing local delete in cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128800) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 10 10:57:08.504048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:08.507320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:08.509844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:08.514520 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 10 10:57:08.523260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] deallocate_for_instance() {{(pid=128800) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 10 10:57:08.900684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1409979483", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:09.031638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:09.032312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:09.032945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:09.035105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:09.035689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:09.063999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:09.072600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:09.073072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:09.073868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:09.074898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:09.077011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:09.138514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Getting quotas for project 31252e45826c4806b249ce2fd50581ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:09.161088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Getting quotas for user f3c3ec7cb40d47d3b0a3fd709ddbf926 and project 31252e45826c4806b249ce2fd50581ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:09.206822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:09.209066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:09.341790 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac6fa7f4-5fbc-4e0b-87a8-b04b50fd30c2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.833515 Oct 10 10:57:09.347973 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1992/4081] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 10:57:09.360508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-plugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:09.391703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:09.392214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:09.392609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:09.485068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:09.508732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] Creating event network-vif-plugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:57:09.518844 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-98c6119f-065b-43e4-8bb7-a82fb6342774 req-cb7246e4-6566-437c-83fc-4397941f2a8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165795 Oct 10 10:57:09.524074 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1993/4082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:09.533690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:09.537140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:09.550644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:09.551345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:09.552168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:09.554797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:09.557324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:09.557945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:09.596936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Updating instance_info_cache with network_info: [] {{(pid=128800) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 10:57:09.817392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:09.830084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:09.831965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:09.835881 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19b2727c-489a-4a13-a75a-05ee9ee617f3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.310058 Oct 10 10:57:09.837460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1994/4083] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:09 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:09.868124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:09.869520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:09.905013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:10.094171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:10.118369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:10.120610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:10.122157 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9227f2e-1c41-424e-9903-8e99c761ea57 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 200 len: 1278 microversion: 2.47 time: 0.282556 Oct 10 10:57:10.123134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1995/4084] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:09 2022] GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:10.154598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:10.155632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:10.163345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:10.164832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:10.165648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:10.166546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:10.167735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:10.177925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:10.576070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:10.585544 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f30e5865-0677-4fde-9c1e-2315647a1938 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.461191 Oct 10 10:57:10.591344 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1996/4085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:10 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:10.602463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c1eb21-579d-4a8d-9a5f-bcc17dd4d181", "name": "network-vif-deleted", "tag": "80623ca5-bfd4-4c61-9f0e-04cb3d3eedf9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:10.630101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:10.632447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:10.634611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:10.675581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_external_events [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] Unable to find a host for instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181. Dropping event network-vif-deleted {{(pid=128801) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 10:57:10.676553 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c1f91051-247f-4cf2-9b31-0c5a0ddfe486 req-e13b8093-6aa3-4ba3-ad9f-9b027a789961 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.083772 Oct 10 10:57:10.698799 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1997/4086] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 10:57:10.722043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1548806648", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:10.926562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:10.926992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:10.927491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:10.927912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:10.935272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:11.017779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.018297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.024058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.024931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.025427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.028965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.059697 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6a6f3f5-8995-4cd8-ae3e-c0ee223cbd59 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 204 len: 0 microversion: 2.1 time: 4.606705 Oct 10 10:57:11.070047 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2090/4087] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:06 2022] DELETE /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 0 bytes in 4618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:11.080831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:11.083823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:11.110951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.114693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.116245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.119108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.121084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.123385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.127680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Getting quotas for project 31252e45826c4806b249ce2fd50581ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:11.147728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Getting quotas for user f3c3ec7cb40d47d3b0a3fd709ddbf926 and project 31252e45826c4806b249ce2fd50581ac. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:11.222099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:11.232214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:11.306362 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3ebac07-25eb-41c2-933b-61696649a0a2 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.591295 Oct 10 10:57:11.307611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1998/4088] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 10:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 10:57:11.313663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:11.315683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:11.324780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.326610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.327581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.328809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.329663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.330463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.348824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.372398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.385718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.389424 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b06edec0-909b-4df3-86e5-fdd721e21529 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.317517 Oct 10 10:57:11.390683 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2091/4089] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:11 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:11.396972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-522a46d8-7381-4c40-a717-9662a8ce31da tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:11.397954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 HTTP/1.1 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '24c1eb21-579d-4a8d-9a5f-bcc17dd4d181'} Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:11.400638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:57:11.405252 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:11.407070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-522a46d8-7381-4c40-a717-9662a8ce31da tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:11.411888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:57:11.414025 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd9667e0-5b78-4877-baad-a131be04a9e5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 404 len: 111 microversion: 2.1 time: 0.103992 Oct 10 10:57:11.414622 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1999/4090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:11 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:57:11.586986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-522a46d8-7381-4c40-a717-9662a8ce31da tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "PUT /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 992 microversion: 2.47 time: 0.194872 Oct 10 10:57:11.600510 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2092/4091] 10.222.0.16 () {62 vars in 1297 bytes} [Mon Oct 10 10:57:11 2022] PUT /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 992 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 10:57:11.617002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:11.618177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:11.625416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:11.635042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:11.636972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.643696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.644162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.644923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:11.645395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:11.645836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:11.806012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.814366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.821319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:11.822680 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd9ebf0a-a8c2-40cf-9432-c16515ecc09b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1278 microversion: 2.47 time: 0.201247 Oct 10 10:57:11.839024 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2093/4092] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:11 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:12.062129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:12.074156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4736f74-8951-4237-bfcb-690cdbb7612f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.460978 Oct 10 10:57:12.081449 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2000/4093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:11 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:12.096125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-212032594", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:12.267876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:57:12.420840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:12.421756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:12.428938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:12.432403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:12.433129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:12.434097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:12.435519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:12.436180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:12.666462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:12.707915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:12.709815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:12.719413 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98355e72-0c12-4033-be8b-961d5d564ddf tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.300917 Oct 10 10:57:12.722725 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2001/4094] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:12 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:12.858856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:12.864961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:12.891417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:12.891846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:12.892289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:12.900008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:12.900506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:12.901092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.104535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:13.120784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:13.124123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:13.127759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-412b432b-22c1-4fc2-b11f-294daccc63d6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1330 microversion: 2.47 time: 0.277783 Oct 10 10:57:13.130436 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2002/4095] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:12 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1330 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:13.141954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:13.145320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:13.162167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.164865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.165524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.167782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.171166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.172556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.252163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:13.253615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:13.254430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:13.255280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:13.255945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:13.290688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.291676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.296197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.299526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.300634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.302037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.349610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:13.366969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:13.396162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:13.398824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:13.530431 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6f6746f5-4126-421c-9c69-e4d3b91a71f7 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438629 Oct 10 10:57:13.531128 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2094/4096] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:57:13.544860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4cb79db-9b2f-4c5e-a10c-93e446c4ef81 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:13.546233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4cb79db-9b2f-4c5e-a10c-93e446c4ef81 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:13.565618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:13.575958 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c238a94d-4f27-4d86-8a4e-4bbc47cff26c tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.443514 Oct 10 10:57:13.584693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2003/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:13 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:13.752374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:13.753730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:13.764737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.767447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4cb79db-9b2f-4c5e-a10c-93e446c4ef81 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:13.767816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.768525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.773295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.775897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.776599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.793004 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4cb79db-9b2f-4c5e-a10c-93e446c4ef81 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1214 microversion: 2.1 time: 0.252012 Oct 10 10:57:13.828640 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2095/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:13 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:13.912618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4d2b7c-2671-410d-b6e5-2e63be563530", "tag": "57377e7d-4f6f-4494-88c5-c968e006180e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:13.933055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:13.933536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:13.936571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:13.995856 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] Creating event network-changed:57377e7d-4f6f-4494-88c5-c968e006180e for instance be4d2b7c-2671-410d-b6e5-2e63be563530 on n-h2-860687-2 Oct 10 10:57:14.019670 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e3c0a31e-f196-4d52-8cc1-6a4332f34275 req-d6b062d6-06c6-4f30-8e71-9747c83fac85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104889 Oct 10 10:57:14.023308 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2096/4099] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:14.066263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.082386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.086382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.087885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a97d51c-cbb9-4872-b994-19a0e68f64c1 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.339639 Oct 10 10:57:14.099960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2004/4100] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:13 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:14.161852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:14.162557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:14.200728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.201953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.202403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:14.212946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.213475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.214066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:14.401979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.414949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.422323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:14.423576 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d86f86d5-ee2e-4e4b-bc22-ffd0ee029599 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1336 microversion: 2.47 time: 0.267393 Oct 10 10:57:14.428985 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2097/4101] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:14 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1336 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:14.617065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:14.619595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:14.642435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.643425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.644175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:14.645094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.646566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.647303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:14.826093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:14.828196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:14.850721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.854431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.855574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:14.859733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:14.860725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:14.861438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:15.131336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.145598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-662de6ad-cb4a-48ca-882a-593c28a8a43b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1218 microversion: 2.1 time: 0.329749 Oct 10 10:57:15.156280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2098/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:14 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:15.162392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:15.163461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:15.174926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:15.175939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:15.176594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:15.177544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:15.178464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:15.179293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:15.452634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.468763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a236853-fd09-4d7b-88bf-1ca31ff40b27 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.856475 Oct 10 10:57:15.470726 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2005/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:14 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:15.487736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:15.488587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:15.503299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:15.504002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:15.504623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:15.505476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:15.508225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:15.508837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:15.552212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.583861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.591968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.597195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96526de7-23c6-4aa6-9cb4-6bf9a7ebd42f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.438241 Oct 10 10:57:15.600965 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2099/4104] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:15 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:15.701426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.713589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.719828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:15.721050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4b24489-904a-4e5e-b58b-af4717045ccc tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1336 microversion: 2.47 time: 0.249188 Oct 10 10:57:15.721614 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2006/4105] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:15 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1336 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:16.118410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc851e35-4ce6-43c9-8098-65c1d735fa87", "tag": "036dca56-8291-4c4c-9b95-3d3ee9815c19"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:16.131385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.133397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.134795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.143311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:16.156696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] Creating event network-changed:036dca56-8291-4c4c-9b95-3d3ee9815c19 for instance dc851e35-4ce6-43c9-8098-65c1d735fa87 on n-h1-860687-2 Oct 10 10:57:16.183378 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a1eee6d0-c89a-4794-8f73-08a22c90f628 req-831a6e0a-bd6c-48e5-8d24-843f9289b037 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061881 Oct 10 10:57:16.184226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:16.185470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:16.187671 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2100/4106] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:57:16.214668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.215494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.215956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.216680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.217139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.217563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.463459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:16.479826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b0d0d17-9ad3-4ef8-8e49-6435a723bf15 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1274 microversion: 2.1 time: 0.300029 Oct 10 10:57:16.480446 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2007/4107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:16 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:16.510980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:16.511769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:16.527802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.529984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.530451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.540029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.543655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.544414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.628489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:16.631045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:16.639047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.639689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.640217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.641080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.642112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.642626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.855683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:16.869032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:16.872752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:16.875156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f06e9ec-58cf-4c89-a2db-4a16c7d13c35 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.250807 Oct 10 10:57:16.887103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2008/4108] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:16 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:16.892905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:16.894897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:16.915188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.916386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.917388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.920241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:16.921119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:16.922866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:16.988560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.001742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4224beaf-05f4-4028-a444-163bcc5b3249 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.501887 Oct 10 10:57:17.006112 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2101/4109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:16 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:17.120853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.137227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.141207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.145659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f331bba7-2c2c-4d62-a2bf-a692bcb51777 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1357 microversion: 2.47 time: 0.264804 Oct 10 10:57:17.167835 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2009/4110] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:16 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:17.176683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:17.180151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:17.190003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.190538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.191069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.194092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.194611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.195044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.348283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:17.352819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:17.353615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:17.354741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:17.355490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:17.357653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:17.510008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:17.510564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:17.511380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:17.525726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.526236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.526675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.527433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.527924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.528970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.535800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.536231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.536675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.537391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.537857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.538288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.644118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff1bbc5d-5261-4a03-bfc4-a5dafe5ef31f tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "POST /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39/action" status: 202 len: 1079 microversion: 2.47 time: 0.471431 Oct 10 10:57:17.648246 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2102/4111] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 10:57:17 2022] POST /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39/action => generated 1079 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 10:57:17.671791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:17.672999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:17.690747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.691519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.692382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.693227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.694677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.695252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.796595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.813979 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e0df2b3-65ae-4081-b11e-f52c8b7548a0 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1272 microversion: 2.1 time: 0.305200 Oct 10 10:57:17.819126 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2010/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:17 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:17.907253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:17.908184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:17.922421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.937487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.937739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.938092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.939033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:17.939666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:17.940278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:17.954158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.957817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:17.961072 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04dea8ad-f821-45fc-9120-7127b4389dfd tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.294748 Oct 10 10:57:17.965985 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2103/4113] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:17 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:18.029997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:18.031392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:18.047046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:18.050421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:18.051946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:18.053533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:18.057242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:18.060811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:18.271660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:18.287152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:18.289010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:18.297245 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-faa7f687-ad09-4200-af1c-14fad14d5f65 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.394731 Oct 10 10:57:18.303952 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2011/4114] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:17 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:18.566428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:18.592132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6edddf62-488e-4cc1-a9da-403dbdd27668 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.568584 Oct 10 10:57:18.622163 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2104/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:18 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:18.856870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:18.860867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:18.883728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:18.884668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:18.885369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:18.886406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:18.887119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:18.888862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:18.999976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:19.001226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:19.019970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.020668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.021123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.022323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.032635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.033226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.315469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.324480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.338873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.349480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.350455 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8184b08a-8c09-430d-b43b-85c237dfcfab tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.504462 Oct 10 10:57:19.351746 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2012/4116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:18 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:19.354717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5dfff7d0-b519-49c0-8ca0-d52aab1a5a20 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.359536 Oct 10 10:57:19.362213 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2105/4117] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:18 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:19.387061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:19.397039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:19.434349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.437995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.440748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.442175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.444829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.445496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.570134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.583661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.585697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:19.587733 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f548195-f7e6-4676-8c84-c592a28981d6 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.223657 Oct 10 10:57:19.588497 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2106/4118] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:19 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:19.646204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:19.647118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:19.661050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.661784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.664500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.695348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:19.696174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:19.696771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:19.778532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:20.026837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.039229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ae264fb-d868-46db-80c2-ea6520a4a469 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.396761 Oct 10 10:57:20.040859 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2013/4119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:19 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:20.380984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:20.382187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:20.391036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:20.393051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:20.395659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.396239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.405691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.407717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.408500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.408991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.409526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.413299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.414872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.419690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.419854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.420136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.576350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.585516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.586984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.596388 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b67fb0a-0ba1-4f30-953f-4bda1db6f995 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.212477 Oct 10 10:57:20.598153 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2014/4120] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:20 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:20.623039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:20.627124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:20.661163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.668995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.669987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.674367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:20.675100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:20.676477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:20.929528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.940474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.943414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.948045 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f5e0157-80df-4ad1-af4d-de7fcbf9a7f7 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1408 microversion: 2.54 time: 0.331476 Oct 10 10:57:20.951900 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2015/4121] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:20 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:20.975158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:20.987224 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b91df67e-0201-4454-8abb-32d4fce9ecd1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.610308 Oct 10 10:57:20.991625 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2107/4122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:20 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:21.068200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:21.068992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:21.070967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:21.086902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:21.092653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:21.098442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:21.099432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:21.102328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:21.103108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:21.183292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:21.440069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:21.450883 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69f877e5-8c14-487a-84a8-bd28d5e488f3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 0.385878 Oct 10 10:57:21.452312 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2016/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:21 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:21.631608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:21.633023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:21.658209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:21.660476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:21.664390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:21.667328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:21.669304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:21.672290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:21.832879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:21.855557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:21.857390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:21.861075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6eb8c5e1-d587-4676-aa9c-236ceec1e8d7 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.234891 Oct 10 10:57:21.865946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2108/4124] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:21 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:21.976113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:21.977656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:21.990586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:21.993760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:21.995521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:21.998370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.000234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.003856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.016734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:22.017655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:22.030781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.038159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.039905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.042353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.044649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.045359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.290762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:22.319688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:22.321725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:22.324881 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07bd6d8b-2206-4433-8e22-caa8c7cdb13b tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1414 microversion: 2.54 time: 0.353270 Oct 10 10:57:22.326993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2017/4125] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:21 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1414 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:22.474751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:22.479634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:22.501182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.501683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.511587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.513346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.521387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.522815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.717441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:22.728112 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-057cc548-48dd-4571-9ff3-d9db8064ead9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.715985 Oct 10 10:57:22.729484 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2109/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:22 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:22.897205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:22.898016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:22.909258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.912254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.916104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:22.916980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:22.917472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:22.922194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.100273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.111819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.125468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.127090 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63fdc490-a731-45ba-9720-f969ccefff2d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.236706 Oct 10 10:57:23.127833 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2110/4127] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:22 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:23.154215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d2b7c-2671-410d-b6e5-2e63be563530", "name": "network-vif-plugged", "status": "completed", "tag": "57377e7d-4f6f-4494-88c5-c968e006180e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:23.175128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.175614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.176054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.196481 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] Creating event network-vif-plugged:57377e7d-4f6f-4494-88c5-c968e006180e for instance be4d2b7c-2671-410d-b6e5-2e63be563530 on n-h2-860687-2 Oct 10 10:57:23.211465 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e839111f-802b-49e4-b96c-36de242bd13a req-733d28a3-22ec-4670-ae55-5fd17952f78a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063116 Oct 10 10:57:23.212094 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2111/4128] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:57:23.350493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:23.368927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:23.371350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:23.395045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.395547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.398587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.399459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.399886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.400329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.780709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.791945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:23.800529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.803568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.804986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bddd14e1-8805-46bb-8249-e1e24d2a5142 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1414 microversion: 2.54 time: 0.455847 Oct 10 10:57:23.806588 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2112/4129] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:23 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1414 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:23.826739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:23.829334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:23.866815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.868230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.869788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.872894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.874286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.878347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.901369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:23.913250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a5dbd22-c3e6-4093-967d-e3169468950f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 1.442370 Oct 10 10:57:23.919925 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2018/4130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:22 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:23.927170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021be33c-ce1d-4a4a-b57e-504bfe18e7aa", "tag": "2d940094-96d0-40d0-995e-7a3596bddcb2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:23.955622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:23.956371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:23.956964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:23.986256 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] Creating event network-changed:2d940094-96d0-40d0-995e-7a3596bddcb2 for instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa on n-h1-860687-2 Oct 10 10:57:23.992765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2c885a8d-3f20-4327-94cc-e5c78f189cf0 req-5183a093-5c57-44a9-9b22-901f1bde73ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071375 Oct 10 10:57:24.006836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2019/4131] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:24.158143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:24.158858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:24.174314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.178051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.178724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:24.187464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.188308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.189664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:24.257851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:24.277308 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26088ce2-7741-40a0-a84c-d80c268c24ea tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.469144 Oct 10 10:57:24.281958 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2113/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:23 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:24.352691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:24.370400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:24.383867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:24.387699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6017d3e-7ab3-4091-a379-feb4a7cf6658 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.233371 Oct 10 10:57:24.393370 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2020/4133] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:24 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:24.838900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:24.839562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:24.860733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.861494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.862097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:24.865230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.866893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.874764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:24.946679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:24.947437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:24.966182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.973582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.974383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:24.975551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:24.976556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:24.977180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.131473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.161156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.165647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.167462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9655348a-6b00-4a68-8285-b6715e3a0763 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1399 microversion: 2.54 time: 1.335397 Oct 10 10:57:26.168669 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2114/4134] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:24 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1399 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:26.174887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc851e35-4ce6-43c9-8098-65c1d735fa87", "name": "network-vif-plugged", "status": "completed", "tag": "036dca56-8291-4c4c-9b95-3d3ee9815c19"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:26.193595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.196399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.196980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.197554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.205431 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54717d59-1b0d-492c-a756-ca6c4ac8d009 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1320 microversion: 2.1 time: 1.263118 Oct 10 10:57:26.206362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2021/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:24 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1320 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:26.213185 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] Creating event network-vif-plugged:036dca56-8291-4c4c-9b95-3d3ee9815c19 for instance dc851e35-4ce6-43c9-8098-65c1d735fa87 on n-h1-860687-2 Oct 10 10:57:26.217016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:26.218025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:26.221967 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-17ba2402-ab7d-4b3a-ad51-733b726e0262 req-2fcb846e-2933-4fed-9f0f-fa5468ce8403 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051360 Oct 10 10:57:26.225982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.226882 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2115/4136] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:26.227123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.227755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.228675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.229632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.230268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.232959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:26.233741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:26.242672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.243306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.243813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.244590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.245535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.246132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.427839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.438871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:26.445252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.447655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.449147 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-554f9a94-98af-4433-b419-bbff4cb4c5b6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.220889 Oct 10 10:57:26.464221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2116/4137] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:26 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:26.477946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8db031d4-1892-4ce3-86fd-fa8d4eaa0526 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '.version_select at 0x7f6777788f70>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:26.508200 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8db031d4-1892-4ce3-86fd-fa8d4eaa0526 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-518477253" status: 204 len: 0 microversion: 2.54 time: 0.035973 Oct 10 10:57:26.509116 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2117/4138] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 10:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-518477253 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:57:26.522842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:26.523407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:26.532623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.533407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.534561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.535492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.536302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.537500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.586331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:26.611477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.630562 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5a77bed-08e2-4ffc-8a1b-e354bea3cf56 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.422424 Oct 10 10:57:26.631263 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2022/4139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:26 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:26.772487 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42246cb5-2a03-4c11-b62d-fc32da7b232f tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 204 len: 0 microversion: 2.54 time: 0.254929 Oct 10 10:57:26.774688 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2118/4140] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:57:26 2022] DELETE /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 10:57:26.786985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:26.787696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:26.805000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.805798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.808404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.809859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:26.812241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:26.812851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:26.973127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.985505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.986969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:26.988196 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9abddad6-6b7e-4bfa-9da0-6b6ce06990a3 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1405 microversion: 2.54 time: 0.207708 Oct 10 10:57:26.988775 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2023/4141] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:26 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:27.234052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:27.235164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:27.249260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.255602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.257447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.258332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.259741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.265901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.478465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:27.479209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:27.494384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.496252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.498141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.499811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.500982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.501790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.683514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:27.688081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:27.696407 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fa21912e-3b05-4d85-b041-b24ad1ceba99 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 200 len: 1509 microversion: 2.1 time: 0.466882 Oct 10 10:57:27.697778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:27.698897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2119/4142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:27 2022] GET /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:27.709120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:27.717398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a791e999-0526-41a0-acac-12f43158a0f6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.243465 Oct 10 10:57:27.721413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:27.722719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2024/4143] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:27 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:27.724630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:27.730030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:27.732658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.733107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: dc851e35-4ce6-43c9-8098-65c1d735fa87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:27.734283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.734938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.735876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.736497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.737214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.744447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.746011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.747114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:27.754476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:27.756497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:27.757030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:28.124103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:28.134733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e583531e-5936-4283-8b4b-f0f46df3e288 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87" status: 200 len: 1320 microversion: 2.1 time: 0.408726 Oct 10 10:57:28.149231 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2025/4144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:27 2022] GET /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:28.167683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:28.173326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:28.197032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:28.198012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:28.201166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:28.202183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:28.205238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:28.205867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:28.256792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:28.270921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e08fbfc-3819-480d-97df-51df71d6e5fa tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.570336 Oct 10 10:57:28.273190 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2120/4145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:27 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:28.383073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:28.395252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:28.400621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:28.404534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d8808c0-04ce-4910-8eb8-4ab7f1d16f78 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1405 microversion: 2.54 time: 0.253153 Oct 10 10:57:28.406950 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2026/4146] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:28 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:28.759685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:28.760675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:28.778479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:28.795738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:28.798901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:28.802669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:28.804655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:28.812812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.016723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.029459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.033354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.038849 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-20609077-a7cc-4b99-bfd8-c18e4d58a62a tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.287228 Oct 10 10:57:29.040718 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2121/4147] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:28 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:29.164286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:29.165577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: dc851e35-4ce6-43c9-8098-65c1d735fa87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:29.180702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.181273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.181826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.182931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.199458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.201042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.296428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:29.297148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:29.314295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.315199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.320918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.322754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.324246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.326732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.607718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.625616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef3927d4-ee4e-46be-833b-7765ef42966b tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87" status: 200 len: 1508 microversion: 2.1 time: 0.465449 Oct 10 10:57:29.626203 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2027/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:29 2022] GET /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87 => generated 1508 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:29.634219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.634912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:29.635867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:29.642668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-edb1c85c-bd0b-44e6-a80a-d0765c6aade1 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.350085 Oct 10 10:57:29.650484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.650982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.651441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.652903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.653397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.653860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.655114 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2122/4149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:29 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:29.665731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:29.666247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: dc851e35-4ce6-43c9-8098-65c1d735fa87] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:29.681465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.687392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.687913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.690981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.693388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.694036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.710358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:29.711308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:29.711917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:29.712576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lazy-loading 'fault' on Instance uuid 7d69aeaa-90b4-4dde-8734-977a87d1ccbd {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:57:29.756522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: dc851e35-4ce6-43c9-8098-65c1d735fa87] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:29.793121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.806267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.809268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c24e73c233d5466a984ae3232f596c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0298add60e54b3f8241393675926394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:29.811615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7e3155e-5a08-4940-b2cb-a4667d7f3c0e tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 200 len: 1410 microversion: 2.54 time: 0.184268 Oct 10 10:57:29.817652 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2028/4150] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:29 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 1410 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:29.984535 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6064efc7-4273-41ea-9a96-7aa7ac485d68 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87" status: 204 len: 0 microversion: 2.1 time: 0.327731 Oct 10 10:57:29.985515 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2123/4151] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:29 2022] DELETE /compute/v2.1/servers/dc851e35-4ce6-43c9-8098-65c1d735fa87 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:29.995633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:29.996574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:30.006382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.007932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.009402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.010761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.012501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.013285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.028222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:30.029233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:30.036969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.037839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.038511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.039799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.040470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.041126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.106569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: be4d2b7c-2671-410d-b6e5-2e63be563530] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:30.154704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:30.203096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lazy-loading 'services' on Instance uuid aaf851f2-4eb0-4c93-a632-3a8523e0255a {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:57:30.249039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6be791f9-6438-44e4-86b1-ae242f3cdcb3 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530" status: 204 len: 0 microversion: 2.1 time: 0.258503 Oct 10 10:57:30.250178 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2029/4152] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:29 2022] DELETE /compute/v2.1/servers/be4d2b7c-2671-410d-b6e5-2e63be563530 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:30.256039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:30.258334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:30.265296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.266570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.267367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.269370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.270025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.270650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.348986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3297a66-2848-47b3-bb13-58476ebb69dc tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a/os-volume_attachments/d1975264-8102-4ce0-a2de-6d87cced2d68" status: 202 len: 0 microversion: 2.1 time: 0.327335 Oct 10 10:57:30.349855 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2124/4153] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:57:30 2022] DELETE /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a/os-volume_attachments/d1975264-8102-4ce0-a2de-6d87cced2d68 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:57:30.382909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021be33c-ce1d-4a4a-b57e-504bfe18e7aa", "name": "network-vif-plugged", "status": "completed", "tag": "2d940094-96d0-40d0-995e-7a3596bddcb2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:30.419737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.420314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.420821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.458617 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] Creating event network-vif-plugged:2d940094-96d0-40d0-995e-7a3596bddcb2 for instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa on n-h1-860687-2 Oct 10 10:57:30.467684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:30.483911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:30.499875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:30.500111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ce618501-a4a3-463e-9269-1774e7608111 req-d83c7b82-8c36-460a-8c3f-1d340581722b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134005 Oct 10 10:57:30.500758 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2125/4154] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:30.502251 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-686e712b-ab05-46b8-951b-d564b26a8a31 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.250606 Oct 10 10:57:30.515356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2030/4155] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:30 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:30.666314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:30.667354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:30.677692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.680764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.681581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.683580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.687292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.687972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.719499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-296489651", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1abc3d43-dcf6-4b42-9cbe-b46120bf45e2"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:30.773956 n-d-860687-2 devstack@n-api.service[128800]: Exception ignored in: . at 0x7f67779deaf0> Oct 10 10:57:30.773956 n-d-860687-2 devstack@n-api.service[128800]: Traceback (most recent call last): Oct 10 10:57:30.773956 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 10 10:57:30.778457 n-d-860687-2 devstack@n-api.service[128800]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 10 10:57:30.778457 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 10 10:57:30.779159 n-d-860687-2 devstack@n-api.service[128800]: connection_record.checkin() Oct 10 10:57:30.779159 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 10 10:57:30.779616 n-d-860687-2 devstack@n-api.service[128800]: pool.dispatch.checkin(connection, self) Oct 10 10:57:30.779616 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 10 10:57:30.782766 n-d-860687-2 devstack@n-api.service[128800]: fn(*args, **kw) Oct 10 10:57:30.782766 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 10 10:57:30.789213 n-d-860687-2 devstack@n-api.service[128800]: time.sleep(0) Oct 10 10:57:30.789213 n-d-860687-2 devstack@n-api.service[128800]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 10 10:57:30.791974 n-d-860687-2 devstack@n-api.service[128800]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 10 10:57:30.791974 n-d-860687-2 devstack@n-api.service[128800]: AssertionError: do not call blocking functions from the mainloop Oct 10 10:57:30.829246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] validate_networks() for [('1abc3d43-dcf6-4b42-9cbe-b46120bf45e2', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:57:30.923761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:30.934739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab35cb36-6f79-40e1-98f9-b8f54b879874 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.272657 Oct 10 10:57:30.935360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2031/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:30 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:30.954967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:30.955765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] [instance: 7d69aeaa-90b4-4dde-8734-977a87d1ccbd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:30.972869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.973385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.974417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.975861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:30.976344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:30.977801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:30.998646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] HTTP exception thrown: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Request method failure captured: Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd HTTP/1.1 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_ptvXrX8TlYcjriqPobCv2Rk_h8IydcQkhy8wDDywgkOFAXAAeMgX3VputujH6ohu0w4mW4rcaBOCSjIvgOp4mNjFJ9IMlirR0ixReCu9xWAszWxqeRz2ZreR-8aPBnYO7BA54DdYedzx_JF2mNAmnW5iu7zedG2x01-3DCwZea_K8 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.54 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e0298add60e54b3f8241393675926394 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerShowV254Test-793192124 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0298add60e54b3f8241393675926394"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0298add60e54b3f8241393675926394", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0298add60e54b3f8241393675926394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0298add60e54b3f8241393675926394"}]}] Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerShowV254Test-793192124 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e0298add60e54b3f8241393675926394 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerShowV254Test-793192124 Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerShowV254Test-793192124-project Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c24e73c233d5466a984ae3232f596c2b Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerShowV254Test-793192124-project Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7d69aeaa-90b4-4dde-8734-977a87d1ccbd'} Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:31.001841 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. Oct 10 10:57:31.009084 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:31.013519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] Returning 404 to user: Instance 7d69aeaa-90b4-4dde-8734-977a87d1ccbd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:57:31.014615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bc36624-cf7b-4523-b9c5-d9a8fdc5d6f0 tempest-ServerShowV254Test-793192124 tempest-ServerShowV254Test-793192124-project] 10.222.0.16 "GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd" status: 404 len: 111 microversion: 2.54 time: 0.076279 Oct 10 10:57:31.015737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2032/4157] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:30 2022] GET /compute/v2.1/servers/7d69aeaa-90b4-4dde-8734-977a87d1ccbd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:57:31.482259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:31.484520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:31.485197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:31.485826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:31.486687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:31.499945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.500778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.501385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.502856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.503523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.504139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.534179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:31.535204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:31.544544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Getting quotas for project b2dfb46972824ec1a52fa4b595b0127a. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:31.550581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.552142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.552938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.553994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Getting quotas for user c80a9162990c4720aee23a9132af0fa9 and project b2dfb46972824ec1a52fa4b595b0127a. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:31.556409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.557018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.559403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.574137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Going to run 2 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:31.577907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:31.631814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=49e83b31-6293-445d-b5ec-7a5276efd5a7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:31.752830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:31.797111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:31.801379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:31.812798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4fa57c29-c008-4c53-af8c-205f85b82b61 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.098006 Oct 10 10:57:31.813441 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2126/4158] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:57:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 10 10:57:31.814242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e88b59e-b391-4495-8a56-c6cd8e0dcf21 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.282677 Oct 10 10:57:31.814854 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2033/4159] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:31 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:31.875378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:31.906962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:31.911202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Searching by: {'deleted': False, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:57:31.918067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:31.962694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:31.963348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:31.978531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.979046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.979167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.979496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.979611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.980052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.980223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.981350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:31.989578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:31.991904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:31.997957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:32.001886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:32.070597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:57:32.182462 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca4ccb1d-706b-4cbf-926c-559e84800317 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.331967 Oct 10 10:57:32.199197 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2034/4160] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 10:57:31 2022] GET /compute/v2.1/servers => generated 1335 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:32.210415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75c3c8a5-fe13-400f-a6ef-00c314077494 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:32.226431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75c3c8a5-fe13-400f-a6ef-00c314077494 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:32.439650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75c3c8a5-fe13-400f-a6ef-00c314077494 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:32.450702 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75c3c8a5-fe13-400f-a6ef-00c314077494 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1217 microversion: 2.1 time: 0.242965 Oct 10 10:57:32.452174 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2035/4161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:32 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:32.548810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:32.560595 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4cae2f5-ba43-458e-b517-4d1a12ab7a2e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.602381 Oct 10 10:57:32.562913 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2127/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:31 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:32.853151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:32.854691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:32.874212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:32.877129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:32.877751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:32.881611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:32.882546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:32.883834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:33.211323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:33.231083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:33.235422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:33.243922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83fa9b37-c927-42d3-83f8-f2f45a65276d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.396417 Oct 10 10:57:33.245551 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2036/4163] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:32 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:33.485801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8917185f-98e5-4ce3-b227-4390e87d5825 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:33.491279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8917185f-98e5-4ce3-b227-4390e87d5825 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:33.595335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:33.595960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:33.612979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:33.619382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:33.620112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:33.621074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:33.621812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:33.622401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:33.662839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8917185f-98e5-4ce3-b227-4390e87d5825 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:33.674395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8917185f-98e5-4ce3-b227-4390e87d5825 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1217 microversion: 2.1 time: 0.198837 Oct 10 10:57:33.677747 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2128/4164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:33 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:34.086891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:34.122592 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2708ee38-f93a-4e0d-a069-1b7d13bbbd32 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1314 microversion: 2.1 time: 0.529253 Oct 10 10:57:34.159230 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2037/4165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:33 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:34.282415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:34.285721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:34.305651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d2b7c-2671-410d-b6e5-2e63be563530", "name": "network-vif-deleted", "tag": "57377e7d-4f6f-4494-88c5-c968e006180e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:34.313415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:34.315657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:34.320779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:34.325056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:34.330497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:34.332175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:34.334451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:34.339540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:34.345599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:34.403184 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] Creating event network-vif-deleted:57377e7d-4f6f-4494-88c5-c968e006180e for instance be4d2b7c-2671-410d-b6e5-2e63be563530 on n-h2-860687-2 Oct 10 10:57:34.425418 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-41fffc89-3374-44c1-bef6-48c5e0d2f510 req-ee4d9f49-d81c-4655-913d-d90982e79209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126436 Oct 10 10:57:34.430588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2038/4166] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:57:34.650427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:34.661308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:34.679737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:34.680964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3c2a9e9-309c-435c-895c-e4526e438006 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.408018 Oct 10 10:57:34.681572 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2129/4167] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:34 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:34.723453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:34.724304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:34.746270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:34.749158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:34.749628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:34.750367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:34.755727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:34.761587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:34.977540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:34.993828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c52e476f-1122-4dbc-a630-fabc8652bf58 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1269 microversion: 2.1 time: 0.292311 Oct 10 10:57:35.000294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2039/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:34 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1269 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:35.149886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:35.150693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:35.193046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:35.194158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:35.196128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:35.201103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:35.211271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:35.213023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:35.588656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:35.602305 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92af509a-d7ac-4eb6-bafa-bd76436d5db9 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1501 microversion: 2.1 time: 0.456417 Oct 10 10:57:35.604849 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2130/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:35 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1501 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:35.631516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:35.643339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:35.645402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:35.646049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:35.710541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:35.711210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:35.729262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:35.729774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:35.754351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:35.759928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:35.760431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:35.760875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:35.827399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 10:57:35.962029 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1e183e7-54d6-4f3a-911a-6c861996c88d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa/action" status: 202 len: 0 microversion: 2.1 time: 0.335560 Oct 10 10:57:35.986753 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2040/4170] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:57:35 2022] POST /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:57:36.012710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:36.013682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:36.030174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:36.030822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:36.048131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:36.054436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:36.055227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:36.055570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:36.148496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:36.166193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:36.169105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:36.178462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a5f07a4-1422-4d35-9fa4-72423705a8be tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.472505 Oct 10 10:57:36.184712 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2131/4171] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:35 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:36.194781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:36.195679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:36.222637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:36.223450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:36.225300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:36.227097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:36.227737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:36.228325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:36.767116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:36.770382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:36.784654 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28430089-2453-4d9c-8e2d-ce7cdec80e38 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1287 microversion: 2.1 time: 0.598511 Oct 10 10:57:36.787319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2132/4172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:36 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1287 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:36.793938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc851e35-4ce6-43c9-8098-65c1d735fa87", "name": "network-vif-deleted", "tag": "036dca56-8291-4c4c-9b95-3d3ee9815c19"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:36.834015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:36.834506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:36.834941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:36.862332 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] Creating event network-vif-deleted:036dca56-8291-4c4c-9b95-3d3ee9815c19 for instance dc851e35-4ce6-43c9-8098-65c1d735fa87 on n-h1-860687-2 Oct 10 10:57:36.874906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-cffb7173-754c-4791-a4bc-3e3d053d1596 req-77860b18-1720-496d-9e52-05d1d65ea852 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086046 Oct 10 10:57:36.878520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2133/4173] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:36.976653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:36.987801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-893e47a5-b087-47f7-95d1-1db83abdc048 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.997652 Oct 10 10:57:36.996370 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2041/4174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:35 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:37.218894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:37.220357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:37.223294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:37.239406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:37.243706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:37.244642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:37.247504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:37.249383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:37.251232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:37.809322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:37.810194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:37.821751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:37.822457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:37.823103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:37.825738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:37.827897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:37.828518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:37.910558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:37.929280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:37.938171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:37.942414 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b5bd7a7-26d0-4348-aa06-d7e7e893757c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.727045 Oct 10 10:57:37.955023 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2134/4175] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:37 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:38.012731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:38.013429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:38.023950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:38.024798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:38.027684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:38.028779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:38.029253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:38.029686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:38.861268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:38.868412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:38.886045 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c4d4eeb-f969-430e-88f7-2a2b59487173 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 1.076001 Oct 10 10:57:38.890117 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2042/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:37 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:38.915689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54b945ed-7673-44dc-bb87-fd419cb82d65 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.907710 Oct 10 10:57:38.925067 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2135/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:38 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:38.976334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:38.977197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:39.004091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.008690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.010372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:39.015157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.015939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.019223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:39.284804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:39.304775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:39.310386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:39.314375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7965f82-5dc3-496d-a30e-9a9416436242 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.346032 Oct 10 10:57:39.317092 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2043/4178] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:38 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:39.917002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:39.917728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:39.927972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.928723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.929759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:39.930873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.931449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.932748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:39.950743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:39.960416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:39.976692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.978105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.978796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:39.983817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:39.984627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:39.990664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:40.434971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:40.443327 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-837acb2e-3c05-49bc-9add-482120b80455 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.530317 Oct 10 10:57:40.448470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2136/4179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:39 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:40.453489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e83b31-6293-445d-b5ec-7a5276efd5a7", "tag": "c54f4ec7-5ef4-4b5b-934c-e7b52e44499a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:40.502687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:40.503580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:40.506192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:40.533041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:40.541187 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] Creating event network-changed:c54f4ec7-5ef4-4b5b-934c-e7b52e44499a for instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 on n-h2-860687-2 Oct 10 10:57:40.555555 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0aa7876f-89eb-4a26-be82-2bb3f2fb670d req-7717f488-0448-4234-bac3-01abffd79fd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105494 Oct 10 10:57:40.560538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2137/4180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:40.561376 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e16f9608-5b17-4e39-8797-96fc4aa44e07 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.614364 Oct 10 10:57:40.565419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2044/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:39 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:40.582778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:40.585456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:40.586437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:40.588055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:40.600725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:40.601868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:40.603456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:40.605465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:40.606858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:40.608039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:40.608634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:40.609141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:40.609587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:40.610309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:40.610827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:40.611391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.015652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:41.027641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:41.037173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:41.039785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23bed6ea-5ec7-4215-8571-c3493d006a06 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.472703 Oct 10 10:57:41.064808 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2045/4182] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:40 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:41.308819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:41.321489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fb90350-a079-4b0c-a8c8-65467791ab79 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.757615 Oct 10 10:57:41.324717 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2138/4183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:40 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:41.349089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1949235788"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:41.351868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:41.371885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:41.372984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:41.373604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.382879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:41.384123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:41.384748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.530216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:41.570520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06a493b-5911-4919-b405-62c68e243e8b", "tag": "5e7e7ce1-da97-41d7-8d18-f537b0a6fc05"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:41.592437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:41.594329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:41.597320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.625672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] Creating event network-changed:5e7e7ce1-da97-41d7-8d18-f537b0a6fc05 for instance b06a493b-5911-4919-b405-62c68e243e8b on n-h2-860687-2 Oct 10 10:57:41.646103 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6884e527-e246-42be-a61f-c377fb887e40 req-a16f1f42-725b-44bb-ab18-16123b1bfae8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577648 Oct 10 10:57:41.649214 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2046/4184] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:41.668910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:41.670971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:41.691949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:41.702956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:41.706672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.712577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:41.713382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:41.714369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:41.825352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:41.934731 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d66f04cc-dc79-4d74-8f7c-3cfdaf8a2c5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.589155 Oct 10 10:57:41.941302 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2139/4185] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:57:41 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 10 10:57:41.972487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:41.973577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:42.004209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:42.007258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:42.010027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:42.011113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:42.013398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:42.014098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:42.026039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:42.157217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:42.168881 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cbad6e5-f23e-49bf-ad96-8289a0333feb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.518422 Oct 10 10:57:42.170909 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2047/4186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:41 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:42.194845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:42.195783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:42.211983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:42.225202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:42.225984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:42.228536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:42.229034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:42.229468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:42.331300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:42.345582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:42.347049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:42.348638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c9300e4-8733-4f58-897a-d95026d08d8b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.176729 Oct 10 10:57:42.349347 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2048/4187] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:42 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:42.358757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:42.373148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7db4c3c-ea45-4b72-816d-8d1b43ae92c4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.427346 Oct 10 10:57:42.375427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2140/4188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:41 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:43.196979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:43.197653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:43.203406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:43.222509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.236353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.236997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.237959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.238440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.238874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.362008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:43.363638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:43.375990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.378672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.379547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.380861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.382357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.383785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.448768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:43.612220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c43d3e6-74c9-4371-8fc0-e70a1f7cc88c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 204 len: 0 microversion: 2.1 time: 0.255599 Oct 10 10:57:43.619315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2141/4189] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:43 2022] DELETE /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:43.643184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:43.646815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:43.662484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.663440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.665752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.666900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.668918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.669729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.738534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:43.762705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:43.774458 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89030e45-6f2c-4751-90bb-e719ca486167 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.581348 Oct 10 10:57:43.788067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2049/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:43 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:43.806692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:43.808036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:43.825828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.826504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.827503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.830763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.831436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.832021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.930884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:43.944564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:43.947360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:43.950173 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fa9964e0-008e-434d-a47b-9fb57d1cc569 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1366 microversion: 2.47 time: 0.329284 Oct 10 10:57:43.952694 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2142/4191] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:43 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:43.957638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:43.958377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:43.968667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.969339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.976917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:43.978991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:43.983766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:43.985707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:44.325554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:44.333894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db204fce-8237-495e-9e85-812b8e817d85 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.538560 Oct 10 10:57:44.354093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2050/4192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:43 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:44.455358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:44.465628 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5bed9d24-ea5a-4af1-b901-a61480b216eb tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1513 microversion: 2.1 time: 0.511455 Oct 10 10:57:44.470086 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2143/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:43 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:44.502724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-unplugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:44.518231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:44.521615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:44.522358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:44.560828 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] Creating event network-vif-unplugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:57:44.568723 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cf61aa45-882c-41fc-a8be-f4860a3d90a8 req-6037aecf-0334-490b-ad8f-1bd271d26429 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069537 Oct 10 10:57:44.569877 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2051/4194] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:44.798328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:44.799482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:44.808990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:44.814388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:44.815135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:44.816164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:44.816827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:44.819259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:44.979397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:44.980683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:44.998619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:45.007219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:45.010809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:45.012581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:45.018545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:45.020621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:45.763810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:45.785716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:45.790324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:45.797693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03664fa0-bc85-417d-aa38-097ba32bed47 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1384 microversion: 2.47 time: 0.821468 Oct 10 10:57:45.800544 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2052/4195] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:44 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1384 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:45.823486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:45.825110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:45.838287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:45.838789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:45.842488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:45.843448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:45.846473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:45.847444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:46.023535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:46.043534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d62204d0-9818-4938-9dbb-113e9d12aab5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 1.247947 Oct 10 10:57:46.044685 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2144/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:44 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:46.052695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:46.053715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:46.067153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:46.079081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:46.080946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:46.083719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:46.084467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:46.085110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:46.690390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:46.710234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9b3945b-8f3b-4dfa-806e-b48327373e3d tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 200 len: 1471 microversion: 2.1 time: 0.662822 Oct 10 10:57:46.711900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2145/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:46 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:46.731877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf851f2-4eb0-4c93-a632-3a8523e0255a", "name": "network-vif-deleted", "tag": "1d4bd02c-46e9-47e0-9c39-be73a90df529"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:46.793470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:46.794870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:46.795507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:46.809275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:46.821848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30d8366b-ad3e-4453-95fa-98b8975b9628 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 1.019865 Oct 10 10:57:46.828646 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2053/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:45 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:46.853543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:46.853962 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] Creating event network-vif-deleted:1d4bd02c-46e9-47e0-9c39-be73a90df529 for instance aaf851f2-4eb0-4c93-a632-3a8523e0255a on n-h1-860687-2 Oct 10 10:57:46.859119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:46.860227 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-493d56a1-153f-4344-a5a0-bfd35f5cdef6 req-b0677c3f-7c88-41ab-9397-3c629a9d4628 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145308 Oct 10 10:57:46.861234 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2146/4199] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:46.875415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:46.876943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:46.877596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:46.878547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:46.879368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:46.880507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.072666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:47.077162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:47.108142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.111642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.126668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.133732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.136635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.137095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.359158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:47.374202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:47.378657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:47.379938 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed239928-d40e-47f2-aced-ade51922f32b tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1372 microversion: 2.47 time: 0.547362 Oct 10 10:57:47.380502 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2054/4200] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:46 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1372 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:47.736691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:47.737613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: aaf851f2-4eb0-4c93-a632-3a8523e0255a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:47.755360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.755864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.757396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.758151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.763555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.766074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.819698 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] HTTP exception thrown: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Request method failure captured: Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a HTTP/1.1 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_nF6EvgheFYjwVFuTCzZF9Xa437oZUR_aP6RTnzhhkOs1St6NTiodLV3nD_M3ov5kgXMuaZ1OYKpHDSNMqoeGhQsL11eONTcekBBfDa6iTkm2aBmgq-jSawW4VUv2GXSrcHayMT_6_L5oQglGkWaw10lz1KfilcTBy-TvHHWL4pitI Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f0fe822f501145eea8c66821aca0f85a Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0fe822f501145eea8c66821aca0f85a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0fe822f501145eea8c66821aca0f85a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0fe822f501145eea8c66821aca0f85a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0fe822f501145eea8c66821aca0f85a"}]}] Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f0fe822f501145eea8c66821aca0f85a Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotTestJSON-876625084-project Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 376e209ca66f4c5ca0c8a279e6a28080 Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotTestJSON-876625084-project Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'aaf851f2-4eb0-4c93-a632-3a8523e0255a'} Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:47.825732 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. Oct 10 10:57:47.830601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:57:47.835408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Returning 404 to user: Instance aaf851f2-4eb0-4c93-a632-3a8523e0255a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:57:47.836891 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56894735-ddbe-4c79-a1e8-c6106717c00a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a" status: 404 len: 111 microversion: 2.1 time: 0.104936 Oct 10 10:57:47.840012 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2055/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:47 2022] GET /compute/v2.1/servers/aaf851f2-4eb0-4c93-a632-3a8523e0255a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:57:47.865349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:47.866052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:47.874322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.875235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.875930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.877191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:47.878122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:47.878771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:47.912456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:47.927256 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9ac31c2-c54b-44f9-9586-059966ebcbb8 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.862628 Oct 10 10:57:47.927867 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2147/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:47 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:48.415698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:48.416439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:48.423445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:48.423943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:48.424386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:48.425105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:48.425563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:48.425997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:48.497995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:48.591956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:48.617303 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e32313f0-ca96-4c5f-b262-82cd163ddf0d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.763126 Oct 10 10:57:48.618267 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2056/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:47 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:48.932869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:48.953975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:48.959758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:48.960392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:48.967435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:48.969132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c8ab7db2-6991-4301-80bd-8f2d0df98443 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1357 microversion: 2.47 time: 0.557328 Oct 10 10:57:48.972109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:48.972611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:48.973050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:48.973761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:48.974221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:48.974648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:48.976369 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2148/4204] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:48 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1357 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:49.010989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:49.015985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:49.023386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Searching by: {'deleted': False, 'project_id': '31252e45826c4806b249ce2fd50581ac'} {{(pid=128800) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 10:57:49.041740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.042241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.043300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.044037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.053091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.053548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.488345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.multi_cell_list [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128800) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 10:57:49.649689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:49.671401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.671904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.672348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.693747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:49.695235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:49.762385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8087da7a-59f6-41e7-be6d-97ab03ccdd86 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.755964 Oct 10 10:57:49.764003 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2149/4205] 10.222.0.16 () {60 vars in 1187 bytes} [Mon Oct 10 10:57:49 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:49.769698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06a493b-5911-4919-b405-62c68e243e8b", "name": "network-vif-plugged", "status": "completed", "tag": "5e7e7ce1-da97-41d7-8d18-f537b0a6fc05"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:49.782542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.783499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.784085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.807269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:49.819202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] Creating event network-vif-plugged:5e7e7ce1-da97-41d7-8d18-f537b0a6fc05 for instance b06a493b-5911-4919-b405-62c68e243e8b on n-h2-860687-2 Oct 10 10:57:49.829858 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea3269b7-a1e6-4239-b717-bd51cd736235 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.869831 Oct 10 10:57:49.831208 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2057/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:48 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:49.840056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e775374e-921f-46be-bd57-37e55fc61501 req-8ad5a041-a873-445e-bffe-382706543f51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065390 Oct 10 10:57:49.841451 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2150/4207] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:49.857669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:49.861041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:49.861196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:49.861752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:49.901826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.902421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.902888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.903928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.904396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.904825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.912744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.914788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.919564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:49.926206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:49.929047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:49.934719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:50.002975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:50.189486 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f74f484b-9f65-4d67-9ab1-2089ea3c161d tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 204 len: 0 microversion: 2.47 time: 0.346224 Oct 10 10:57:50.193303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2151/4208] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:57:49 2022] DELETE /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:57:50.204032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:50.208626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:50.221460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:50.240373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:50.241012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:50.241776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:50.242251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:50.250909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:50.454464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:50.465570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:50.469284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:50.472355 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-003a76c0-d1dd-4dc4-af7f-3366f8cbc352 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1363 microversion: 2.47 time: 0.277855 Oct 10 10:57:50.475829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2152/4209] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:50 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:50.614657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:50.647837 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a0021a4-abe1-4791-ab93-35763dabd049 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.810390 Oct 10 10:57:50.650327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2058/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:49 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:50.771432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-655194395", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:50.860292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:50.861245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:50.874864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:50.875643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:50.877273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:50.878307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:50.879552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] validate_networks() for [('1b38c6a3-c663-47a3-b4dc-a29014f67d9c', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:57:50.880446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:50.881171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:51.515465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:51.524240 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59db66bf-c115-4906-9e29-512a356087db tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1317 microversion: 2.1 time: 0.668869 Oct 10 10:57:51.524822 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2059/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:50 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:51.551554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:51.553402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:51.573202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:51.578112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:51.578631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:51.581310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:51.584298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:51.585258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:51.757316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:51.775217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:51.781142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:51.785220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f3708db-2f48-4822-95d7-eb1024e23d17 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1363 microversion: 2.47 time: 0.245918 Oct 10 10:57:51.787146 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2060/4212] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:51 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:51.793341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:51.794135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:51.811205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:51.812897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:51.814791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:51.817822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:51.818514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:51.819174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.098700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:57:52.100198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:57:52.100847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:57:52.101410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:57:52.102348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:57:52.131163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.132385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.132983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.135896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.136811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.141212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.196706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Getting quotas for project f897475932274086b7c53142bdc1143f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:57:52.208901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Getting quotas for user a79a951557ef44ce88ccb6219e784dbf and project f897475932274086b7c53142bdc1143f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:57:52.246194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:57:52.249055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:57:52.350622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:52.357213 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b525519-a9b0-4a98-8fac-2177b1e53820 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877973 Oct 10 10:57:52.358150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2153/4213] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:57:52.369721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-plugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:52.374975 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-923da705-8a7f-4f8a-8b1e-0ac324533009 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.586546 Oct 10 10:57:52.375874 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2061/4214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:51 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:52.406700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21b6c119-4d78-4743-bd53-a1ec61036d94 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:52.411194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21b6c119-4d78-4743-bd53-a1ec61036d94 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:52.414982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.416406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.417040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.444644 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] Creating event network-vif-plugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:57:52.471248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9014923b-7c65-4d08-a5b3-7d960377b643 req-30b06cba-066e-44fd-9740-4a5b31631eec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093778 Oct 10 10:57:52.473577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2154/4215] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:52.551681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:52.552736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:52.571516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.572017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.572704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.575321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.578635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.579372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.694967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21b6c119-4d78-4743-bd53-a1ec61036d94 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:52.720414 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21b6c119-4d78-4743-bd53-a1ec61036d94 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1216 microversion: 2.1 time: 0.329757 Oct 10 10:57:52.720935 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2062/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:52 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1216 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:52.816661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:52.818468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:52.826798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.827855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.828466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.829396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.830073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.830789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.907865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:52.909107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:52.910894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:52.912145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lazy-loading 'fault' on Instance uuid c3bdfc90-234f-43e9-b415-03443c9f2f39 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:57:53.079617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.093215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.095062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.101759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7637a2fb-e09f-43c7-a653-daa01a3a49ef tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 200 len: 1368 microversion: 2.47 time: 0.289294 Oct 10 10:57:53.102702 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2063/4217] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:52 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:53.155621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.172498 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5236df84-77ba-4ead-bb52-c5eeccc5c160 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 200 len: 1505 microversion: 2.1 time: 0.623134 Oct 10 10:57:53.174657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2155/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:52 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:53.204804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:53.207696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:53.221610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.223412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.224038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.227522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.229235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.230360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.405567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:53.406249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:53.432464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.433559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.434011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.434812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.435467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.436010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.829608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.842190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d10e03fe-ff33-4f35-a019-e45e2c07e41f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1317 microversion: 2.1 time: 0.642622 Oct 10 10:57:53.849521 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2064/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:53 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:53.858884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:53.859532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:53.890541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.891052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.891489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.892190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:53.892644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:53.893064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:53.987568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:53.995806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c67433e6-4070-4a84-bb64-fdf4293fb302 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.594850 Oct 10 10:57:53.996417 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2156/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:53 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:54.112317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:54.116449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:54.132626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:54.133542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: c3bdfc90-234f-43e9-b415-03443c9f2f39] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:54.138032 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c16d693-8a16-4b75-b3dd-d547d2ea2934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1268 microversion: 2.1 time: 0.281936 Oct 10 10:57:54.139957 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2065/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:53 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:54.160574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.161133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.161506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.162244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.162712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.164276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.183380 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] HTTP exception thrown: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Request method failure captured: Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 HTTP/1.1 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qEHQLHgH7TSg06cYl0cCFozy8DVsOuUnz8D_ONgo8fZKMXUC1waS3_9VR0rTWmw6EC9sjok_KDVCtSSdF0sZ09-GCQmRKQeglxPU9mNRFlESErJX-EIp2-HBlLBHxwYyYx7QLvRQsJwVBTnemRBUcSrRm2vOpaEXSfPrAfD3K2Xew Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 31252e45826c4806b249ce2fd50581ac Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31252e45826c4806b249ce2fd50581ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31252e45826c4806b249ce2fd50581ac", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31252e45826c4806b249ce2fd50581ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31252e45826c4806b249ce2fd50581ac"}]}] Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 31252e45826c4806b249ce2fd50581ac Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerShowV247Test-1634565384-project Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f3c3ec7cb40d47d3b0a3fd709ddbf926 Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerShowV247Test-1634565384-project Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c3bdfc90-234f-43e9-b415-03443c9f2f39'} Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:54.186652 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. Oct 10 10:57:54.191542 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:54.193248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Returning 404 to user: Instance c3bdfc90-234f-43e9-b415-03443c9f2f39 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:57:54.194340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56da98f3-1b4a-4dde-ad8d-1a03428081c6 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39" status: 404 len: 111 microversion: 2.47 time: 0.065705 Oct 10 10:57:54.195343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2157/4222] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:54 2022] GET /compute/v2.1/servers/c3bdfc90-234f-43e9-b415-03443c9f2f39 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 10:57:54.204952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:54.205463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:54.216741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.217160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.223934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.224705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.225181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.225623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.319828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:54.437888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db767802-413c-4df3-805b-b759b74aac1e tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 204 len: 0 microversion: 2.47 time: 0.236443 Oct 10 10:57:54.439204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2066/4223] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 10:57:54 2022] DELETE /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 10:57:54.447663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:54.449145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:54.462602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.463884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.465000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.466581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.467402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.468093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.575430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e83b31-6293-445d-b5ec-7a5276efd5a7", "name": "network-vif-plugged", "status": "completed", "tag": "c54f4ec7-5ef4-4b5b-934c-e7b52e44499a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:54.575647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:54.599375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:54.602019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:54.605433 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c836a68-f055-40ba-a0f1-8785041fe043 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 200 len: 1363 microversion: 2.47 time: 0.161177 Oct 10 10:57:54.606521 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2158/4224] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:54 2022] GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 10:57:54.623884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.623884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.623884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.678840 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] Creating event network-vif-plugged:c54f4ec7-5ef4-4b5b-934c-e7b52e44499a for instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 on n-h2-860687-2 Oct 10 10:57:54.701284 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-744dd948-9d2e-4cd7-9f7d-307c12808e8b req-ef7db910-d205-4769-9a2e-bc5476ac6bf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130538 Oct 10 10:57:54.712780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2067/4225] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:57:54.876656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:54.878457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:54.903165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.904124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.904878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:54.907182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:54.907895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:54.908553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.023638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:55.025117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:55.038320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.046394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.047617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.048595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.049288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.051026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.765771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:55.805310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0271547f-ff3b-43e8-a1e2-25b40e9fb641 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.786273 Oct 10 10:57:55.824829 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2068/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:55 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:55.856117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:55.857727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:55.863755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:55.880589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d23464b7-e402-47fd-8b3e-958f889f3a60 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1317 microversion: 2.1 time: 1.009955 Oct 10 10:57:55.881918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2159/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:54 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:55.908785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.910494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.913523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.916908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:55.918096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.919048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.921891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.925606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:55.949713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.953657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.954315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:55.956367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:55.959322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:55.962006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:56.145129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:56.154206 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17704eeb-a571-4575-8e69-b602c14bb858 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1274 microversion: 2.1 time: 0.326747 Oct 10 10:57:56.154800 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2069/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:55 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:56.260968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:56.271997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:56.280651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:56.285158 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-88707b9c-4970-456d-acb1-3c6e09afd073 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 200 len: 1363 microversion: 2.47 time: 0.383294 Oct 10 10:57:56.285947 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2160/4229] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:55 2022] GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:56.831290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:56.832138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:56.842180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:56.844655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:56.846333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:56.846813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:56.847291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:56.847714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:56.907545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:56.908859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:56.922935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:56.928613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:56.934890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:56.936735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:56.937648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:56.943685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.344306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.362541 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e61d2505-da1d-4449-bead-bf4c1d68fbd5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.535267 Oct 10 10:57:57.364457 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2070/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:56 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:57.393772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:57.395722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:57.424819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.429211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.431736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.433748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.434815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.436059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.436963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.443019 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d2ac4f6-9094-4465-83de-7740f7d86548 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1505 microversion: 2.1 time: 0.539279 Oct 10 10:57:57.447953 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2161/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:56 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:57:57.453349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:57.474674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:57.490328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.491173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.491841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.493521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.496533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.497585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.562319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.563734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.564606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.565550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lazy-loading 'fault' on Instance uuid a5e6cce6-4ad4-4d60-ad2b-9f455a858eca {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:57:57.732555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.769328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.774706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3c3ec7cb40d47d3b0a3fd709ddbf926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31252e45826c4806b249ce2fd50581ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.780565 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34ee822d-61f6-4080-93d3-9a020c0333a1 tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 200 len: 1368 microversion: 2.47 time: 0.331116 Oct 10 10:57:57.781674 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2162/4232] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:57 2022] GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 10:57:57.787620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:57.788416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:57.797050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.797915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.798590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.799727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:57.800464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:57.801830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:57.850479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:57.869321 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14696a10-fcf5-44ef-a8a4-c3d40313fc2a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1274 microversion: 2.1 time: 0.500380 Oct 10 10:57:57.872050 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2071/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:57 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1274 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:57.894430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:58.026327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:58.096847 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27571c7d-e24f-4fb5-8f95-af09c3243b41 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 204 len: 0 microversion: 2.1 time: 0.313305 Oct 10 10:57:58.101637 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2163/4234] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:57 2022] DELETE /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:58.113069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:58.113684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:58.143948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.145529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.150409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.157036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.159960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.162344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.291244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:57:58.397518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:58.405231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:58.433455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.434318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.434946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.435878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.436710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.437193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.548029 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-826e8742-1a0d-419c-b8a1-ac28355a4fb1 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 204 len: 0 microversion: 2.1 time: 0.439809 Oct 10 10:57:58.548712 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2072/4235] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:57:58 2022] DELETE /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:57:58.561751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:58.562686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:58.569057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.569749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.570528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.571587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.572195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.572775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.862319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:58.876831 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d7a8e578-5805-4261-a014-d9f8b647d4d4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.488855 Oct 10 10:57:58.877891 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2164/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:58 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:58.883319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:58.887296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] [instance: a5e6cce6-4ad4-4d60-ad2b-9f455a858eca] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:58.906439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.907411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.908205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.909158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:58.909800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:58.913245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:58.951874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] HTTP exception thrown: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Request method failure captured: Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca HTTP/1.1 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qEHQLHgH7TSg06cYl0cCFozy8DVsOuUnz8D_ONgo8fZKMXUC1waS3_9VR0rTWmw6EC9sjok_KDVCtSSdF0sZ09-GCQmRKQeglxPU9mNRFlESErJX-EIp2-HBlLBHxwYyYx7QLvRQsJwVBTnemRBUcSrRm2vOpaEXSfPrAfD3K2Xew Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 31252e45826c4806b249ce2fd50581ac Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31252e45826c4806b249ce2fd50581ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_31252e45826c4806b249ce2fd50581ac", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/31252e45826c4806b249ce2fd50581ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/31252e45826c4806b249ce2fd50581ac"}]}] Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 31252e45826c4806b249ce2fd50581ac Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerShowV247Test-1634565384 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerShowV247Test-1634565384-project Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: f3c3ec7cb40d47d3b0a3fd709ddbf926 Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerShowV247Test-1634565384-project Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a5e6cce6-4ad4-4d60-ad2b-9f455a858eca'} Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:57:58.953734 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. Oct 10 10:57:58.958428 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:57:58.962004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] Returning 404 to user: Instance a5e6cce6-4ad4-4d60-ad2b-9f455a858eca could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:57:58.963130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e471944-5f48-4199-976f-90d0a881fa4c tempest-ServerShowV247Test-1634565384 tempest-ServerShowV247Test-1634565384-project] 10.222.0.16 "GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca" status: 404 len: 111 microversion: 2.47 time: 0.083369 Oct 10 10:57:58.964163 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2165/4237] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 10:57:58 2022] GET /compute/v2.1/servers/a5e6cce6-4ad4-4d60-ad2b-9f455a858eca => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:57:58.980275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:58.980815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:58.998228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:57:58.999986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:59.000713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:59.001261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:59.002082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:59.002652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:59.003227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:59.293509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:59.306203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-655b21d6-6169-4f91-8c74-0ff69e3bdbdb tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1511 microversion: 2.1 time: 0.749806 Oct 10 10:57:59.309081 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2073/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:58 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1511 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:59.490829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:57:59.504691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d0fceff-e495-42f0-bae1-16ce5df7f39e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 0.539057 Oct 10 10:57:59.506150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2166/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:58 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:57:59.855771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:57:59.871912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:59.872456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:59.872929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:59.904161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] Creating event network-changed:e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1 for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f on n-h1-860687-2 Oct 10 10:57:59.907463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:57:59.908237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:57:59.916543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5964380f-3258-44ca-b351-f7fcde0294ec req-9970f760-4440-41e5-a6b2-15be3d6c0a1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066532 Oct 10 10:57:59.918418 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2074/4240] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:57:59.922059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:59.923041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:59.923783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:57:59.924915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:57:59.925834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:57:59.927272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:00.337779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:00.338590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:00.342191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:00.409418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:00.411710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:00.440688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:00.441455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:00.461439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:00.463939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:00.762114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:00.778703 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5049ed53-66bd-48ff-9923-5f7784e51b94 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.870614 Oct 10 10:58:00.779651 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2167/4241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:57:59 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:00.799130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:00.800067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:00.807596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:00.808586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:00.809214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:00.811919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:00.812616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:00.819274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:01.953227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:01.967758 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4072b3a-2beb-4601-80ac-96cbfff03b2d tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1511 microversion: 2.1 time: 1.635402 Oct 10 10:58:01.968352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2075/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:00 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1511 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:01.989961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:01.991186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:01.998601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:01.999476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:02.000243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:02.001359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:02.002276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:02.002862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:02.137005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:02.146553 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a9b5722-fe6e-4817-bccf-ea7515d7b5bb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 1.365580 Oct 10 10:58:02.149894 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2168/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:00 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:02.162458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06a493b-5911-4919-b405-62c68e243e8b", "name": "network-vif-deleted", "tag": "5e7e7ce1-da97-41d7-8d18-f537b0a6fc05"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:02.167858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:02.185472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:02.185964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:02.186604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:02.215456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] Creating event network-vif-deleted:5e7e7ce1-da97-41d7-8d18-f537b0a6fc05 for instance b06a493b-5911-4919-b405-62c68e243e8b on n-h2-860687-2 Oct 10 10:58:02.235471 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-88429bb8-fb95-4766-8a61-bd09d6438c11 req-59cbb440-5f5d-4bcc-9a7e-5886841bada5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083960 Oct 10 10:58:02.236717 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2169/4244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:02.260387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-322482315", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "ad5bd046-b439-40e6-a1d7-834894a160de"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:02.283384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:02.420495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] validate_networks() for [('ad5bd046-b439-40e6-a1d7-834894a160de', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:58:02.647738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:02.663322 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96054fe7-2837-433f-bda8-514f86926d8a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1511 microversion: 2.1 time: 0.689578 Oct 10 10:58:02.664171 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2076/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:01 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:02.996695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:02.998023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:03.000193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:03.014214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.023428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.024108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.025251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.025882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.027077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.303671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80a9162990c4720aee23a9132af0fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2dfb46972824ec1a52fa4b595b0127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:03.312830 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce2f2b67-72e4-4c9f-9388-b3e4189d4d7f tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 200 len: 1469 microversion: 2.1 time: 0.320270 Oct 10 10:58:03.313426 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2077/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:02 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:03.332551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:03.333400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:03.350562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.364165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.369365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.372349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.380461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.381328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.757575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:03.765091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:58:03.765091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:58:03.765753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:58:03.766003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:58:03.766419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:58:03.771876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d8582f8-da4b-42b0-8616-26a5b427bf1f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 0.457363 Oct 10 10:58:03.776074 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2078/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:03 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:03.778444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.779501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.780115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.781119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.781587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.782015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.796213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e83b31-6293-445d-b5ec-7a5276efd5a7", "name": "network-vif-deleted", "tag": "c54f4ec7-5ef4-4b5b-934c-e7b52e44499a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:03.803061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Getting quotas for project f0fe822f501145eea8c66821aca0f85a. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:58:03.810782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Getting quotas for user 376e209ca66f4c5ca0c8a279e6a28080 and project f0fe822f501145eea8c66821aca0f85a. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:58:03.828839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:58:03.831473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.833211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:58:03.833457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.834138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.868921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] Creating event network-vif-deleted:c54f4ec7-5ef4-4b5b-934c-e7b52e44499a for instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 on n-h2-860687-2 Oct 10 10:58:03.887312 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bb35ec9b-76c0-4dc4-856b-4e006972a3a6 req-f791aca2-baf8-435e-8b7f-9b3cd9370193 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105580 Oct 10 10:58:03.889008 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2079/4248] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:03.899593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:03.900612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:03.916434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.917342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.918008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.918947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:03.919650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:03.920285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:03.947498 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a75667cf-1747-42b0-ab0b-4db07184d913 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.707758 Oct 10 10:58:03.948784 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2170/4249] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:58:03.963616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1253b00a-d3b8-4ceb-8d6e-57b33110600f tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:03.967855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1253b00a-d3b8-4ceb-8d6e-57b33110600f tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.295855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1253b00a-d3b8-4ceb-8d6e-57b33110600f tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:04.318677 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1253b00a-d3b8-4ceb-8d6e-57b33110600f tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1218 microversion: 2.1 time: 0.361018 Oct 10 10:58:04.319324 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2171/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:03 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1218 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:04.371623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:04.372207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: 49e83b31-6293-445d-b5ec-7a5276efd5a7] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.392056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.392584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.393040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.393771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.394314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.394663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.454279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] HTTP exception thrown: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. Oct 10 10:58:04.459393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Request method failure captured: Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 HTTP/1.1 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_p9Q3_uvLAfXpXx6kr3FeNHTlrSJzbvCblUlZdhf7Be65Vt_ULphaZv9A5i_YoXRfl0LQM4OKvnnSlSoDCtggqH1qFdwTa99FAkZnq2SkV4-wX_gF3M9aoQ5uHR7GaP6xqZiSA3RliXDJKKxwvDX6GgipNtHocENgvrv6HHRR910qY Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b2dfb46972824ec1a52fa4b595b0127a Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "tempest-type-716596987", "name": "tempest-service-873318131", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2dfb46972824ec1a52fa4b595b0127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b2dfb46972824ec1a52fa4b595b0127a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2dfb46972824ec1a52fa4b595b0127a"}]}, {"type": "tempest-type-333822415", "name": "tempest-service-1652226165", "endpoints": [{"region": "tempest-region-671803817", "publicURL": "https://url-105416519.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b2dfb46972824ec1a52fa4b595b0127a"}]}] Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b2dfb46972824ec1a52fa4b595b0127a Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-MultipleCreateTestJSON-778597154-project Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: c80a9162990c4720aee23a9132af0fa9 Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-MultipleCreateTestJSON-778597154-project Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '49e83b31-6293-445d-b5ec-7a5276efd5a7'} Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:04.468234 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. Oct 10 10:58:04.472442 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.480964 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c3a51fb-3e29-4ed3-962a-31b69430d77a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1488 microversion: 2.1 time: 0.587237 Oct 10 10:58:04.481986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Returning 404 to user: Instance 49e83b31-6293-445d-b5ec-7a5276efd5a7 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:04.483968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2080/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:03 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1488 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:04.484485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94eacd73-dace-4d70-a0e3-52c5e3968379 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7" status: 404 len: 111 microversion: 2.1 time: 0.141994 Oct 10 10:58:04.485211 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2172/4252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:04 2022] GET /compute/v2.1/servers/49e83b31-6293-445d-b5ec-7a5276efd5a7 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:04.495373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:04.497058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] [instance: b06a493b-5911-4919-b405-62c68e243e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.510396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:04.511360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.512147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.512657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.513104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.515803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.517265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.520018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.520453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.522005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.522658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.524149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.525485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.526817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.556582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:04.561360 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] HTTP exception thrown: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Request method failure captured: Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b HTTP/1.1 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_p9Q3_uvLAfXpXx6kr3FeNHTlrSJzbvCblUlZdhf7Be65Vt_ULphaZv9A5i_YoXRfl0LQM4OKvnnSlSoDCtggqH1qFdwTa99FAkZnq2SkV4-wX_gF3M9aoQ5uHR7GaP6xqZiSA3RliXDJKKxwvDX6GgipNtHocENgvrv6HHRR910qY Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b2dfb46972824ec1a52fa4b595b0127a Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "tempest-type-716596987", "name": "tempest-service-873318131", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2dfb46972824ec1a52fa4b595b0127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b2dfb46972824ec1a52fa4b595b0127a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b2dfb46972824ec1a52fa4b595b0127a"}]}, {"type": "tempest-type-333822415", "name": "tempest-service-1652226165", "endpoints": [{"region": "tempest-region-671803817", "publicURL": "https://url-105416519.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b2dfb46972824ec1a52fa4b595b0127a"}]}] Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b2dfb46972824ec1a52fa4b595b0127a Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateTestJSON-778597154 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateTestJSON-778597154-project Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c80a9162990c4720aee23a9132af0fa9 Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateTestJSON-778597154-project Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b06a493b-5911-4919-b405-62c68e243e8b'} Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:04.565168 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. Oct 10 10:58:04.569518 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:04.575935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] Returning 404 to user: Instance b06a493b-5911-4919-b405-62c68e243e8b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:04.579014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54c7684f-7bbc-4976-8669-3f1b590a00c5 tempest-MultipleCreateTestJSON-778597154 tempest-MultipleCreateTestJSON-778597154-project] 10.222.0.16 "GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b" status: 404 len: 111 microversion: 2.1 time: 0.089337 Oct 10 10:58:04.581240 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2081/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:04 2022] GET /compute/v2.1/servers/b06a493b-5911-4919-b405-62c68e243e8b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:04.610386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:58:04.801541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:04.802613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.822148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.823159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.823855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.824952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.825654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.826607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.829815 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44c9f7fb-60e8-4ed1-a25b-4e39c992384e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 204 len: 0 microversion: 2.1 time: 0.325080 Oct 10 10:58:04.833694 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2173/4254] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:04 2022] DELETE /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 10:58:04.847278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:04.849154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:04.865452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.868245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.869464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:04.871545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:04.874597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:04.875475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:05.770054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:05.803720 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f058764-823b-472e-b74f-97ace354de09 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 0.991784 Oct 10 10:58:05.811136 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2082/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:04 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:05.831111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:05.833210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:05.850464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:05.853329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:05.854087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:05.856748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:05.860261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:05.861013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:05.864068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:05.881798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed4f4f8f-3a75-4762-8c90-b9923bc6be08 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1494 microversion: 2.1 time: 1.043834 Oct 10 10:58:05.888102 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2174/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:04 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1494 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:06.300250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:06.313641 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54a8901c-6879-4666-9d40-1ef331b537dd tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1270 microversion: 2.1 time: 0.499390 Oct 10 10:58:06.323955 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2083/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:05 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1270 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:06.854599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:06.855288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:06.883433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:06.887660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:06.891698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:06.896371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:06.898880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:06.903226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:06.910231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:06.910856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:06.922502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:06.923562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:06.925631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:06.926571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:06.931070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:06.931865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:08.034224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:08.058147 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09b5b10f-6237-47e9-bb14-06fae9a6e524 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1494 microversion: 2.1 time: 1.151775 Oct 10 10:58:08.059443 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2084/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:06 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1494 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:08.079607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:08.096043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:08.097103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-190daff3-00f4-4512-8e00-7cf1d6cfd064 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 1.266996 Oct 10 10:58:08.098200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2175/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:06 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:08.102216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:08.112045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:08.113058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:08.113679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:08.114534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:08.115267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:08.115838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:08.344132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:08.363727 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b21c5cd6-f99b-49f7-a557-2ce4d784e8e5 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1276 microversion: 2.1 time: 0.273890 Oct 10 10:58:08.388043 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2085/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:08 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:08.745252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021be33c-ce1d-4a4a-b57e-504bfe18e7aa", "name": "network-vif-deleted", "tag": "2d940094-96d0-40d0-995e-7a3596bddcb2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:08.788636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:08.803067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:08.803657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:08.864239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] Creating event network-vif-deleted:2d940094-96d0-40d0-995e-7a3596bddcb2 for instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa on n-h1-860687-2 Oct 10 10:58:08.883232 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4ae4e886-0d67-43bf-8e63-1c5f6c8bdc7e req-b2d76c0f-1503-4364-a4c0-583bfa9d1459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148100 Oct 10 10:58:08.891929 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2086/4261] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:09.085385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "name": "network-vif-plugged", "status": "completed", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:09.087129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:09.088014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:09.102126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.102641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.103122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.103850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.104386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.104779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.120324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.120989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.132360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.196890 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] Creating event network-vif-plugged:e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1 for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f on n-h1-860687-2 Oct 10 10:58:09.224557 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-74577957-0f2d-49c9-8e7f-dbfe20d1245e req-a1217721-4d31-42bc-9c12-b87bcdf14661 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.538615 Oct 10 10:58:09.228879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2176/4262] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:09.251929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:09.252654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:09.282011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.293399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.293868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.294650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'fault' on Instance uuid 021be33c-ce1d-4a4a-b57e-504bfe18e7aa {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:58:09.294751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.295329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.295786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.296530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:09.296995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:09.297427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:09.961123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:09.973040 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0cbc1d4-97d1-4918-a777-8e2d7b771413 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 200 len: 1304 microversion: 2.1 time: 0.890891 Oct 10 10:58:09.976293 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2087/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:09 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 1304 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:09.992270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:09.992806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:10.033473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:10.033987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:10.034439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:10.036623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:10.039932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:10.040431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:10.365926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:10.373180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:10.393567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14b8d789-87d0-4085-9aad-b6d280a4e943 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1276 microversion: 2.1 time: 0.416188 Oct 10 10:58:10.403875 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2088/4264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:09 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1276 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:10.404765 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb47d399-4717-4ef5-b075-5885ee0c5ca9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1316 microversion: 2.1 time: 1.168395 Oct 10 10:58:10.422673 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2177/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:09 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1316 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:11.002841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:11.003697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:11.030196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.030763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.034107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:11.050664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.061123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.064664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:11.142066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa HTTP/1.1 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '021be33c-ce1d-4a4a-b57e-504bfe18e7aa'} Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:11.156390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:11.163226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:11.165653 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dccc1a75-ab30-4020-a85b-3ad253c5473f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 404 len: 111 microversion: 2.1 time: 0.167207 Oct 10 10:58:11.166252 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2089/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:10 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:11.438373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:11.439155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:11.439633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:11.441190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:11.452908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.453758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.455700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.458149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:11.459027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.459898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.460097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.460766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:11.461307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:11.465620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:11.468954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:11.469871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:12.502617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:12.523685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c9ba080-8f2c-4613-ab83-d823379e4d26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.094107 Oct 10 10:58:12.545420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2090/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:11 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:12.561451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-897304254", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "801943ed-816f-4b37-8520-d9c9d1637030"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:12.719495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] validate_networks() for [('801943ed-816f-4b37-8520-d9c9d1637030', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:58:12.748500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:12.761802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95b39d79-b344-4113-ac47-17d40e583bde tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 1.335856 Oct 10 10:58:12.767488 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2178/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:11 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:12.861115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136421107", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:13.050149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] validate_networks() for [('1b38c6a3-c663-47a3-b4dc-a29014f67d9c', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:58:13.793001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:14.303573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:16.727170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:58:16.729825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:58:16.730665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:58:16.734208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:58:16.739942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:58:16.766076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:16.768727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:16.769217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:16.772597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:16.773087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:16.773531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:16.790806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:58:16.792390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:58:16.793033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:58:16.793607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:58:16.794200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:58:16.817661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:16.817661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:16.817661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:16.817661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:16.817661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:16.834450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:16.843073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Getting quotas for project f897475932274086b7c53142bdc1143f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:58:16.878967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Getting quotas for user a79a951557ef44ce88ccb6219e784dbf and project f897475932274086b7c53142bdc1143f. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:58:16.913239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:58:16.929655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Getting quotas for user a6bba7b21c494fd4ab609113f1e9168a and project a9eea9b98dbc4d23b017c1db8b43b9b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:58:16.930721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:58:16.955611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:58:16.970968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:58:16.976880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:58:17.089986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7366ec98-c193-4a37-86c3-7c3a405fc132 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.232443 Oct 10 10:58:17.092954 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2179/4269] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:58:17.120643 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f1b4582-4d5c-4bc1-af32-413ca32c3d4d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.573201 Oct 10 10:58:17.121998 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2091/4270] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:58:17.130294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969baf85-599d-400b-992d-75da6a55c660", "tag": "4988e950-defb-4d64-8418-b0c8727f6aa3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:17.142248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:17.143467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:17.154361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:17.158037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:17.160309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:17.178651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:17.182970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:17.184714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:17.185540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:17.185946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:17.186384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:17.229210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] Creating event network-changed:4988e950-defb-4d64-8418-b0c8727f6aa3 for instance 969baf85-599d-400b-992d-75da6a55c660 on n-h2-860687-2 Oct 10 10:58:17.252948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f265e37e-5589-4759-b247-49bde0302229 req-32c18aa8-7a6a-4c2f-ad03-2c6a3c0a4d52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129236 Oct 10 10:58:17.264319 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2092/4271] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:17.298832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-295a2b23-5954-448b-8b3f-4314d1542789 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:17.299536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-295a2b23-5954-448b-8b3f-4314d1542789 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:17.960097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-295a2b23-5954-448b-8b3f-4314d1542789 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:17.984773 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-295a2b23-5954-448b-8b3f-4314d1542789 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1217 microversion: 2.1 time: 0.715724 Oct 10 10:58:17.986301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2093/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:17 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1217 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:18.012477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d352aed-4be2-4260-98ee-813602aa7905 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:18.020009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d352aed-4be2-4260-98ee-813602aa7905 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:18.330324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d352aed-4be2-4260-98ee-813602aa7905 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:18.360337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d352aed-4be2-4260-98ee-813602aa7905 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1214 microversion: 2.1 time: 0.367515 Oct 10 10:58:18.368692 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2094/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:17 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1214 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:18.433234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:18.445806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ca79e22-e542-42dd-ac3e-a07426c6d666 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 1.351495 Oct 10 10:58:18.446899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2180/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:17 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:19.013723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:19.015466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:19.026386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:19.027661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:19.032139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.032911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.033605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.035496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.036721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.037520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.037866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.038457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.038887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.040882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.042671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.043380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.159109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:19.171192 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-548a4abb-c997-4dce-be02-6e9f66beaf43 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1213 microversion: 2.1 time: 0.163760 Oct 10 10:58:19.176620 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2095/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:19 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:19.393705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:19.394317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:19.408715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.410637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.411284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.412745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.414466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.417002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.585446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:19.601110 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d654d095-3020-41b0-8565-89067795d0a5 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1210 microversion: 2.1 time: 0.208398 Oct 10 10:58:19.615027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2096/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:19 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:19.615027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:19.616393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:19.625368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.625919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.626362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.627217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.628593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.629323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.806431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:19.819383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ed7460d-aa4d-4366-8acd-ea5390cc3b29 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.797740 Oct 10 10:58:19.819975 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2181/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:19 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:19.845939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1244825229"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:19.849326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:19.858183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.859333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.859947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:19.860753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:19.861214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:19.861631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.255829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:20.330642 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f7834691-aa0d-43b3-9b7a-9d8d2d9f1df4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.488694 Oct 10 10:58:20.331364 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2182/4278] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:58:19 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 10 10:58:20.368219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:20.373164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:20.403514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.404023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.410945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.416375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.416902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.417833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.445983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:20.463778 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7716e890-1fa2-4969-a65e-c44262bb1db2 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 0.848773 Oct 10 10:58:20.467839 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2097/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:19 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:20.486604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:20.490066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:20.517361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.517910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.525155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.527535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.536137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.539260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.767636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:20.782900 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb3ee50a-7ab0-4114-94fd-9a2ba5973704 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1275 microversion: 2.1 time: 0.442149 Oct 10 10:58:20.807628 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2183/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:20 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1275 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:20.816223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:20.816853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:20.836552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.841995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.845840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:20.847122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:20.847749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:20.850662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:21.215096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:21.230340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c1b73be-35f6-432a-b274-ae5b889af148 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1274 microversion: 2.1 time: 0.430684 Oct 10 10:58:21.230956 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2184/4281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:20 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1274 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:21.495245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:21.496001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:21.508705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:21.509201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:21.509631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:21.510385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:21.510922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:21.511377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:22.295823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:22.304050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1d6b1ad-7789-48a5-ad99-38c10721bfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 1.834960 Oct 10 10:58:22.310861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2098/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:20 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:22.330899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:22.337094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:22.350651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:22.352877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:22.353345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:22.354753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:22.354753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:22.359630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:22.714447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:22.719995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:22.737747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc037944-31df-4ae8-aad2-657e7a6cabe8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.421251 Oct 10 10:58:22.738377 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2099/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:22 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:22.739146 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f544150-e0a8-4711-8be4-5301097fdb13 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 1.251019 Oct 10 10:58:22.744171 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2185/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:21 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:22.756708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:22.758959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:22.775389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:22.776174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:22.776868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:22.779447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:22.780109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:22.783137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:23.114153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:23.123738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0b77b72-756a-4fc3-8361-52f450810bd3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1272 microversion: 2.1 time: 0.379892 Oct 10 10:58:23.124330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2100/4285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:22 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:23.172724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-unplugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:23.206815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:23.207699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:23.209625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:23.243655 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] Creating event network-vif-unplugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:58:23.259145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d7afea41-d8f1-4822-8160-15a4357da63b req-6722793a-3eca-4ce9-9f35-54a7acac3590 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088692 Oct 10 10:58:23.261062 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2186/4286] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:23.334687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:23.336475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:23.356014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:23.359871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:23.366399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:23.368805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:23.370554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:23.373033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:23.771429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:23.773128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:23.781916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:23.785299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:23.786476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:23.789160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:23.793496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:23.794195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:24.784826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:24.824977 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e798ef9-1331-439b-987f-43f1b9581cb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 1.059464 Oct 10 10:58:24.827726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2187/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:23 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:24.835125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:24.836141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:24.846805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:24.847412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:24.847862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:24.850423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:24.850901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:24.851420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:24.909638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:24.921054 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9f1c2db-70ae-432b-8b2a-556b5c57b43a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1684 microversion: 2.1 time: 1.590536 Oct 10 10:58:24.949941 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2101/4288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:23 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1684 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:24.961595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:24.962465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:24.975553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:24.978012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:24.979673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:24.981054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:24.981835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:24.982437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:25.383197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:25.399660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-754e48dd-d791-4124-940d-5c02a9c6fd9a tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 0.570478 Oct 10 10:58:25.400175 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2188/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:24 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:25.422290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0", "tag": "44502bd9-1f14-47d4-b936-4c9e945f0906"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:25.445753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:25.450415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:25.451104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:25.479166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] Creating event network-changed:44502bd9-1f14-47d4-b936-4c9e945f0906 for instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 on n-h2-860687-2 Oct 10 10:58:25.486679 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-cd9bf858-22a7-46c0-878f-ac0357c07e6d req-1c37e8b0-f39b-4b1f-af9f-7f7800ff45a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085211 Oct 10 10:58:25.495093 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2189/4290] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:25.655150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:25.658452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:25.673101 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bab4e348-a786-4a71-926f-14d8d375fad4 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 0.721748 Oct 10 10:58:25.674459 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2102/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:24 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:25.849315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:25.850668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:25.862947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:25.863760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:25.864571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:25.873722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:25.874419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:25.875856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:25.950604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:25.952018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:25.967145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:25.972213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:25.972874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:25.976575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:25.980257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:25.982169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.490015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:26.508710 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acb6c2ac-fdb3-473b-99ed-b442cf7a53e9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.563532 Oct 10 10:58:26.509668 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2103/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:25 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:26.527707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:26.528854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:26.536460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:26.539526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:26.543203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:26.543884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.545099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:26.547278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:26.548000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.551252 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ff9ef75-cb2f-4b89-a526-22dece6226e4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.706708 Oct 10 10:58:26.578070 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2190/4293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:25 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:26.591294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969baf85-599d-400b-992d-75da6a55c660", "name": "network-vif-plugged", "status": "completed", "tag": "4988e950-defb-4d64-8418-b0c8727f6aa3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:26.608816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:26.610449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:26.611096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.627427 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] Creating event network-vif-plugged:4988e950-defb-4d64-8418-b0c8727f6aa3 for instance 969baf85-599d-400b-992d-75da6a55c660 on n-h2-860687-2 Oct 10 10:58:26.635820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a416dad5-838b-4024-a682-d33618218863 req-54c2c06d-6946-43b7-a18a-44b6143b7891 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052885 Oct 10 10:58:26.640416 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2191/4294] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:26.699910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:26.702095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:26.715949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:26.716667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:26.717324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.720462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:26.721519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:26.724084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:26.822316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:26.871090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:26.918499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:28.145266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:28.162883 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d531f02d-b59f-4aed-a191-87c98b98baf8 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 1.643029 Oct 10 10:58:28.167381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:28.202405 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bcaf23c-cd3d-4913-9c65-506067ea9b29 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 1.508017 Oct 10 10:58:28.203682 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2104/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:26 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:28.211712 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2192/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:26 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:28.222430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:28.223457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:28.232470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:28.234823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:28.263485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:28.265099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:28.266955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:28.269529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:28.269783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:28.271127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:28.272922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:28.276566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:28.277881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:28.280621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:28.283555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:28.284724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:28.372646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:29.009768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:29.018799 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0fafdaa-afd3-4f82-9f86-b49631cc18bd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.801870 Oct 10 10:58:29.027611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:29.037357 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47037f15-5038-4192-878a-3e7435b9030b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.832028 Oct 10 10:58:29.037666 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2193/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:28 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:29.043692 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2105/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:28 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:29.050024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-plugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:29.070791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:29.073178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:29.073713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:29.074149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:29.100964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] Creating event network-vif-plugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:58:29.112796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4317a5be-3771-477a-8c9a-b7ebb1280a95 req-53f8789e-908c-4dc2-bb33-2682c7ac0131 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073595 Oct 10 10:58:29.114288 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2194/4299] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:29.202884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:29.204152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:29.214283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:29.215086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:29.215502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:29.216216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:29.243363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:29.245085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:29.661960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:29.662809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:29.675991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:29.680185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:29.680965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:29.682770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:29.683515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:29.684161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:30.479310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:30.494283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d787b743-df84-4df5-a5bc-dae894245239 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 1.256639 Oct 10 10:58:30.497389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2195/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:29 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:30.523491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:30.525000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:30.532579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:30.533219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:30.533731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:30.535449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:30.536140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:30.536794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:30.854718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:30.870582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7fe427ce-71b8-4d21-88e5-dd7a7d0c5e4e tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1318 microversion: 2.1 time: 1.671374 Oct 10 10:58:30.872589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2106/4301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:29 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1318 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:30.886909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:30.888086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:30.902740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:30.909063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:30.913388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:30.915689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:30.920056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:30.921652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:30.922856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:31.290493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:31.304617 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb805490-df86-4120-9a67-8cf1825428dd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.788672 Oct 10 10:58:31.307889 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2196/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:30 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:31.317362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80aef51-70b7-4c44-8906-58959cea3735", "tag": "5ead9757-de2c-4b93-be06-843669bc436e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:31.331672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:31.332408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:31.333004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:31.377821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] Creating event network-changed:5ead9757-de2c-4b93-be06-843669bc436e for instance b80aef51-70b7-4c44-8906-58959cea3735 on n-h2-860687-2 Oct 10 10:58:31.392715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a2dfadb5-ffd6-4bde-8d98-776c9fb9f4e8 req-495084d3-c9ff-4bd4-9fd7-f733013f7e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083338 Oct 10 10:58:31.394633 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2197/4303] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:31.526456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:31.527588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:31.539698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:31.540651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:31.543774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:31.544778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:31.547692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:31.551292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:31.735261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:31.753749 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6231d17-08ba-486d-95a6-9ea6de95d7a8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.877594 Oct 10 10:58:31.760326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2107/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:30 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:31.896042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:31.898087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:31.913587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:31.922880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:31.923686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:31.926156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:31.929251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:31.932093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:32.036102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:32.048372 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23afec1a-a9ce-423c-86ca-5a54bb9ae9ca tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 0.524907 Oct 10 10:58:32.049589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2198/4305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:31 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:32.329168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:32.329797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:32.341395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:32.351432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:32.363372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:32.366071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:32.366717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:32.369553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:32.733222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:32.742520 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a250dcdb-c25c-4b6b-9419-d0d2cbddc68b tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1507 microversion: 2.1 time: 0.852651 Oct 10 10:58:32.748083 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2108/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:31 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1507 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:32.774890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa77c70d-93da-470c-bec3-776a0de328ae", "device": "/dev/sdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:32.783266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:32.791543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:32.792323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:32.792975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:32.793900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:32.794575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:32.795482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:33.091159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:33.105556 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1551a8f-5895-47e0-b610-45648a8522d2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.778764 Oct 10 10:58:33.110568 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2199/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:32 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:33.125488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:33.126181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:33.144257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:33.145129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:33.145585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:33.148570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:33.149050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:33.149485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:33.521042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:33.534277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a2e045f-ab17-4bfe-b9dc-ae9ad3d78414 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.420826 Oct 10 10:58:33.546058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2200/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:33 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:33.560149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:33.560149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:33.574556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:33.574915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:33.575415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:33.577081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:33.577279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:33.577630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.293646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24549180-14c3-4680-8328-914b4df44d32 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "POST /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.523138 Oct 10 10:58:34.311859 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2109/4309] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 10:58:32 2022] POST /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660/os-volume_attachments => generated 194 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:58:34.341806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0", "name": "network-vif-plugged", "status": "completed", "tag": "44502bd9-1f14-47d4-b936-4c9e945f0906"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:34.405900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:34.408181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:34.409444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.460775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:34.474193 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] Creating event network-vif-plugged:44502bd9-1f14-47d4-b936-4c9e945f0906 for instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 on n-h2-860687-2 Oct 10 10:58:34.490985 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f30a5d6-e0fe-4235-a84e-da8c1f7cccdd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 0.944108 Oct 10 10:58:34.493693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a9821727-a085-4fe0-a791-5adf9a250bcf req-7c6640c9-87e8-4504-893d-b1f71a77bca5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175102 Oct 10 10:58:34.496477 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2110/4310] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:34.499066 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2201/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:33 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:34.511510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:34.512549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:34.524833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:34.528949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:34.530451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.533216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:34.533903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:34.535359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.563476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:34.564614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:34.583925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:34.589268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:34.590755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.596162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:34.607285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:34.609301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:34.629605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:35.383097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:35.392617 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f9fb4f4-6f4a-48ea-9930-20b216daab80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1317 microversion: 2.1 time: 0.894467 Oct 10 10:58:35.409321 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2111/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:34 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:35.611622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-462554728", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "6d433d27-93cc-4bb2-b19e-13537fdefdd3"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:35.644314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:35.670623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4e25458-7d04-4efa-8960-fd105a31bb95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 1.109838 Oct 10 10:58:35.672568 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2202/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:34 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:35.704053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:35.704698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:35.745722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:35.746233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:35.746680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:35.747421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:35.747879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:35.748304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:35.764607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] validate_networks() for [('6d433d27-93cc-4bb2-b19e-13537fdefdd3', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:58:37.903672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:37.912512 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d811971b-0150-4da4-8b1d-419a2026543b tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 2.231802 Oct 10 10:58:37.939829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2203/4314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:35 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:37.950384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:37.953058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:37.968096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:37.968620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:37.969076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:37.969807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:37.970271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:37.970703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.148735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:39.162598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f612e4c2-c969-4627-950e-4bb6a116663e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1506 microversion: 2.1 time: 1.221201 Oct 10 10:58:39.177055 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2204/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:37 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1506 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:39.205486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:39.206321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:39.221214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.223430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.227676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.229566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.230551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.231278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.374849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:58:39.376752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:58:39.377415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:58:39.377999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:58:39.379376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:58:39.423198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.426989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.428650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.435887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.436697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.441217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.505891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Getting quotas for project 9edfa766d39c44e89125b6da709e8cbb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:58:39.513467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Getting quotas for user 5912f78acc8644f38b97864163c9c9d3 and project 9edfa766d39c44e89125b6da709e8cbb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:58:39.556527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:58:39.559546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:58:39.666716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-606e0835-c9fc-4c4e-8032-494910917614 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.251028 Oct 10 10:58:39.673879 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2112/4316] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:58:39.690338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:39.706224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:39.759109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.761355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.767275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:39.775656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:39.787990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:39.792540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:40.050236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:40.066047 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87d2091a-09b4-450f-ad54-ff1446fcf260 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.887661 Oct 10 10:58:40.068298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2205/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:39 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:40.078918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:40.094375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:40.127189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:40.128103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:40.129620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:40.139807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:40.141801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:40.146234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:40.282209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:58:40.585777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b009b72-9cac-41c3-a31d-a832bdeafd8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 204 len: 0 microversion: 2.1 time: 0.511219 Oct 10 10:58:40.592948 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2206/4318] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:40 2022] DELETE /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:58:40.613890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-68b276f5-2da5-40ff-ac4d-eaeb803e068b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:40.624781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68b276f5-2da5-40ff-ac4d-eaeb803e068b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:40.794480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-68b276f5-2da5-40ff-ac4d-eaeb803e068b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:40.805332 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-68b276f5-2da5-40ff-ac4d-eaeb803e068b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1215 microversion: 2.1 time: 0.206593 Oct 10 10:58:40.808839 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2207/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:40 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:40.819779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:40.823770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:40.845956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:40.848779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:40.850548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:40.852144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:40.854348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:40.855519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:40.925434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:40.942704 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0581e6d2-9a63-405c-9ffd-096687653235 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 1.270652 Oct 10 10:58:40.965552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2113/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:39 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:41.095538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:41.096649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:41.112040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:41.120081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:41.121360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:41.122368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:41.124348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:41.125574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.099964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:42.112777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a83fbb62-11f3-4466-8d91-d5d011c7e54c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1512 microversion: 2.1 time: 1.302573 Oct 10 10:58:42.124786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2208/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:40 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1512 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:42.142466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:42.143455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:42.175580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:42.177473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:42.187995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.195892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:42.197325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:42.198249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.471659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:42.480641 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-272765d0-befd-4d49-9350-64c05b45ff7f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 1.388815 Oct 10 10:58:42.489702 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2114/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:41 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:42.495237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80aef51-70b7-4c44-8906-58959cea3735", "name": "network-vif-plugged", "status": "completed", "tag": "5ead9757-de2c-4b93-be06-843669bc436e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:42.504028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:42.517927 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7fc5ca57-ee65-4590-8192-79c9c721bbbb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1219 microversion: 2.1 time: 0.390623 Oct 10 10:58:42.528575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2209/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:42 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1219 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:42.555651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:42.560347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:42.561234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.575686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:42.576357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:42.592877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] Creating event network-vif-plugged:5ead9757-de2c-4b93-be06-843669bc436e for instance b80aef51-70b7-4c44-8906-58959cea3735 on n-h2-860687-2 Oct 10 10:58:42.598304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:42.605931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:42.606553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.613038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4de69620-5d10-435b-84c4-0e5976d0e980 req-7e1ac5b3-3089-4998-895d-1085e8e8c721 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118605 Oct 10 10:58:42.614019 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2115/4324] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:42.614513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:42.615169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:42.616759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:42.928501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-79977753", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "6eb0a6c7-7ab7-4660-a8d4-3a6f30ad9f33"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:43.059131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] validate_networks() for [('6eb0a6c7-7ab7-4660-a8d4-3a6f30ad9f33', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:58:43.273489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:43.287820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ebaacb4-e93f-4009-88ea-63252ee1ed48 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1314 microversion: 2.1 time: 0.757806 Oct 10 10:58:43.292007 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2210/4325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:42 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:43.302741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:43.306951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:43.313961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:43.314668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:43.315912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:43.319742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:43.320464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:43.321206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:44.685425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:44.698350 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c1362fa-c482-447b-8302-f8f8a9579f02 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 200 len: 1512 microversion: 2.1 time: 1.401767 Oct 10 10:58:44.711699 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2211/4326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:43 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 1512 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:44.730987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:44.738344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:44.785122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:44.793232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:44.794969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:44.799678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:44.801509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:44.804677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:45.557319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:45.572938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1883c67-5d63-490d-a948-2fbd57e323b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.851126 Oct 10 10:58:45.577099 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2212/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:44 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:45.595858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:45.596654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:45.624350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:45.625041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:45.625477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:45.643666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:45.644529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:45.646910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:45.760056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:58:45.761163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:58:45.761844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:58:45.762432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:58:45.763747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:58:45.782751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:45.787378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:45.787830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:45.793883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:45.794411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:45.795949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:45.889507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Getting quotas for project 29dec10958344687a10fa30f85f452dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:58:45.927410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Getting quotas for user 58587085946c485f97c924590a060418 and project 29dec10958344687a10fa30f85f452dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:58:45.998739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:58:46.017617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:58:46.268059 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f762b319-7a8a-4b8d-a147-68aec0ff3b84 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.651366 Oct 10 10:58:46.270847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2116/4328] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:58:46.318640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:46.352161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.114014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:47.138529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3dc84964-cbe7-4bce-b29a-5de185469363 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 1.548762 Oct 10 10:58:47.144193 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2213/4329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:45 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:47.165075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0", "name": "network-vif-deleted", "tag": "44502bd9-1f14-47d4-b936-4c9e945f0906"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:47.194573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.198114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.198831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.251451 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] Creating event network-vif-deleted:44502bd9-1f14-47d4-b936-4c9e945f0906 for instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 on n-h2-860687-2 Oct 10 10:58:47.274053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-84f8c471-ebe8-4e4c-bab0-167760ec45b3 req-0e04a55f-265f-4b4b-b5ea-c73fdc960e8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128342 Oct 10 10:58:47.279062 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2214/4330] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:47.319252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:47.320078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:47.346764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.349897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.350353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.353812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.355346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.356353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.406383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 HTTP/1.1 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0'} Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:47.408459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:58:47.415121 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:47.418924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:47.423209 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0198122-fe7e-4bda-b963-44bb6fc8600c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 404 len: 111 microversion: 2.1 time: 0.141716 Oct 10 10:58:47.424737 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2215/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:47 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:47.440400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24d742b6-e8d3-4b6e-80f1-1bfc4d4fc30e tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:47.442990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24d742b6-e8d3-4b6e-80f1-1bfc4d4fc30e tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:47.658509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24d742b6-e8d3-4b6e-80f1-1bfc4d4fc30e tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:47.669917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:47.670972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24d742b6-e8d3-4b6e-80f1-1bfc4d4fc30e tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1226 microversion: 2.1 time: 0.242480 Oct 10 10:58:47.674367 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2216/4332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:47 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1226 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:47.691807 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09460392-4514-4978-9713-5344d38b711d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1500 microversion: 2.1 time: 1.411961 Oct 10 10:58:47.704647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:47.706543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:47.708517 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2117/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:46 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1500 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:47.736497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:47.737620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:47.745213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.746012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.757344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.758717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.758891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.760114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.761196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.762359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:47.763116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.764210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:47.765427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:47.765900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:48.599469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:48.612212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-798f305f-1851-40b1-b9ee-30efbe15efec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.936730 Oct 10 10:58:48.612808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2217/4334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:47 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:48.636415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:48.636979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:48.649055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:48.655732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:48.656383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:48.657155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:48.657642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:48.658083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:48.699079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:48.724933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lazy-loading 'flavor' on Instance uuid b80aef51-70b7-4c44-8906-58959cea3735 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:58:48.734972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ca5cc04-884b-4b52-b743-d278049d61f7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.022164 Oct 10 10:58:48.738608 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2118/4335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:47 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:48.760645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:48.781073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:48.826782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:48.827599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:48.828263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:48.829162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:48.831962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:48.832576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:48.924883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:48.969572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd86965a-12b1-450d-88f8-598a37fa9605 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "POST /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735/action" status: 202 len: 0 microversion: 2.1 time: 0.355461 Oct 10 10:58:48.970837 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2218/4336] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:58:48 2022] POST /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:58:48.976968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:48.985913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:49.028364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.030052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.030515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.035713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.039507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.040162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.607762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:49.637091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ef5f215-0f27-4408-ad5a-28642c96c083 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1286 microversion: 2.1 time: 0.664763 Oct 10 10:58:49.646896 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2219/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:48 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1286 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:49.663509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:49.664318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:49.684418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.692080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.693735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.696778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.698369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.699129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.777213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:49.808465 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cffe0e7-a2b6-4184-a332-857d04c71301 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 1.065393 Oct 10 10:58:49.810243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2119/4338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:48 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:49.822663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa9cc0b-b95b-4a83-92af-b8b5f11c7386", "tag": "ef3ae10f-fa32-49ae-90cc-3531022ff232"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:49.857177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.858938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.859470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.886570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] Creating event network-changed:ef3ae10f-fa32-49ae-90cc-3531022ff232 for instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 on n-h1-860687-2 Oct 10 10:58:49.892962 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c6ada4d5-e51e-46e3-a023-f215c7a228ce req-7de83e24-2ec2-4079-8daa-88f912a33d49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080085 Oct 10 10:58:49.893819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2120/4339] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:49.901456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-781299ac-61b8-4336-8afb-9d8519d4d89d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-781299ac-61b8-4336-8afb-9d8519d4d89d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 163 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": 12345, "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 12345 Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:58:49.905597 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 10:58:49.911056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:49.913284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-781299ac-61b8-4336-8afb-9d8519d4d89d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:49.915846 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-781299ac-61b8-4336-8afb-9d8519d4d89d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019028 Oct 10 10:58:49.917137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2121/4340] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:49 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:58:49.922642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:49.923820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:49.936912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.937904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.938528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.939711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:49.940407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:49.941018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:49.971256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:50.729565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:50.745241 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c39870b-3939-482e-a1bd-eeafe91cd72c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1491 microversion: 2.1 time: 1.095408 Oct 10 10:58:50.746423 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2220/4341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:49 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1491 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:50.758150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:50.759657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:50.769149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:50.770085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:50.770740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:50.771707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:50.772381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:50.773031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.055235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:51.069050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49b004c0-5c53-498e-88d4-f1ea22a1a945 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 1.150412 Oct 10 10:58:51.070708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2122/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:49 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:51.077914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:51.078716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:51.086148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.086698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.087377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.088536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.089040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.089970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.251735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:51.264642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e0dabb7-4a5d-45f7-b42e-659e25381442 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1284 microversion: 2.1 time: 0.190722 Oct 10 10:58:51.267861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2123/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:51 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:51.283985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:51.294233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:51.315180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.317776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.318495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.320738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.322070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.323562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.412437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:58:51.472980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:51.496264 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-388ecbd9-a224-4c7c-9cf4-d1d61f89187e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.746933 Oct 10 10:58:51.497967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2221/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:50 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:51.503084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:51.503940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:51.517227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.518469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.520630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.521737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.522360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.523089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.640642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9113bac8-c3a3-4f1b-8386-1bc76f475434 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 204 len: 0 microversion: 2.1 time: 0.368400 Oct 10 10:58:51.641822 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2124/4345] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:51 2022] DELETE /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:58:51.651675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:51.652899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:51.668938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.674246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.675888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:51.678317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:51.679483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:51.681928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.170433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:52.188542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2597eb39-57a2-42bf-b8a5-946ab1d44161 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 0.686504 Oct 10 10:58:52.189485 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2222/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:51 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:52.208293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:52.209166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:52.224749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.225544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.226197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.227210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.228413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.229045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.441900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:52.451605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05000d78-44c2-4b8d-befa-f892edd726ca tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.808253 Oct 10 10:58:52.458823 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2125/4347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:51 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:52.478286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:52.479169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:52.508572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.509636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.518008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.518781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.527287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.529518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.570943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:52.588949 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-878a1cdd-eb65-425e-8080-02b810d2ecad tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1497 microversion: 2.1 time: 0.391628 Oct 10 10:58:52.597414 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2223/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:52 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1497 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:52.612441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:52.615888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:52.628370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.631535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.638724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:52.641372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:52.644718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:52.645373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:53.599664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:53.624559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-259dfb59-4ba7-4bcd-8cd0-36440f932362 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 1.164048 Oct 10 10:58:53.625208 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2126/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:52 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:53.654721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:53.655438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:53.691310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:53.698441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:53.700916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:53.701766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:53.704762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:53.705431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:53.895811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:53.918369 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-897f631a-006c-4ae7-8a4d-0206978ef593 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 1.307609 Oct 10 10:58:53.919613 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2224/4350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:52 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:53.935817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:53.942354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:53.972937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:53.976247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:53.980516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:53.981729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:53.988389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.022970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:54.149514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:54.168874 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-372ae5e7-dcd5-40d6-9a25-d5cfbc3595df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 0.529024 Oct 10 10:58:54.171997 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2127/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:53 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:54.268792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bba7b21c494fd4ab609113f1e9168a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9eea9b98dbc4d23b017c1db8b43b9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:54.292853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-50c08d62-9b81-48aa-8074-cf447234a9f3 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 200 len: 1455 microversion: 2.1 time: 0.369397 Oct 10 10:58:54.296782 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2225/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:53 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 1455 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:54.477487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80aef51-70b7-4c44-8906-58959cea3735", "name": "network-vif-deleted", "tag": "5ead9757-de2c-4b93-be06-843669bc436e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:54.522152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:54.538270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.538735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:54.584693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] Creating event network-vif-deleted:5ead9757-de2c-4b93-be06-843669bc436e for instance b80aef51-70b7-4c44-8906-58959cea3735 on n-h2-860687-2 Oct 10 10:58:54.612219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-79eb5a62-7d73-4676-a61a-f5b53f8af9c2 req-c4ac61b6-f3f1-4d03-bf9e-20d013606ce2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141032 Oct 10 10:58:54.614968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2128/4353] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:54.657847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:54.661128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:54.678353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:54.679110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.679785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:54.681034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:54.683449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.684108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:54.946627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:54.947666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:54.966100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:54.967561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.970483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:54.973720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:54.978554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:54.979279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:55.433677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:55.444542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48764cea-244d-4888-aa92-327223c18e7a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 0.800176 Oct 10 10:58:55.478874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2226/4354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:54 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:55.499954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:55.502041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:55.518432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:55.519337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:55.519976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:55.522827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:55.524960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:55.525551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:55.830459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:55.971403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:56.073350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:56.084925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27c5a859-7209-4059-8e94-4182c046564b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 1.142839 Oct 10 10:58:56.090112 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2129/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:54 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:56.105924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.107332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.119662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.122182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.123485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.127266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.128628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.129305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.151817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:56.166745 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f39be1f4-7f7f-4657-8852-26bdac547f34 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 0.684329 Oct 10 10:58:56.172437 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2227/4356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:55 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:56.182485 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 HTTP/1.1 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b80aef51-70b7-4c44-8906-58959cea3735'} Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.188580 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.192521 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.197430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.198594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6814d26-389e-4901-9e30-2f8a385dc206 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 404 len: 111 microversion: 2.1 time: 0.106623 Oct 10 10:58:56.209955 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2130/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:56 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.211857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.212795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.226393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.227238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.227978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.229135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.232454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.232942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.254415 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 HTTP/1.1 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b80aef51-70b7-4c44-8906-58959cea3735'} Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.257993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.264008 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.271177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.276303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec9b7d2e-4634-4aca-9188-2c2babdde01f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 404 len: 111 microversion: 2.1 time: 0.069267 Oct 10 10:58:56.290343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.291186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: b80aef51-70b7-4c44-8906-58959cea3735] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.294819 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2228/4358] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:56 2022] DELETE /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.303068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.303648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.304088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.304792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.305244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.306301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.333985 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 HTTP/1.1 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b80aef51-70b7-4c44-8906-58959cea3735'} Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.349588 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance b80aef51-70b7-4c44-8906-58959cea3735 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.360683 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccaffa39-1fb8-46b6-a90d-545274926a7d tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735" status: 404 len: 111 microversion: 2.1 time: 0.072953 Oct 10 10:58:56.365122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.365735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.375327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2131/4359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:56 2022] GET /compute/v2.1/servers/b80aef51-70b7-4c44-8906-58959cea3735 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.378130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.387892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.389833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.392934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.393028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.396164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.435377 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa HTTP/1.1 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '021be33c-ce1d-4a4a-b57e-504bfe18e7aa'} Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.437947 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.442975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.445842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.451726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d25f7064-8480-4a64-a26e-f66082101fc8 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 404 len: 111 microversion: 2.1 time: 0.088574 Oct 10 10:58:56.454343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2229/4360] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:56 2022] DELETE /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.460696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.461320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 021be33c-ce1d-4a4a-b57e-504bfe18e7aa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.472370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.472903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.473371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.474086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.474551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.474982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.484401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.489130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.504901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.507969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.508594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.510548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.512708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.513256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.530468 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa HTTP/1.1 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '021be33c-ce1d-4a4a-b57e-504bfe18e7aa'} Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.532058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. Oct 10 10:58:56.536909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.545384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 021be33c-ce1d-4a4a-b57e-504bfe18e7aa could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.558871 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11884c02-d6f4-41b5-acca-4451d2146270 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa" status: 404 len: 111 microversion: 2.1 time: 0.099874 Oct 10 10:58:56.559508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2132/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:56 2022] GET /compute/v2.1/servers/021be33c-ce1d-4a4a-b57e-504bfe18e7aa => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.573981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.574494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.624246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.624980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.625533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.643759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.647666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.647666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.692158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 HTTP/1.1 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '24c1eb21-579d-4a8d-9a5f-bcc17dd4d181'} Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:56.693775 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:56.698963 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:56.704444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:56.716161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-277626d1-860d-46a7-afeb-182c64f16710 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 404 len: 111 microversion: 2.1 time: 0.150344 Oct 10 10:58:56.718946 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2133/4362] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:56 2022] DELETE /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:56.729521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9cc0b-b95b-4a83-92af-b8b5f11c7386", "name": "network-vif-plugged", "status": "completed", "tag": "ef3ae10f-fa32-49ae-90cc-3531022ff232"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:56.775578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.777448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.779499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.825671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] Creating event network-vif-plugged:ef3ae10f-fa32-49ae-90cc-3531022ff232 for instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 on n-h1-860687-2 Oct 10 10:58:56.834519 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-551c16f9-859b-4876-b2ef-0a603ce82516 req-1ef81414-a13b-43b7-9268-0fa4dedab289 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114030 Oct 10 10:58:56.849488 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2134/4363] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:56.862735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:56.887167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:56.910808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.916648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.918528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:56.920796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:56.921375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:56.922144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.007021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 HTTP/1.1 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '24c1eb21-579d-4a8d-9a5f-bcc17dd4d181'} Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.009127 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. Oct 10 10:58:57.013166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.019471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:57.029923 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45777dbf-221f-4c65-98f0-0f71b95aa836 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181" status: 404 len: 111 microversion: 2.1 time: 0.177205 Oct 10 10:58:57.034693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2135/4364] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:56 2022] GET /compute/v2.1/servers/24c1eb21-579d-4a8d-9a5f-bcc17dd4d181 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:57.041183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:57.049294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:57.075054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.075947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.078802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.079961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.080654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.083252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.146736 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 HTTP/1.1 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e52d7e4b-18d2-4083-983d-42b8792cd244'} Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:57.149067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.153957 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.158276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:57.159414 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0e9143c-3085-4ea0-ba4c-c7609196717a tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 404 len: 111 microversion: 2.1 time: 0.123374 Oct 10 10:58:57.163359 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2136/4365] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:57 2022] DELETE /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:57.196583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:57.201506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:57.233564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.236409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.239757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.241947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.244034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.247764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.473490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:57.486931 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6b60217-5f42-436e-9f5c-5bfd0c852df1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1679 microversion: 2.1 time: 1.014072 Oct 10 10:58:57.491856 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2230/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:56 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1679 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:57.504420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:57.505697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: e52d7e4b-18d2-4083-983d-42b8792cd244] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:57.522554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.525201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.525759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.531135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.531648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.532177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.566188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 HTTP/1.1 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e52d7e4b-18d2-4083-983d-42b8792cd244'} Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.569342 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. Oct 10 10:58:57.574379 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.576980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance e52d7e4b-18d2-4083-983d-42b8792cd244 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:57.578357 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1925a202-68b9-4e29-9fee-d0d4d1749f0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244" status: 404 len: 111 microversion: 2.1 time: 0.085243 Oct 10 10:58:57.579143 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2231/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:57 2022] GET /compute/v2.1/servers/e52d7e4b-18d2-4083-983d-42b8792cd244 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:57.586482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:57.587563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:57.595831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.596721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.597367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.598274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.598919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.599555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:57.668359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:57.798772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:57.808722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28f14b10-ca11-49b0-9fea-6dce883a8633 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.643151 Oct 10 10:58:57.809271 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2137/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:57 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:57.819084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-234df443-ef5e-4460-bc83-314b38ee2f1c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1040837762", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83a678e6-af2a-4bfd-abfb-d737575820a9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:57.942583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-234df443-ef5e-4460-bc83-314b38ee2f1c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-234df443-ef5e-4460-bc83-314b38ee2f1c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 358 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1040837762", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83a678e6-af2a-4bfd-abfb-d737575820a9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: exception: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1040837762', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '83a678e6-af2a-4bfd-abfb-d737575820a9'}], 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:58:57.952951 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-234df443-ef5e-4460-bc83-314b38ee2f1c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Block Device 83a678e6-af2a-4bfd-abfb-d737575820a9 is not bootable. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:57.957416 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-234df443-ef5e-4460-bc83-314b38ee2f1c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.142514 Oct 10 10:58:57.959884 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2138/4369] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:58:57 2022] POST /compute/v2.1/servers => generated 110 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:58:57.963249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4423862c-a594-436e-ba4c-db5d0fae83e0", "tag": "d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:58:57.981353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:57.989871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:57.990600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.014132 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] Creating event network-changed:d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa for instance 4423862c-a594-436e-ba4c-db5d0fae83e0 on n-h2-860687-2 Oct 10 10:58:58.018817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:58.025619 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-899cad06-8e35-481a-82e5-fbf1e7dbacc6 req-5bb2a9ac-4428-4018-80ea-b466196f5413 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064460 Oct 10 10:58:58.027562 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2139/4370] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:58:58.030788 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bdc0d081-9ae8-4a89-8ce3-d6eda90ec8df tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1315 microversion: 2.1 time: 0.450136 Oct 10 10:58:58.036373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.037263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.039553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2232/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:57 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:58.045059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.045681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.058856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.059411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.059854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.060567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.061026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.061459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.062893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.063408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.064113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.065002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.065604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.066189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.084151 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 HTTP/1.1 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4bcc6ceb-f81f-420e-a994-356384f69148'} Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:58.086886 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.092845 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.094803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:58.096179 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23058f82-9494-470c-9760-b15571ecf830 tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 404 len: 111 microversion: 2.1 time: 0.065943 Oct 10 10:58:58.097919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2140/4372] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:58 2022] DELETE /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:58:58.106954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.107821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 4bcc6ceb-f81f-420e-a994-356384f69148] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.113996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:58.115886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.117289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.118536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.119696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.120315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.120889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.163592 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 HTTP/1.1 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4bcc6ceb-f81f-420e-a994-356384f69148'} Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:58:58.167367 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 4bcc6ceb-f81f-420e-a994-356384f69148 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73cd5dc7-dbff-4804-999b-a8b44bebbd1c tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148" status: 404 len: 111 microversion: 2.1 time: 0.073888 Oct 10 10:58:58.181780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2141/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:58 2022] GET /compute/v2.1/servers/4bcc6ceb-f81f-420e-a994-356384f69148 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:58:58.520094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.521010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.530872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.534141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.535677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.539182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.540447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.542676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.551823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:58.572820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9912ef0-f753-490b-abcb-5bce1ba07780 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.528685 Oct 10 10:58:58.573728 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2233/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:58 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:58.606056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.606948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.625763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.626568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.627260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.628939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.638747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.640214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.937164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:58.948507 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-767b7f84-0197-4aed-8f86-c27e93380f9f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.430814 Oct 10 10:58:58.952657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2142/4375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:58 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:58.959061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:58.959897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:58.994171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:58.994925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:58.995513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:58.998987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.000703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.003812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.040250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:59.050280 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1320b8cc-7373-4050-83e3-b1a248a0af93 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.449489 Oct 10 10:58:59.051468 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2234/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:58 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:58:59.068661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:59.069453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:59.085410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.085950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.100858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.106072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.109598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.110229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.296413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:59.312307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6df50882-9efd-42d7-b339-60204e041844 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.354770 Oct 10 10:58:59.313439 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2143/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:58 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:59.370817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:58:59.392049 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff26e1b8-3d09-4f9b-8db9-84f6fc655a0b tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1503 microversion: 2.1 time: 0.326674 Oct 10 10:58:59.409605 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2235/4378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:58:59 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:58:59.418380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:59.419184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:59.427198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.427788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.428354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.429141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.429891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.431306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.597637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:59.619717 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-861261c8-12f1-4c79-8dd9-26259e25edeb tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.206761 Oct 10 10:58:59.621949 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2144/4379] 10.222.0.16 () {58 vars in 1296 bytes} [Mon Oct 10 10:58:59 2022] DELETE /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386/os-server-password => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:58:59.642674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:59.644043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:59.648565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:58:59.666423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.675698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.676752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.678239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.679553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.681417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.802307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0349258c-1417-4a6b-ba6e-db2f0443902c tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.163856 Oct 10 10:58:59.811380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2236/4380] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Oct 10 10:58:59 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386/os-server-password => generated 16 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 10:58:59.817457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:58:59.823536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:58:59.838490 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 10:58:59.838713 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 10:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 (ip 10.222.0.16) !!! Oct 10 10:58:59.878402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.887461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.888198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.891991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:58:59.891991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:58:59.891991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:58:59.962371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:59:00.120652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:00.121273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:00.131349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.131854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.132294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.133004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.133527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.134538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.186480 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd38a499-a82f-4c9a-a2e5-72febdc695af tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 204 len: 0 microversion: 2.1 time: 0.375962 Oct 10 10:59:00.187113 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2145/4381] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:58:59 2022] DELETE /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:59:00.201722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:00.206557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:00.222463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.224120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.224563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.225275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.225731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.228325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.670686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:00.673740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:00.695896 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22e7ce6f-2c8e-43fe-8a0d-3057b12588c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.572282 Oct 10 10:59:00.696999 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2237/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:00 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:00.717713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:00.718613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:00.751702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.752218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.752660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.753389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:00.753848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:00.754281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:00.972296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:00.991740 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-116f22a3-0daf-47ff-a9a1-0c45d448e42d tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1509 microversion: 2.1 time: 0.800337 Oct 10 10:59:01.006705 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2146/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:00 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1509 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:01.246497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:01.260892 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4585f6d3-efa6-4331-a5ce-78e0b07d5e90 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.562618 Oct 10 10:59:01.264142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2238/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:00 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:02.033697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:02.035297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:02.057126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.061859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.067611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.070660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.075857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.076939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.172658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54741ff6-0eeb-443e-87c2-f6296828652e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688921422", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "destination_type": "local"}, {"source_type": "volume", "uuid": "9dfa5fe1-55f3-48b2-9e18-33648ea555fa", "destination_type": "invalid"}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54741ff6-0eeb-443e-87c2-f6296828652e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 494 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688921422", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "destination_type": "local"}, {"source_type": "volume", "uuid": "9dfa5fe1-55f3-48b2-9e18-33648ea555fa", "destination_type": "invalid"}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-688921422', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '9dfa5fe1-55f3-48b2-9e18-33648ea555fa', 'destination_type': 'invalid'}], 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:02.187793 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 10:59:02.192833 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:02.200803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54741ff6-0eeb-443e-87c2-f6296828652e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:02.202684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54741ff6-0eeb-443e-87c2-f6296828652e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.034688 Oct 10 10:59:02.207666 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2239/4385] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:02.236337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:02.243851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:02.274748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.277102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.279130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.281326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.281821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.282473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.565027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:02.577656 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d10487b1-bb0f-4d58-8d3b-a36d28870984 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1509 microversion: 2.1 time: 0.547678 Oct 10 10:59:02.580256 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2147/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:02 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:02.600469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:02.603044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:02.629496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.634589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.638408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.649660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.650322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.650771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.769394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:02.785116 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee183d88-7201-4eaf-9f0a-320ff8ff6759 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.567757 Oct 10 10:59:02.787759 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2240/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:02 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:02.819986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:02.821662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:02.829509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.830495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.831969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:02.833383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:02.834431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:02.835209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.203079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:03.216801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a94edb7-558d-4c31-a258-b9b69db57c31 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.633557 Oct 10 10:59:03.217394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2148/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:02 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:03.283457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-unplugged", "status": "completed", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:03.303115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.307153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.307838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.341904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:03.356099 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] Creating event network-vif-unplugged:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 10:59:03.356640 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1a8e73a-d78d-4aac-941c-4a514e737022 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.538458 Oct 10 10:59:03.358192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2241/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:02 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:03.378954 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6a1c9b74-25a7-49fa-b7d0-7385c560cbdf req-db30fa3d-7c1c-4276-bb37-eca9a0de3cf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099375 Oct 10 10:59:03.379508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:03.380474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:03.381262 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2149/4390] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:59:03.397875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.398800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.400956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.405924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.406727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.407587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.605911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:03.607441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:03.620510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.621020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.621466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.622202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.622668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.640100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.862647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:03.881123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bca7e274-bd11-4ee0-9899-5be1c5318b4b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.515190 Oct 10 10:59:03.885242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5912f78acc8644f38b97864163c9c9d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9edfa766d39c44e89125b6da709e8cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:03.896674 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2242/4391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:03 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:03.901057 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-356359b7-098e-44f1-a1e8-d5c6ba5df705 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 200 len: 1467 microversion: 2.1 time: 0.294632 Oct 10 10:59:03.915681 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2150/4392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:03 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 1467 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:03.923379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9cc0b-b95b-4a83-92af-b8b5f11c7386", "name": "network-vif-deleted", "tag": "ef3ae10f-fa32-49ae-90cc-3531022ff232"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:03.945327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:03.945571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bea6402-f4f7-4a01-b844-6450a5ba9050 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900461297", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:03.946430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:03.947405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bea6402-f4f7-4a01-b844-6450a5ba9050 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 492 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1900461297", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1900461297', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.957137 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:03.960089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bea6402-f4f7-4a01-b844-6450a5ba9050 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:03.964607 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bea6402-f4f7-4a01-b844-6450a5ba9050 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.039520 Oct 10 10:59:03.971278 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2243/4393] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:03 2022] POST /compute/v2.1/servers => generated 624 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:03.983274 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] Creating event network-vif-deleted:ef3ae10f-fa32-49ae-90cc-3531022ff232 for instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 on n-h1-860687-2 Oct 10 10:59:03.984300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:03.987238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:03.999646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-757055ca-cc67-441e-a138-b3abf317ce81 req-4c808964-ca77-4eff-9c9a-aa631a3a9899 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082382 Oct 10 10:59:04.001549 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2151/4394] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:04.009411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.011305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.013553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.014582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.015335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.017088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.017651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:04.021070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:04.033336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.033777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.034217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.038412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.041665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.042119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.654794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:04.668141 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68d7f997-c765-4224-9a88-7eadfea6e7ed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.662216 Oct 10 10:59:04.680192 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2152/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:04 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:04.699946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:04.700883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:04.708789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.709628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.710361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.711457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.713462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.714089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.746436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:04.761919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f3d8e23-8b72-4c98-8140-871da0673607 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.786013 Oct 10 10:59:04.762897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2244/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:03 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:04.782837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:04.786374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:04.830865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.832049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.833826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:04.836098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:04.839482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:04.840886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.191529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:05.202630 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc24eba1-71a7-461f-92e9-c5c42ad9ae06 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.435038 Oct 10 10:59:05.203331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2245/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:04 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:05.215356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.216257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.234857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.235445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:05.235928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.236634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.238492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.239346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.239882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.252903 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d65a8ad8-046c-4da4-9b04-1a1ecf5f0efd tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.570717 Oct 10 10:59:05.269633 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2153/4398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:04 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:05.277694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.279640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] [instance: 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.298084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.303912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.304485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.306003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.306502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.306952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.338663 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] HTTP exception thrown: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Request method failure captured: Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 HTTP/1.1 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_rajX91JD44trtslIy9F6-uFYGd-j7ErmFSChbwGaet3I9_iyinw_vctB4p1pNZ7AHyMQrfOxZFqULw76y4Q3EtMzzwSFLMuFnueIB-hx1TZfHd-3pZ5U_vmW7R7zy6SIpxSXh5twNb75hiJlfuZfq0S-ttsEW3J7MzxZRd9e3RS4I Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 9edfa766d39c44e89125b6da709e8cbb Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerPasswordTestJSON-850611450 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9edfa766d39c44e89125b6da709e8cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9edfa766d39c44e89125b6da709e8cbb", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9edfa766d39c44e89125b6da709e8cbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9edfa766d39c44e89125b6da709e8cbb"}]}] Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerPasswordTestJSON-850611450 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 9edfa766d39c44e89125b6da709e8cbb Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerPasswordTestJSON-850611450 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerPasswordTestJSON-850611450-project Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5912f78acc8644f38b97864163c9c9d3 Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerPasswordTestJSON-850611450-project Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7aa9cc0b-b95b-4a83-92af-b8b5f11c7386'} Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.344818 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] Returning 404 to user: Instance 7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5abcbed2-c48e-4dcf-b565-f2709db75272 tempest-ServerPasswordTestJSON-850611450 tempest-ServerPasswordTestJSON-850611450-project] 10.222.0.16 "GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386" status: 404 len: 111 microversion: 2.1 time: 0.075012 Oct 10 10:59:05.348966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2154/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/7aa9cc0b-b95b-4a83-92af-b8b5f11c7386 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:05.363429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.363958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.373576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.374755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.375922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.377026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.377694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.378320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.401173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d HTTP/1.1 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '6c86870b-f556-4380-927d-029fbf5ed30d'} Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:05.403687 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:05.408229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e98ae6db-ea9e-457e-aec4-b66dea020afe tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 404 len: 111 microversion: 2.1 time: 0.047325 Oct 10 10:59:05.410765 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2155/4400] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:05 2022] DELETE /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:05.418003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed552a35-1056-4834-babf-f181066f986b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed552a35-1056-4834-babf-f181066f986b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 416 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.422044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed552a35-1056-4834-babf-f181066f986b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed552a35-1056-4834-babf-f181066f986b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012085 Oct 10 10:59:05.426716 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2156/4401] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:05.434012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.435621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 6c86870b-f556-4380-927d-029fbf5ed30d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.445214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.446208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.446860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.447791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.448438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.449381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.458718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:05.478924 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5a46c32-5f77-4f50-994a-c17e7e996b5d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.273702 Oct 10 10:59:05.480729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2246/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:05.491888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.494915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.498902 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d HTTP/1.1 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '6c86870b-f556-4380-927d-029fbf5ed30d'} Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.501208 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. Oct 10 10:59:05.505461 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.507444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 6c86870b-f556-4380-927d-029fbf5ed30d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:05.509241 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d58ac48-4730-47a1-b4fc-1204a38cac0f tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d" status: 404 len: 111 microversion: 2.1 time: 0.083163 Oct 10 10:59:05.510508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2157/4403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/6c86870b-f556-4380-927d-029fbf5ed30d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:05.513958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.515616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.516293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:05.517825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.519439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.520056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.520185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.520543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.530084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.531698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.532339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.533661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.534944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.535589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.705581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-246e148e-678b-4940-9403-497d5bd8af9e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.193383 Oct 10 10:59:05.706298 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2158/4404] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:05 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:05.732131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:05.737494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.738834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.745020 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58ef08d6-77ee-4e72-8114-8f424c667aed tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.262148 Oct 10 10:59:05.752318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2247/4405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:05.762102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.762805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.791379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.791949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.792915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.793711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.794246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.794747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.816121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.819960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.823848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:05.825808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.827179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f HTTP/1.1 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f'} Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:05.828242 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:05.832058 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21a0de29-bf8c-44e0-a64c-7dad55f08a5e tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 404 len: 111 microversion: 2.1 time: 0.121852 Oct 10 10:59:05.834154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.834467 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2159/4406] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:05 2022] DELETE /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:05.840237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:05.840942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:05.841727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.850201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.851046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.851672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:05.853106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:05.853896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:05.854551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.152315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:06.168059 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90c5334f-1854-4a87-974d-40e89e1fb106 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.328898 Oct 10 10:59:06.169015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2160/4407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:06.190675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:06.193288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] [instance: 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:06.225355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.226144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.226670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.228713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.229397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.229833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.250366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:06.258657 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] HTTP exception thrown: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Request method failure captured: Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f HTTP/1.1 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_mnBFU4D79dTIbn7iVw7N0kFE9q2zRkwNcB7nSfDLRg8GZkWuWhm0z9kGrv0J6fRV-m9dU6KK67pkjJqXEythIJkN2RWc9lORoLv2PiaaVNJHSz9qSdY8mYySNFRslTvIoj39z63999TneCd0KuVMUJ33KEj86EaPknQgVZzolvVw4 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9eea9b98dbc4d23b017c1db8b43b9b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9eea9b98dbc4d23b017c1db8b43b9b5"}]}] Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a9eea9b98dbc4d23b017c1db8b43b9b5 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909942423 Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a6bba7b21c494fd4ab609113f1e9168a Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1909942423-project Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f'} Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:06.260264 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] Returning 404 to user: Instance 0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:06.265525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8037fd54-1b76-4b6e-af7b-b3144d735dbd tempest-DeleteServersTestJSON-1909942423 tempest-DeleteServersTestJSON-1909942423-project] 10.222.0.16 "GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f" status: 404 len: 111 microversion: 2.1 time: 0.089440 Oct 10 10:59:06.272363 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c1837d4-4b67-4221-b8d0-8df71ee8f4bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1668 microversion: 2.1 time: 0.509522 Oct 10 10:59:06.274709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2248/4408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:05 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1668 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:06.276215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2161/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:06 2022] GET /compute/v2.1/servers/0cf7b94a-d9c2-43fc-9a3a-abfe89aaaa5f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:06.282718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423862c-a594-436e-ba4c-db5d0fae83e0", "name": "network-vif-plugged", "status": "completed", "tag": "d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:06.289969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:06.290836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:06.307706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.308581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.309656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.310844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.312131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.312725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.318547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.324381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.325188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.355190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] Creating event network-vif-plugged:d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa for instance 4423862c-a594-436e-ba4c-db5d0fae83e0 on n-h2-860687-2 Oct 10 10:59:06.378366 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0b9f2ce1-3702-43b5-9de2-71b29c571b54 req-660b5e97-acec-46bd-8a90-7f2c89baafe5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102121 Oct 10 10:59:06.383450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2249/4410] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:06.431273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-133fa5ca-4c95-4858-9ec5-1e1e2a681b0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-875512733", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": -1, "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:06.455267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-133fa5ca-4c95-4858-9ec5-1e1e2a681b0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Flavor -1 could not be found. Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-133fa5ca-4c95-4858-9ec5-1e1e2a681b0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 205 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-875512733", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": -1, "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: exception: Flavor -1 could not be found. Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-875512733', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': -1, 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:06.457550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 10 10:59:06.461612 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:06.467908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-133fa5ca-4c95-4858-9ec5-1e1e2a681b0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:06.469135 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-133fa5ca-4c95-4858-9ec5-1e1e2a681b0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.042833 Oct 10 10:59:06.471067 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2250/4411] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 10:59:06.484412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:06.495968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:06.509202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.510106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.514125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:06.515279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:06.516268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:06.516931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:07.028297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:07.038963 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fc37b53-a105-4a5f-8a76-19599d6eb9ac tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1326 microversion: 2.1 time: 0.761405 Oct 10 10:59:07.040108 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2162/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:06 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1326 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:07.079389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:07.087525 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d89d9e4b-f520-4409-863c-18582f6f2b84 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.612760 Oct 10 10:59:07.099780 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2251/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:06 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:07.140127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:07.140752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:07.149589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:07.158569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:07.159606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:07.160384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:07.172296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:07.173221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:07.302379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:07.303570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:07.329419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:07.330446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:07.333763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:07.334977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:07.337553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:07.341463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:08.000746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:08.016121 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2450af23-e8e5-48fd-bbac-c8e4676c1650 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.880030 Oct 10 10:59:08.017101 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2163/4414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:07 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:08.068681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:08.070534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:08.097293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:08.098693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:08.099797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:08.100314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:08.104104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:08.106150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:08.106632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:08.113337 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af4c5bad-11cc-40c6-ba47-86fb781017f2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1668 microversion: 2.1 time: 0.818492 Oct 10 10:59:08.117266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2252/4415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:07 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1668 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:08.119878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=93,nova_cell1:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:08.169875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-565a1b0a-dfbf-43c1-840a-3bc411af2078 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788475343", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-565a1b0a-dfbf-43c1-840a-3bc411af2078 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 173 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788475343", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1788475343', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi -1 Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:08.174469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-565a1b0a-dfbf-43c1-840a-3bc411af2078 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-565a1b0a-dfbf-43c1-840a-3bc411af2078 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.012408 Oct 10 10:59:08.184337 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2253/4416] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:08.186532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:08.187258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:08.198143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:08.198708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:08.199235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:08.200326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:08.200979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:08.201635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.257990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:09.273820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28ee9d33-a8a6-4ad3-bbb6-fc135431a58b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.090993 Oct 10 10:59:09.275576 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2254/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:08 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:09.282128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:09.283031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:09.290571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.291467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.292098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.292991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.293631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.294280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.403818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:09.417874 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1b44fc7-e710-4559-8407-4ffd051dcd37 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1526 microversion: 2.1 time: 1.354636 Oct 10 10:59:09.422337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2164/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:08 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1526 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:09.431646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:09.438059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:09.456515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.462553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.464067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.468012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.468747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.469413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.935530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:09.950586 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7182e023-2b59-41a8-98ad-1bf9e2b9dead tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.671059 Oct 10 10:59:09.951612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2255/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:09.970448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:09.971107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:09.977573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.978285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.978922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:09.979864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:09.980490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:09.981085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.001542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:10.022582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6be3c0cf-c3c8-4d55-817d-2d1fb3fc0d7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.597755 Oct 10 10:59:10.026986 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2165/4420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:09 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:10.045558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:10.053963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:10.077342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.079256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.081022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.081954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.084383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.085541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.147593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89f47dcb-ea23-42ad-81ba-755e568f249b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 200 len: 322 microversion: 2.1 time: 0.118780 Oct 10 10:59:10.149527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2166/4421] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:10 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 322 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:10.157471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4af6dcb7-755f-4058-b751-6bf552b73fbf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1684587597", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:10.163286 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4af6dcb7-755f-4058-b751-6bf552b73fbf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4af6dcb7-755f-4058-b751-6bf552b73fbf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 216 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1684587597", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1684587597', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:10.166714 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 10:59:10.171244 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:10.173316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4af6dcb7-755f-4058-b751-6bf552b73fbf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:10.174953 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4af6dcb7-755f-4058-b751-6bf552b73fbf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023645 Oct 10 10:59:10.176256 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2167/4422] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:10 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:10.183517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:10.184825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:10.193231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.194008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.194890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.196073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.197039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.197671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.562086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:10.577856 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11025e22-140b-4e1c-b6eb-db37ff273adf tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1526 microversion: 2.1 time: 0.624965 Oct 10 10:59:10.583545 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2256/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:09 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1526 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:10.590867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:10.594846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:10.625770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.640288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.648895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:10.652695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:10.657013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:10.659473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.057316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:11.069478 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b0818fc-dd20-456c-bc36-c8f7ce83e7c4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.889832 Oct 10 10:59:11.087876 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2168/4424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:10 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:11.348151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:11.377150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3cff84fb-e938-417e-800b-acaedf739f40 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.792443 Oct 10 10:59:11.377750 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2257/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:10 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:11.398140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:11.398140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:11.424212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.424641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.425084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.425809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.426273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.426708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.561920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:11.563915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:11.574467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.575483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.576169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.577204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.577933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.578595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.604140 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] HTTP exception thrown: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Request method failure captured: Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 HTTP/1.1 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_rhMTIWWALDkoDQQdJUwsA7H11RLzqDh8QkVtT8eRvhYnVho9eZr5Gl-h1B2kHYDvYmKJ6tsb3mzam3ZlicTBQwCLpAgfP670w9ITN_i9640WJzxjBjPEv-RoB0UppmAA0pHi4gav3sG3OiMEZfLsEAQJU7XdgLUExwUU5Gg6owMo4 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 5f64927116fa4db6bb537f9fb53f3ed4 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f64927116fa4db6bb537f9fb53f3ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f64927116fa4db6bb537f9fb53f3ed4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f64927116fa4db6bb537f9fb53f3ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f64927116fa4db6bb537f9fb53f3ed4"}]}] Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 5f64927116fa4db6bb537f9fb53f3ed4 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestMultiTenantJSON-186155017-project Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 6ea5393bf52147eb920c4168daf3abc0 Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017-project Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4423862c-a594-436e-ba4c-db5d0fae83e0'} Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:11.605734 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:11.610481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Returning 404 to user: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:11.631377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0df1ec4-aa39-4c32-a99d-d4b455680a7f tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 404 len: 111 microversion: 2.1 time: 0.518078 Oct 10 10:59:11.632065 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2169/4426] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:11 2022] DELETE /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 111 bytes in 543 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:11.637411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:11.638349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:11.647198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.652466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.652934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.654540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.655092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.655623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.846115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:11.857418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a141aea-986d-42d7-99d5-b911904364d2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.469636 Oct 10 10:59:11.858776 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2258/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:11.866671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:11.874852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:11.884832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.885716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.886964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.888012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:11.888709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:11.889503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:11.917419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:12.131787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:12.141396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5833c32e-bc8b-49be-91a2-6731dfa261db tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.508159 Oct 10 10:59:12.163685 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2170/4428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:11 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:12.168695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:12.172003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:12.181564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.183498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.184914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.186535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.188221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.189063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.390407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:12.401643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2d23460d-9435-4af4-a95f-67cc6aac98e6 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1526 microversion: 2.1 time: 0.539220 Oct 10 10:59:12.403955 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2259/4429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:11 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1526 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:12.433525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Action: 'update', calling method: >, body: {"server": {"name": "4423862c-a594-436e-ba4c-db5d0fae83e0_new"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:12.436872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:12.443999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.444925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.445830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.446763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.447590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.448248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.466883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] HTTP exception thrown: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Request method failure captured: Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: request: PUT /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 HTTP/1.1 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 64 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_rhMTIWWALDkoDQQdJUwsA7H11RLzqDh8QkVtT8eRvhYnVho9eZr5Gl-h1B2kHYDvYmKJ6tsb3mzam3ZlicTBQwCLpAgfP670w9ITN_i9640WJzxjBjPEv-RoB0UppmAA0pHi4gav3sG3OiMEZfLsEAQJU7XdgLUExwUU5Gg6owMo4 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5f64927116fa4db6bb537f9fb53f3ed4 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f64927116fa4db6bb537f9fb53f3ed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f64927116fa4db6bb537f9fb53f3ed4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f64927116fa4db6bb537f9fb53f3ed4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f64927116fa4db6bb537f9fb53f3ed4"}]}] Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5f64927116fa4db6bb537f9fb53f3ed4 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestMultiTenantJSON-186155017-project Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 6ea5393bf52147eb920c4168daf3abc0 Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-186155017-project Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "4423862c-a594-436e-ba4c-db5d0fae83e0_new"}} Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4423862c-a594-436e-ba4c-db5d0fae83e0', 'body': {'server': {'name': '4423862c-a594-436e-ba4c-db5d0fae83e0_new'}}} Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:12.470777 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:12.475211 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:12.481402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] Returning 404 to user: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:12.483464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a71d79b-c0b7-4256-8847-5ce3cc698337 tempest-ServersNegativeTestMultiTenantJSON-186155017 tempest-ServersNegativeTestMultiTenantJSON-186155017-project] 10.222.0.16 "PUT /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 404 len: 111 microversion: 2.1 time: 0.055515 Oct 10 10:59:12.487655 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2260/4430] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 10:59:12 2022] PUT /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:12.499083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1552457322", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-key-2004314080", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:12.579181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] validate_networks() for [('1b38c6a3-c663-47a3-b4dc-a29014f67d9c', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:59:12.888240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:12.900479 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fefc5a2b-9f26-4b4f-a809-1b479ae9cfa5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.750432 Oct 10 10:59:12.902738 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2171/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:12 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:12.909504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:12.910586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:12.918657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.919760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.920552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.922331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:12.923328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:12.924707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:12.969633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:59:13.106204 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1793e2b5-ba8e-47de-acce-a77e6ebb2f9b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 204 len: 0 microversion: 2.1 time: 0.201478 Oct 10 10:59:13.109934 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2172/4432] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:12 2022] DELETE /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:59:13.118247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:13.119231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:13.126471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.126963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.127434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.128252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.128744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.129332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.235929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Invalid key_name provided. Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 247 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1552457322", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-key-2004314080", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid key_name provided. Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1552457322', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'key_name': 'tempest-key-2004314080', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2004314080 not found for user a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:13.241206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 10 10:59:13.246489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:13.250685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid key_name provided. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:13.251534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-746b90ae-2b72-4344-924e-30a5db4e7e33 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.765774 Oct 10 10:59:13.252139 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2261/4433] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:12 2022] POST /compute/v2.1/servers => generated 70 bytes in 767 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 10:59:13.267911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:13.268540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:13.276295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.277088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.277720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.279102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.279732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.280317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.524828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:13.542306 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a39aa28-667e-4f35-b0f9-b0671b239047 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.426187 Oct 10 10:59:13.543851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2173/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:13 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:13.551623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:13.553278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:13.571159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.573944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.574394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.580609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:13.581220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:13.581671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:13.613201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:13.629727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-415d8040-876f-474c-9716-815937cc8bea tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1532 microversion: 2.1 time: 0.374082 Oct 10 10:59:13.630386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2262/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:13 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1532 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:13.739170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-644486179", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "d4170c24-8757-45a8-8f28-ac22cc23fbd1"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:13.866817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] validate_networks() for [('d4170c24-8757-45a8-8f28-ac22cc23fbd1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:59:14.154650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:14.171396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9116c530-6ec7-4aa5-946d-984f5ffeecc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.623707 Oct 10 10:59:14.173654 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2174/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:13 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:14.202952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:14.204791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:14.214657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:14.215775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:14.216574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:14.218024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:14.218845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:14.219735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.013455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:15.024406 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-516f7b9a-6c10-47b7-9e6b-a891a46fe506 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.828993 Oct 10 10:59:15.025796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2175/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:14 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:15.035872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:15.036867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:15.055388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.055915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.056790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.057712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.059913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.060569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.178044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lazy-loading 'services' on Instance uuid 969baf85-599d-400b-992d-75da6a55c660 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:59:15.313240 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c46ff69a-ac0f-470c-bb4b-a029e4863baf tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660/os-volume_attachments/fa77c70d-93da-470c-bec3-776a0de328ae" status: 202 len: 0 microversion: 2.1 time: 0.285537 Oct 10 10:59:15.319336 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2176/4438] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 10:59:15 2022] DELETE /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660/os-volume_attachments/fa77c70d-93da-470c-bec3-776a0de328ae => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:15.328303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:15.330522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:15.340248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.341564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.342396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.343402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.344175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.344872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.692327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:15.702738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88505031-5f0d-46d6-90b6-d67b9cf9942b tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1532 microversion: 2.1 time: 0.381361 Oct 10 10:59:15.719909 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2177/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:15 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1532 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:15.724734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:59:15.725268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:59:15.725740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:59:15.726157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:59:15.726588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:59:15.728140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-90048661", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:15.748758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.749247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.749685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.750516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:15.750981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:15.751530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:15.785890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:59:15.818720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:59:15.845075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:59:15.847543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:59:15.959208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-123a8eb1-6fc0-418d-89a6-2823dbb3abb3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224164 Oct 10 10:59:15.966028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Neutron security group does_not_exist not found {{(pid=128801) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 10 10:59:15.966775 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.967364 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2263/4440] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 10:59:15.979988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a6ce1b4-1525-4ff0-9f15-31ebb261e330 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:15.980773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a6ce1b4-1525-4ff0-9f15-31ebb261e330 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 256 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-90048661", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-90048661', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 10 10:59:15.981819 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:15.985881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:15.989527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93108320-ff1a-4361-b141-d9ffb415648e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.261969 Oct 10 10:59:15.989527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2178/4441] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:15 2022] POST /compute/v2.1/servers => generated 106 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:16.005570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:16.007519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:16.022177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.022855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.027373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.029276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.029836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.030291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.153113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0a6ce1b4-1525-4ff0-9f15-31ebb261e330 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:16.163503 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a6ce1b4-1525-4ff0-9f15-31ebb261e330 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1214 microversion: 2.1 time: 0.194492 Oct 10 10:59:16.164634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2264/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:15 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:16.188224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4423862c-a594-436e-ba4c-db5d0fae83e0", "name": "network-vif-deleted", "tag": "d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:16.209091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.209587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.210022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.246869 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] Creating event network-vif-deleted:d3bd5fc3-98c4-4368-85b0-94b8e5fe7dfa for instance 4423862c-a594-436e-ba4c-db5d0fae83e0 on n-h2-860687-2 Oct 10 10:59:16.253233 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-30d21f6e-215e-49bd-b641-555f132be9d7 req-1b8d09f0-344e-4967-bda5-aa4bd9f44c0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078346 Oct 10 10:59:16.254420 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2265/4443] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:16.491774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:16.507403 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c79b873-5154-41a9-986d-4e1b12f09608 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.514324 Oct 10 10:59:16.523055 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2179/4444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:15 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:16.534482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:16.535692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:16.550161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.551934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.554039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.557355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.558502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.562825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.734242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:16.735066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:16.746069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.754402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.757561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.759667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.761932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.764502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.862572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:16.863310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:16.863926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:16.865109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lazy-loading 'fault' on Instance uuid 4423862c-a594-436e-ba4c-db5d0fae83e0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:59:17.031374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58587085946c485f97c924590a060418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29dec10958344687a10fa30f85f452dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:17.040706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c0f629b-fcf7-450d-b183-044c43fd54a8 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 200 len: 1316 microversion: 2.1 time: 0.312145 Oct 10 10:59:17.059032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2180/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:16 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:17.192416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:17.193042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:17.198991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:17.201519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.202026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.202470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:17.203213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.203668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.208817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:17.212066 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ecebfdb3-f0bd-4a2e-8033-f4ae6c184df9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.682146 Oct 10 10:59:17.217022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:17.231537 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2266/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:16 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:17.244725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:17.250219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:17.263255 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 HTTP/1.1 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5'} Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:17.265409 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. Oct 10 10:59:17.269502 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:17.270900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:17.271945 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2758f56-c0f5-49e8-b092-6d970d6ec979 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5" status: 404 len: 111 microversion: 2.1 time: 0.032050 Oct 10 10:59:17.272699 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2267/4447] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:17 2022] DELETE /compute/v2.1/servers/f4fd2be6-36ee-4f66-8f80-f5f2fa7e11c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:59:17.281607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:17.282479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:17.289687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.290454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.291137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:17.292047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.292675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.293281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:17.537742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:17.547070 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51b7d98c-6e7c-4ba9-b649-2affadb5a4c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1210 microversion: 2.1 time: 0.359122 Oct 10 10:59:17.553416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2181/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:17 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1210 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:17.740753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:17.749149 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c89e94eb-5994-4032-9e30-fefebef993b6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.471441 Oct 10 10:59:17.750338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2268/4449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:17 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:17.783141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:17.783785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:17.818263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.818954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.819572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:17.822714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:17.823365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:17.824358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.068826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:18.069687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] [instance: 4423862c-a594-436e-ba4c-db5d0fae83e0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:18.108993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.110076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.112947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.118699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.119851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.122697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.182591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:18.196770 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ad1f036-de32-420d-a8f4-a36714558539 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.423375 Oct 10 10:59:18.199214 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2182/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:17 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:18.229819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:18.230583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:59:18.231642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 9223372036854775808 could not be found. Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9223372036854775808'} Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.233651 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:18.237612 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:18.237612 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:18.237612 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:18.237612 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 10 10:59:18.237612 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.242041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:18.245583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] HTTP exception thrown: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:18.246432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0386a52c-d4f6-4c6e-838e-9c1216a86569 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021194 Oct 10 10:59:18.247622 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2183/4451] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 10 10:59:18 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Request method failure captured: Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 HTTP/1.1 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_rHY0vh0nyF2fKLbBtbHZnFTRpsKomLSZv92SRbTJBEYK3g9IG-pqm4SvXIf5EOSGX4B_mSpDVAijT7CLybXXpNAWVE-hUJj5cOm472AzFBn-xlAQRcR4NHNrg7w0orCjOeXEPG9WJm1Yfwp5hkAnqUN3JXdA-qhBXxFH6gQ2L-0b8 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 29dec10958344687a10fa30f85f452dd Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1417760124 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29dec10958344687a10fa30f85f452dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29dec10958344687a10fa30f85f452dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29dec10958344687a10fa30f85f452dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29dec10958344687a10fa30f85f452dd"}]}] Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1417760124 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 29dec10958344687a10fa30f85f452dd Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1417760124 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1417760124-project Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 58587085946c485f97c924590a060418 Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1417760124-project Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '4423862c-a594-436e-ba4c-db5d0fae83e0'} Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:18.255853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. Oct 10 10:59:18.260853 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:18.263598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] Returning 404 to user: Instance 4423862c-a594-436e-ba4c-db5d0fae83e0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:18.266696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:18.267869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:18.270346 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17941440-ae2c-4c15-aea9-01bd517d5501 tempest-ServersNegativeTestMultiTenantJSON-1417760124 tempest-ServersNegativeTestMultiTenantJSON-1417760124-project] 10.222.0.16 "GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0" status: 404 len: 111 microversion: 2.1 time: 0.205081 Oct 10 10:59:18.273224 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2269/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:18 2022] GET /compute/v2.1/servers/4423862c-a594-436e-ba4c-db5d0fae83e0 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:18.290358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.292077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.293381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.295816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.296560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.298632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.579711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:18.580350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:18.603666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.605925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.608098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.612993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.613883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.614572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.644151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:18.660801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-248424b7-d9f3-4d03-9a0f-e2a353732ef9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.407507 Oct 10 10:59:18.664959 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2184/4453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:18 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:18.692739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:18.694031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:18.705372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.706192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.706865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.726379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:18.728221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:18.730766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:18.787602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:18.813304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0fa10ce-6965-413c-8a7c-11d6340ea74b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1272 microversion: 2.1 time: 0.235383 Oct 10 10:59:18.833240 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2270/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:18 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:19.000519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:19.013034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b19d7f84-1b0c-43e0-9707-976c7d4552da tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.324928 Oct 10 10:59:19.016353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2185/4455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:18 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:19.038080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:19.038827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Failed to fetch instance by id -1 {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 10:59:19.040075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance -1 could not be found. Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance -1 could not be found. Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '-1'} Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:19.042099 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:19.046774 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:19.046774 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:19.046774 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 10 10:59:19.046774 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.047774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:19.048811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e2b44740-ac66-4192-b508-7d583fd54dcd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014785 Oct 10 10:59:19.055742 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2271/4456] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 10:59:19 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:59:19.061433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:19.062139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:19.076756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.077400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.077852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.078581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.080649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.081933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.455970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:19.469711 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e91c1e2-6d84-41e9-996d-44bc349120fa tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.412634 Oct 10 10:59:19.476033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2186/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:19 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:19.501293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:19.501953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:19.509474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.510120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.514697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.516634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.517124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.517573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.842599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:19.843724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:19.857826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:19.859785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:19.862279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.864795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.867478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.868493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.871615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61f79e89-07f2-46ae-a52b-335a5abaf582 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.374810 Oct 10 10:59:19.872223 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2272/4458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:19 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:19.872559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.874578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.898148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:19.899405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: be4c3bcb-aabb-4f8b-871a-5e37f461109b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:19.907089 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/be4c3bcb-aabb-4f8b-871a-5e37f461109b/action HTTP/1.1 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 19 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: {"forceDelete": {}} Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'be4c3bcb-aabb-4f8b-871a-5e37f461109b', 'body': {'forceDelete': {}}} Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:19.912607 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:19.918439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:19.918439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:19.918439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. Oct 10 10:59:19.918439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:19.919655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance be4c3bcb-aabb-4f8b-871a-5e37f461109b could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:19.920686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-51ce9608-a072-4f1a-9fc5-b771895c75b3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/be4c3bcb-aabb-4f8b-871a-5e37f461109b/action" status: 404 len: 111 microversion: 2.1 time: 0.026512 Oct 10 10:59:19.921427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2273/4459] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:19 2022] POST /compute/v2.1/servers/be4c3bcb-aabb-4f8b-871a-5e37f461109b/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:59:19.932923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:19.935251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:19.948147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.948654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.949102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:19.949812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:19.955761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:19.957760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:20.168001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:20.178400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-299b9d6c-5e5f-476a-bbe9-765032bd0994 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1272 microversion: 2.1 time: 0.342641 Oct 10 10:59:20.191898 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2187/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:19 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:20.296052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:20.305493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-511c22eb-48aa-4880-9b3c-31d229639e6b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.378335 Oct 10 10:59:20.312186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2274/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:19 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:20.342013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:20.346834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:20.387251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:20.387756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:20.388196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:20.404633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:20.411894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:20.412603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:20.673746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:20.684377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74a2e88c-14a3-4c0c-9994-a1923cfb2656 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.346784 Oct 10 10:59:20.686412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2188/4462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:20 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:20.709132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:20.712347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 553d6899-69ae-463a-b7f9-4d6452d9dc7f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:20.719946 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/553d6899-69ae-463a-b7f9-4d6452d9dc7f/action HTTP/1.1 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 39 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: {"os-getConsoleOutput": {"length": 10}} Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '553d6899-69ae-463a-b7f9-4d6452d9dc7f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:20.724183 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. Oct 10 10:59:20.729636 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:20.732697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 553d6899-69ae-463a-b7f9-4d6452d9dc7f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:20.734530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f005034-212b-46b9-8d7f-76645eea4eeb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/553d6899-69ae-463a-b7f9-4d6452d9dc7f/action" status: 404 len: 111 microversion: 2.1 time: 0.029394 Oct 10 10:59:20.740658 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2275/4463] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:20 2022] POST /compute/v2.1/servers/553d6899-69ae-463a-b7f9-4d6452d9dc7f/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:20.747100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:20.747843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:20.768095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:20.775524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:20.776152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:20.777052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:20.777711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:20.778476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.100444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:21.118886 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f32b67c3-d4c6-4bdd-8711-a0a3ffdd05f8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.377814 Oct 10 10:59:21.128783 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2189/4464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:20 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:21.156354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:21.156986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:21.177241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.180537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.181079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.181836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.182310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.182747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.205007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:21.206034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:21.222789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.226325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.227612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.228894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.231347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.232071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.327908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:21.343270 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c6ed86b-cb78-46c3-9870-d003e57f656f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1272 microversion: 2.1 time: 0.142409 Oct 10 10:59:21.369320 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2190/4465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:21 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:21.537690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:21.564563 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d57ada5-7206-4a75-8dc4-19628c8d30a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.411596 Oct 10 10:59:21.599976 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2276/4466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:21 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:21.614810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:21.616110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 75243fbb-2cd0-4e30-a82e-0308b94bdcd9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:21.639333 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/75243fbb-2cd0-4e30-a82e-0308b94bdcd9 HTTP/1.1 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '75243fbb-2cd0-4e30-a82e-0308b94bdcd9'} Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:21.645458 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:21.650109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:21.650109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:21.650109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:21.650109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. Oct 10 10:59:21.650109 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:21.652755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 75243fbb-2cd0-4e30-a82e-0308b94bdcd9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:21.668667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c948f59-6064-470b-9f74-470d3fce60d7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/75243fbb-2cd0-4e30-a82e-0308b94bdcd9" status: 404 len: 111 microversion: 2.1 time: 0.072511 Oct 10 10:59:21.675543 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2191/4467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:21 2022] GET /compute/v2.1/servers/75243fbb-2cd0-4e30-a82e-0308b94bdcd9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:21.680382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:21.681327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:21.692890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.694131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.696159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:21.698637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:21.700051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:21.702162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.030762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:22.039612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a23af99f-ea91-4413-8854-a2af86f4fc9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.364819 Oct 10 10:59:22.046767 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2277/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:21 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:22.069705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:22.073389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:22.085546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.086859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.087610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.088841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.089844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.091197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.378455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:22.379607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:22.392430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.396120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.399717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.402294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.403528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.403995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.465622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:22.474066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac7124ae-1b41-4611-afd8-88cb2bffd26d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.411041 Oct 10 10:59:22.474663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2192/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:22 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:22.679262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd2ed694-48e4-4658-adad-2a7ddd28c28f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1410876236", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd2ed694-48e4-4658-adad-2a7ddd28c28f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 238 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1410876236", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1410876236', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.697934 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 10:59:22.702760 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:22.708369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd2ed694-48e4-4658-adad-2a7ddd28c28f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:22.709311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd2ed694-48e4-4658-adad-2a7ddd28c28f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035055 Oct 10 10:59:22.710380 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2193/4470] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:22.722893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:22.723831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:22.749272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.750081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.751530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.755849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:22.760324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:22.760996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:22.844979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:22.859947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6d4a4f0-441a-4237-aabd-a482be5f2e5a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.489552 Oct 10 10:59:22.860745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2278/4471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:22 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:23.214697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:23.231739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5883ed7e-9420-44aa-aef3-9711d3b7e90c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.515605 Oct 10 10:59:23.232624 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2194/4472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:22 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:23.262542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:23.263774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:23.276941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.277774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.278414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:23.283990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.284922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.285567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:23.537098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:23.546446 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b212f98-045f-40ef-89f9-512b1b746a9d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.290455 Oct 10 10:59:23.564779 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2279/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:23 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:23.641345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b45ad944-28e9-4b3b-a1b9-2d5a14d96803 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1480933400", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b45ad944-28e9-4b3b-a1b9-2d5a14d96803 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 235 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1480933400", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1480933400', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.649999 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 10:59:23.655051 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:23.657982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b45ad944-28e9-4b3b-a1b9-2d5a14d96803 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:23.659163 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b45ad944-28e9-4b3b-a1b9-2d5a14d96803 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026700 Oct 10 10:59:23.660484 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2195/4474] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:23.669031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:23.669648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:23.683826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.684661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.685398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:23.686512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.687211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.687918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:23.886328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:23.887743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:23.900584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.901500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.902410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:23.903386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:23.904074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:23.905304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.208568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:24.222922 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73ef4480-9810-4e63-869f-15f02e64ea9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.556602 Oct 10 10:59:24.224402 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2280/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:23 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:24.249178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:24.249813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:24.252004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:24.257264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.257870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.258321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.259103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.259665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.260277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.449844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:24.460270 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16681b5c-752d-4d6b-aa2c-ac3d1df0e78e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.578928 Oct 10 10:59:24.463966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2196/4476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:23 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:24.514470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:24.516390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:24.537755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.539596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.540220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.542239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.547095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.547561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.600170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 10:59:24.766725 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5e6360f-0e97-48af-ba9c-1e5d5553654c tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "DELETE /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 204 len: 0 microversion: 2.1 time: 0.263006 Oct 10 10:59:24.767611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2197/4477] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 10:59:24 2022] DELETE /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 10:59:24.776940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:24.777938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:24.784739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.785489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.786256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.787243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:24.787894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:24.788615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:24.891508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:24.921737 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-60af76a9-708b-45bb-9692-6bea8ef7d3dc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.665328 Oct 10 10:59:24.939319 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2281/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:24 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:24.961850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:24.965445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 30e5001a-10f6-4d31-bd2a-4aded9af16fa] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:24.976960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/30e5001a-10f6-4d31-bd2a-4aded9af16fa/action HTTP/1.1 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 13 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: {"pause": {}} Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '30e5001a-10f6-4d31-bd2a-4aded9af16fa', 'body': {'pause': {}}} Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:24.984637 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:24.988813 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:24.988813 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:24.988813 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. Oct 10 10:59:24.988813 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:24.990518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 30e5001a-10f6-4d31-bd2a-4aded9af16fa could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:24.991633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfa634bc-8684-491a-898c-26b7bc176673 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/30e5001a-10f6-4d31-bd2a-4aded9af16fa/action" status: 404 len: 111 microversion: 2.1 time: 0.047440 Oct 10 10:59:24.993192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2282/4479] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:24 2022] POST /compute/v2.1/servers/30e5001a-10f6-4d31-bd2a-4aded9af16fa/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:25.012825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:25.013760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:25.021638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.022374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.023100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.024141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.024833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.025499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.248091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:25.263129 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-816b1430-a7a1-4be1-ab33-68d19a632345 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1513 microversion: 2.1 time: 0.490717 Oct 10 10:59:25.263747 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2198/4480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:24 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:25.354790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:25.365491 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43f4ffe4-ef83-4514-b337-4df6a4702485 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.367740 Oct 10 10:59:25.368281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2283/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:24 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:25.407455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:25.408501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:25.417772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.418834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.419556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.421346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.422358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.423026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.487686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:25.489802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:25.498188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.499331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.500164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.502087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:25.504830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:25.509776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:25.767020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:26.157574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:26.252625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:26.266111 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-619294e2-79de-43e7-9e7f-d74204b25d45 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.873067 Oct 10 10:59:26.292977 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2199/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:25 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:26.302674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:26.305017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:26.316197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.317025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.318285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:26.319340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.320698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.321813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:26.334672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:26.345130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-31821dc4-a0cc-4aaf-b839-6f0b63052b1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.861448 Oct 10 10:59:26.347125 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2284/4483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:25 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:26.355045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:26.359774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:26.360271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:26.375442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.378834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.379429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:26.383750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.384398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.384859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:26.409833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:26.506317 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0bf7f259-1b19-4323-8cfc-42e1b470f592 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.154546 Oct 10 10:59:26.509791 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2285/4484] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:26 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:26.528504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:26.531959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:26.557946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.560149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.560625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:26.561389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:26.561854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:26.564630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:27.459315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:27.473888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:27.475672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-664575a6-014d-436b-8c44-cafc5fc860e6 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1513 microversion: 2.1 time: 1.180449 Oct 10 10:59:27.477131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2200/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:26 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1513 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:27.489219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d6bf074-1eff-41e6-abec-d43885b5198a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1511 microversion: 2.1 time: 0.974527 Oct 10 10:59:27.499055 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2286/4486] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:26 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:27.500161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a655e72-4da2-4106-b390-17c26fcc2881", "tag": "643317f1-516b-4659-9b5e-bcf1795841ff"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:27.509954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:27.510695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:27.518479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:27.522712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:27.524891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:27.525285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:27.526192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:27.527973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:27.527973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:27.527973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:27.528512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:27.541921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] Creating event network-changed:643317f1-516b-4659-9b5e-bcf1795841ff for instance 2a655e72-4da2-4106-b390-17c26fcc2881 on n-h1-860687-2 Oct 10 10:59:27.552860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9fa6584e-0d8e-4d0d-9b52-49c410755083 req-4927f107-47f2-43d3-b495-00353cd51eed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061413 Oct 10 10:59:27.553789 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2287/4487] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:28.169937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:28.183233 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26e63b0c-1966-4d20-8582-850e839df98f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.698275 Oct 10 10:59:28.184492 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2201/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:27 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:28.505961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:28.506762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:28.518187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:28.519025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:28.519719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:28.520341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:28.524131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:28.525418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:28.525704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:28.526160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:28.534525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:28.535265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:28.535845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:28.544622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:28.547626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:28.555315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:28.845051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '376e209ca66f4c5ca0c8a279e6a28080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0fe822f501145eea8c66821aca0f85a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:28.869684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-453a9c23-9292-4ada-921a-0b7394c29278 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 200 len: 1471 microversion: 2.1 time: 0.366158 Oct 10 10:59:28.889048 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2288/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:28 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:28.917990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969baf85-599d-400b-992d-75da6a55c660", "name": "network-vif-deleted", "tag": "4988e950-defb-4d64-8418-b0c8727f6aa3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:28.960976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:28.963462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:28.967813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:28.997716 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] Creating event network-vif-deleted:4988e950-defb-4d64-8418-b0c8727f6aa3 for instance 969baf85-599d-400b-992d-75da6a55c660 on n-h2-860687-2 Oct 10 10:59:29.012976 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3b7d44c2-a6a1-47be-9eee-025c8a743941 req-f842953b-7584-43be-a09b-e5e6115d8f4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122461 Oct 10 10:59:29.013847 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2289/4490] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:29.128496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:29.145993 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-435c502a-b9a1-4dda-a991-59e87c109c57 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1491 microversion: 2.1 time: 0.632278 Oct 10 10:59:29.146479 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2202/4491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:28 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1491 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:29.172227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:29.173135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:29.181752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.182789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.190833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.192478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.193255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.195030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.207427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:29.208045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:29.219961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.220459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.225010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.225993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.228299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.229247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.263786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'pause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state paused Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 13 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: {"pause": {}} Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'pause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state paused Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'pause': {}}} Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state paused. Cannot pause while the instance is in this state. Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state paused Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:29.265608 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:29.270077 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:29.270077 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:29.270077 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:29.270077 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state paused Oct 10 10:59:29.270077 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:29.275989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'pause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state paused {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:29.283032 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5d7010ee-5e71-4089-aec4-18f90e9351ad tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 143 microversion: 2.1 time: 0.113485 Oct 10 10:59:29.287642 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2290/4492] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:29 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 143 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:59:29.300523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:29.301427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:29.310096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.311246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.313263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.315070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.315865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.316532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.479688 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e17eb80-818c-4571-86f6-5029c1cbec66 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.182673 Oct 10 10:59:29.481029 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2291/4493] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:29 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:29.498490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:29.500344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:29.518701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.520124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.520815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:29.522737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:29.524581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:29.526726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:30.521541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:30.535307 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c80105c-b656-4548-99bd-d03ff4a14c00 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 1.329386 Oct 10 10:59:30.538090 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2203/4494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:29 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:30.554608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:30.556745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] [instance: 969baf85-599d-400b-992d-75da6a55c660] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:30.583915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:30.584727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:30.589830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:30.590947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:30.592105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:30.593115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:30.637232 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] HTTP exception thrown: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Request method failure captured: Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 HTTP/1.1 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_nF6EvgheFYjwVFuTCzZF9Xa437oZUR_aP6RTnzhhkOs1St6NTiodLV3nD_M3ov5kgXMuaZ1OYKpHDSNMqoeGhQsL11eONTcekBBfDa6iTkm2aBmgq-jSawW4VUv2GXSrcHayMT_6_L5oQglGkWaw10lz1KfilcTBy-TvHHWL4pitI Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f0fe822f501145eea8c66821aca0f85a Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0fe822f501145eea8c66821aca0f85a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f0fe822f501145eea8c66821aca0f85a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f0fe822f501145eea8c66821aca0f85a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f0fe822f501145eea8c66821aca0f85a"}]}] Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f0fe822f501145eea8c66821aca0f85a Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-876625084 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotTestJSON-876625084-project Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 376e209ca66f4c5ca0c8a279e6a28080 Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotTestJSON-876625084-project Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '969baf85-599d-400b-992d-75da6a55c660'} Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:30.639433 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. Oct 10 10:59:30.643488 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:30.645777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:30.648875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] Returning 404 to user: Instance 969baf85-599d-400b-992d-75da6a55c660 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:30.650183 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26a5507c-c694-4e9c-a5d5-5147de178c99 tempest-VolumesSnapshotTestJSON-876625084 tempest-VolumesSnapshotTestJSON-876625084-project] 10.222.0.16 "GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660" status: 404 len: 111 microversion: 2.1 time: 0.109438 Oct 10 10:59:30.651085 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2204/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:30 2022] GET /compute/v2.1/servers/969baf85-599d-400b-992d-75da6a55c660 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:30.655884 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c40a6ed2-5836-4f97-9ab9-71fab4a16391 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1498 microversion: 2.1 time: 1.169835 Oct 10 10:59:30.677687 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2292/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:29 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1498 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:31.571923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:31.573183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:31.590565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:31.595852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:31.598333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:31.599472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:31.600776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:31.603480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:31.686659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:31.687308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:31.697793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:31.698295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:31.698734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:31.704632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:31.723396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:31.724569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:32.206227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:32.229814 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ff81d63-c12d-4160-9e7e-be7640117eaf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.668933 Oct 10 10:59:32.238354 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2205/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:31 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:32.331829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:32.348736 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d637e86d-5f67-4068-b91b-7e0f49b90d4f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.665674 Oct 10 10:59:32.349683 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2293/4498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:31 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:32.392187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:32.392920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:32.408264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:32.408709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:32.409381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:32.414186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:32.416148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:32.417075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.216642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:33.225693 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff9c4b3f-b846-4dac-be01-cfbd68129864 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.843309 Oct 10 10:59:33.226899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2206/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:32 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:33.249305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:33.252355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:33.264644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:33.265271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:33.279728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.280235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.280688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.281474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.281937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.282371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.284424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.285155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.286177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.287151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.287868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.289132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.321665 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action HTTP/1.1 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 28 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: {"reboot": {"type": "SOFT"}} Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:33.323926 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:33.328350 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:33.329055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:33.347382 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e06a7cb3-8f67-43a0-a1a5-a122474b64ff tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action" status: 404 len: 111 microversion: 2.1 time: 0.102136 Oct 10 10:59:33.351772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2294/4500] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:33 2022] POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:33.362932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:33.364267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:33.384394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.389478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.391659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:33.394036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:33.396895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:33.397445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:34.213019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:34.224019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-429da0c7-41c9-4c51-9105-e6ca874af909 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.963211 Oct 10 10:59:34.224647 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2207/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:33 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:34.285630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:34.297326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc575a6c-2654-46d1-b071-248d45c3baf6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.940049 Oct 10 10:59:34.298269 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2295/4502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:33 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:34.330337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:34.331725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:34.356537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:34.357052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:34.357616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:34.358210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:34.358674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:34.359121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:34.906793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:34.923503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6c4a758-2fd1-420d-afed-8f80ba6fbb19 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.598097 Oct 10 10:59:34.928666 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2208/4503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:34 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:34.946913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:34.949980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 189f4139-0f33-4416-aa42-97d9dc79889b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:34.956785 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/189f4139-0f33-4416-aa42-97d9dc79889b/action HTTP/1.1 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 28 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: {"reboot": {"type": "SOFT"}} Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '189f4139-0f33-4416-aa42-97d9dc79889b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. Oct 10 10:59:34.958534 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. Oct 10 10:59:34.963933 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:34.966326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 189f4139-0f33-4416-aa42-97d9dc79889b could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:34.967771 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-340c1177-a403-4f4d-a0ad-9cbda55ba2ee tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/189f4139-0f33-4416-aa42-97d9dc79889b/action" status: 404 len: 111 microversion: 2.1 time: 0.024864 Oct 10 10:59:34.972565 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2296/4504] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:34 2022] POST /compute/v2.1/servers/189f4139-0f33-4416-aa42-97d9dc79889b/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:34.978084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:34.979084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:34.985346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:34.986173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:34.987470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:34.988374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:34.989281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:34.989859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:35.251567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:35.252503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:35.266509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:35.270035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:35.270727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:35.272075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:35.273847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:35.275805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:35.816307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:35.848995 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eddfc21e-8cd0-4dfe-b47b-d2bad54aacce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.875161 Oct 10 10:59:35.852546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2209/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:34 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:35.878941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:35.879662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:35.894281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:35.894784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:35.896378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:35.897286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:35.899672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:35.900300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:36.094739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:36.105648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a1b0701-4637-4a19-b6f6-8a615ee36749 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.857875 Oct 10 10:59:36.106622 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2297/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:35 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:36.489104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-768a870b-4ce4-4cef-a908-8af966c1434d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: .version_select at 0x7f67776cfc10>, body: {"keypair": {"name": "tempest-keypair-2063213802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE97SVDe3aMKQVl5SJOpI5bDyqEWlh7lUtDwmi8GkdZS5kv2oOedhAB28f92ytPA4p04g7bFSyFh5mzziZd8sTajuJCD+ohnQhLde61z2O94r33GB2gP4kS0JZPwvhd3Ng=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:36.530804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-768a870b-4ce4-4cef-a908-8af966c1434d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:59:36.551859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-768a870b-4ce4-4cef-a908-8af966c1434d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for user df4649407d1840178a40fa26e75d6d9a and project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:59:36.617482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-768a870b-4ce4-4cef-a908-8af966c1434d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507527 Oct 10 10:59:36.618327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2298/4507] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 10:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:37.064156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:37.088117 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-862f08a8-9c9d-4a3c-b0c3-09eea8369e26 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.213063 Oct 10 10:59:37.092986 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2210/4508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:35 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:37.115324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:37.119106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:37.131202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:37.132869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:37.142028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.142978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.144609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.150314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.152694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.153150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.153607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.155769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.156607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.158485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.160247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.162142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.205797 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action HTTP/1.1 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 65 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0', 'body': {'rebuild': {'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c'}}} Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 10:59:37.215039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:37.219329 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a9fca2d0-6413-4421-8535-a170fcbc4d15 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action" status: 404 len: 111 microversion: 2.1 time: 0.105641 Oct 10 10:59:37.224005 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2299/4509] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:37 2022] POST /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:37.239917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:37.241013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:37.253164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.256496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.257344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.261349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:37.262051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:37.266525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:37.987313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:37.996092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:38.006675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f2b42a84-93c2-450b-9f13-5420e044cce1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.783817 Oct 10 10:59:38.011827 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2300/4510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:37 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:38.012186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f79fbc78-d2a9-47d7-bc0f-33814f50a2f8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.885912 Oct 10 10:59:38.027605 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2211/4511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:37 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:38.040948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:38.041717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:38.048385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:38.049822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:38.050531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:38.051527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:38.052249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:38.052931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:38.416918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:38.435754 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f813c26-c33e-448b-ba63-24b03bffc8bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.399935 Oct 10 10:59:38.454530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2301/4512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:38 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:38.480946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:38.491392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 10915ad6-52e0-4c38-8534-5f23bd373b40] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:38.513795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a655e72-4da2-4106-b390-17c26fcc2881", "name": "network-vif-plugged", "status": "completed", "tag": "643317f1-516b-4659-9b5e-bcf1795841ff"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:38.521285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/10915ad6-52e0-4c38-8534-5f23bd373b40/action HTTP/1.1 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 65 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '10915ad6-52e0-4c38-8534-5f23bd373b40', 'body': {'rebuild': {'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c'}}} Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 10:59:38.524368 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 10915ad6-52e0-4c38-8534-5f23bd373b40 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:38.531638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-985ded93-6f48-42a1-9855-b80020b51f8a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/10915ad6-52e0-4c38-8534-5f23bd373b40/action" status: 404 len: 111 microversion: 2.1 time: 0.061663 Oct 10 10:59:38.533805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2212/4513] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:38 2022] POST /compute/v2.1/servers/10915ad6-52e0-4c38-8534-5f23bd373b40/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:38.540382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:38.541330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:38.547653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:38.549751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:38.550369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:38.550594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:38.551232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:38.551707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:38.554757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:38.555565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:38.556241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:38.581907 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] Creating event network-vif-plugged:643317f1-516b-4659-9b5e-bcf1795841ff for instance 2a655e72-4da2-4106-b390-17c26fcc2881 on n-h1-860687-2 Oct 10 10:59:38.595101 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3af8a54b-7bd9-45c7-8d20-e26c92a13c1d req-c4ddd875-096c-468f-8a32-70c7f07e0ebf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099981 Oct 10 10:59:38.595994 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2302/4514] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:39.037128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:39.039219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:39.055892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.060251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.060729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:39.061491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.061970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.062413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:39.170560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:39.180460 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-455a3075-2770-42e1-a1c2-4e30dfac4d81 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.646403 Oct 10 10:59:39.195813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2213/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:38 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:39.213539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:39.216398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:39.229066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.230434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.234481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:39.235842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.236619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.237378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:39.623683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:39.643449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e90285e8-a899-4cd9-bdc0-530c2d0c23b0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.439498 Oct 10 10:59:39.659025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2214/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:39 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:39.674006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:39.674630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 59b5247e-cff2-4b55-9d63-c98d92faf659] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:39.687651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:39.704454 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10e7cccc-309f-4aa0-b7a2-0f2c5e70e345 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.671762 Oct 10 10:59:39.704707 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. Oct 10 10:59:39.727831 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2303/4517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:39 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/59b5247e-cff2-4b55-9d63-c98d92faf659/action HTTP/1.1 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 15 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: {"restore": {}} Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '59b5247e-cff2-4b55-9d63-c98d92faf659', 'body': {'restore': {}}} Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:39.728430 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:39.733452 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:39.733452 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:39.733452 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. Oct 10 10:59:39.733452 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:39.733452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 59b5247e-cff2-4b55-9d63-c98d92faf659 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:39.734432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db71043c-b286-4c64-a832-2707db6cf0bf tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/59b5247e-cff2-4b55-9d63-c98d92faf659/action" status: 404 len: 111 microversion: 2.1 time: 0.065499 Oct 10 10:59:39.735129 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2215/4518] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:39 2022] POST /compute/v2.1/servers/59b5247e-cff2-4b55-9d63-c98d92faf659/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 10:59:39.745994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:39.749240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:39.791069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.791914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.793630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:39.796413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:39.797827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:39.803799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.225375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:40.235800 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-82dabb1e-ed1e-45be-83b5-dc9a22bf2193 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.496046 Oct 10 10:59:40.241252 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2304/4519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:39 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:40.269880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:40.270879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:40.282766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.286337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.286831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.287638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.288153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.289121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.649883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:40.664707 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d29ce0b8-0267-46d9-b4e6-35f2de887b7d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.397314 Oct 10 10:59:40.667299 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2216/4520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:40 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:40.695373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:40.696568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:40.711826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.713128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.714593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.718082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.718871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.719614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.736258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:40.737223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:40.743873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.749928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.750509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.751481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.755589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.756127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.788633 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'restore' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: {"restore": {}} Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'restore' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'restore': {}}} Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state active. Cannot restore while the instance is in this state. Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:40.793240 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:40.797556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:40.797556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:40.797556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:40.797556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:40.797556 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:40.802413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'restore' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:40.803820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41f0d058-63ab-4e68-8222-6563b6afab7a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 145 microversion: 2.1 time: 0.114524 Oct 10 10:59:40.809094 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2305/4521] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:40 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:59:40.818268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:40.825612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:40.842190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.842690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.843183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.863807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:40.864512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:40.864977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:40.871878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:41.565697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:41.581783 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e37f91a-768a-4a42-a6c6-04e8e46f4ae3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1314 microversion: 2.1 time: 0.843784 Oct 10 10:59:41.582731 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2217/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:40 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:41.621911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:41.630040 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b8a7a5a3-43ce-4cfa-a6ef-068d3ff87254 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.817279 Oct 10 10:59:41.638031 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2306/4523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:40 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:41.667401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:41.668758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:41.687040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:41.688054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:41.688787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:41.689767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:41.691678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:41.692355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:42.606690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:42.608475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:42.623132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:42.627326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:42.632757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:42.633876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:42.634579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:42.635300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:42.815979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:42.833780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbb97c36-66d8-4661-98da-f1ddb499670e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.170748 Oct 10 10:59:42.836003 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2218/4524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:41 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:42.858651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:42.859372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 21fbd789-553e-4e53-b4b7-c6a69f248a1e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:42.869277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/21fbd789-553e-4e53-b4b7-c6a69f248a1e/action HTTP/1.1 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 14 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: {"resume": {}} Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '21fbd789-553e-4e53-b4b7-c6a69f248a1e', 'body': {'resume': {}}} Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:42.885185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:42.890147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:42.890147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:42.890147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. Oct 10 10:59:42.890147 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:42.891844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 21fbd789-553e-4e53-b4b7-c6a69f248a1e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:42.892977 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2619ca64-407e-4d72-9b1c-01fd31a259a4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/21fbd789-553e-4e53-b4b7-c6a69f248a1e/action" status: 404 len: 111 microversion: 2.1 time: 0.039298 Oct 10 10:59:42.894254 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2219/4525] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:42 2022] POST /compute/v2.1/servers/21fbd789-553e-4e53-b4b7-c6a69f248a1e/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:42.909617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:42.911799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:42.937525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:42.941895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:42.943968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:42.948153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:42.953708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:42.954659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:43.056918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:43.734441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:43.744737 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18323e75-cdf7-4a5f-8795-a59e20a0bae6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.845817 Oct 10 10:59:43.750128 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2220/4526] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:42 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:43.761242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:43.781216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:43.781951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:43.798532 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98ca9b9b-51a5-4f53-864e-32f53f4d897b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1499 microversion: 2.1 time: 1.195436 Oct 10 10:59:43.801735 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2307/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:42 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1499 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:43.814439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:43.819758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:43.821147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:43.823827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:43.826212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:43.826671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:43.830309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:43.857505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:43.862599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:43.864393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:43.941322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 10:59:44.035587 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-606e6949-742a-42a6-96c7-1cb3ead89642 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881/action" status: 202 len: 0 microversion: 2.1 time: 0.204232 Oct 10 10:59:44.039022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2308/4528] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:43 2022] POST /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:44.062189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:44.064290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:44.090832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:44.091971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:44.091971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:44.093195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:44.095749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:44.097765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:44.392048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:44.419257 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dab42bd-978a-4d0a-9ebb-f2b0d6fb4fb1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.644535 Oct 10 10:59:44.425132 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2221/4529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:43 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:44.451208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-785996539", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4cb4e26-4e37-4654-be04-42f32ec860ea"}], "security_groups": [{"name": "tempest-securitygroup--684473585"}], "key_name": "tempest-keypair-2063213802", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:44.866171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:44.889540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e15dec1-f24a-4561-be79-24a1643c2004 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.843449 Oct 10 10:59:44.902017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] validate_networks() for [('f4cb4e26-4e37-4654-be04-42f32ec860ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 10:59:44.911952 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2309/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:44 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:44.932785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:44.942911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:44.962746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:44.963539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:44.964473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:44.965361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:44.965984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:44.966708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:45.031527 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'resume' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 14 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: {"resume": {}} Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'resume' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'resume': {}}} Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state active. Cannot resume while the instance is in this state. Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:45.041869 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'resume' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:45.046158 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84782848-548d-4433-b4f2-6d2d61ce6374 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 144 microversion: 2.1 time: 0.130171 Oct 10 10:59:45.049109 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2310/4531] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:44 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 144 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 10:59:45.062958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:45.070856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:45.090126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:45.091388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:45.093542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:45.094812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:45.097278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:45.098439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:46.183144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:46.207225 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a366f91a-6024-4ef3-b5f5-f0b21fbc9036 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.153714 Oct 10 10:59:46.208186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2311/4532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:45 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:46.222313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:46.223398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:46.236114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:46.236881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:46.237573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:46.238522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:46.239278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:46.239935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:46.570661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:46.780090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:46.789098 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0360f922-882f-4af1-a5ab-44a697489ede tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.579540 Oct 10 10:59:46.789905 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2312/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:46 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:46.800728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:46.822852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:46.846966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:46.847839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:46.848554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:46.849509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:46.850217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:46.851444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:47.222690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 10:59:47.223222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 10:59:47.223529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 10:59:47.223943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 10:59:47.224382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 10:59:47.248019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:47.248525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:47.249143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:47.249894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:47.250356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:47.250789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:47.315972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 10:59:47.345319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for user df4649407d1840178a40fa26e75d6d9a and project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 10:59:47.392986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 10:59:47.396479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 10:59:47.602704 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0f8f253-4218-484b-a55c-3983250ee00f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.176426 Oct 10 10:59:47.607294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2222/4534] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 10:59:47.618787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27cdd1fd-8580-4051-b94b-0c560db2f2c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:47.627264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27cdd1fd-8580-4051-b94b-0c560db2f2c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:47.639651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:47.654625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-482d5048-5d28-4361-8325-0c4c6323ab6c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.860301 Oct 10 10:59:47.655618 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2313/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:46 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:47.843269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:47.845208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:47.864834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:47.867338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:47.867826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:47.868574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:47.869045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:47.870922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:48.034493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27cdd1fd-8580-4051-b94b-0c560db2f2c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:48.051920 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27cdd1fd-8580-4051-b94b-0c560db2f2c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1237 microversion: 2.1 time: 0.437525 Oct 10 10:59:48.053619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2223/4536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:47 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1237 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:48.072100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a90fa22e-3239-4e09-a90e-a87a80047538 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a90fa22e-3239-4e09-a90e-a87a80047538 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 160 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "1b38c6a3-c663-47a3-b4dc-a29014f67d9c"}]}} Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b0df75aa-6a93-408c-bf0f-07593ca7536c', 'flavorRef': '452', 'networks': [{'uuid': '1b38c6a3-c663-47a3-b4dc-a29014f67d9c'}]}}} Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 10:59:48.076375 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a90fa22e-3239-4e09-a90e-a87a80047538 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a90fa22e-3239-4e09-a90e-a87a80047538 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023591 Oct 10 10:59:48.081151 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2224/4537] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 10:59:48 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 10:59:48.106789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:48.107293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:48.122320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:48.122815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:48.123272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:48.123972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:48.124427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:48.124857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:48.736202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:48.751646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb5d7db2-652d-4eab-b00d-8d8c22607e80 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.656741 Oct 10 10:59:48.754365 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2225/4538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:48 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:48.780317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:48.781830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:48.796307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:48.797111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:48.797781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:48.799834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:48.800521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:48.801157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:48.826699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:48.840304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-779035f4-582c-49f0-b995-f9e9821b6c1e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 1.007181 Oct 10 10:59:48.840898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2314/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:47 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:49.077784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:49.078677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:49.092428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.095345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.096753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.099944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.102341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.103819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.229503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:49.255777 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b80435f-a4c2-4288-ae26-0d36ca3d5e4d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.480333 Oct 10 10:59:49.267290 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2226/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:48 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:49.313845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:49.314246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:49.314949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: c89bf25c-d3a2-4fee-8c82-0cd972d66596] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:49.324345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/c89bf25c-d3a2-4fee-8c82-0cd972d66596/action HTTP/1.1 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 14 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: {"shelve": {}} Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'c89bf25c-d3a2-4fee-8c82-0cd972d66596', 'body': {'shelve': {}}} Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 10:59:49.328384 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 10:59:49.332656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 10:59:49.332656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 10:59:49.332656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. Oct 10 10:59:49.332656 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 10:59:49.339497 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b73bda1e-61a8-4fd3-82eb-389a6d4ae4da tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1289 microversion: 2.1 time: 0.266010 Oct 10 10:59:49.340033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance c89bf25c-d3a2-4fee-8c82-0cd972d66596 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 10:59:49.341116 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-644856e8-9de0-4db0-a669-60cf767f9db4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/c89bf25c-d3a2-4fee-8c82-0cd972d66596/action" status: 404 len: 111 microversion: 2.1 time: 0.032784 Oct 10 10:59:49.355026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2315/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:49 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:49.357396 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2227/4542] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:49 2022] POST /compute/v2.1/servers/c89bf25c-d3a2-4fee-8c82-0cd972d66596/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 10:59:49.374577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:49.375272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:49.403275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.403906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.404474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.405396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.407165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.408056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.886474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:49.888547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:49.892600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:49.896695 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-758018fd-0caa-4bed-861c-7974cdc89fd3 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.530772 Oct 10 10:59:49.900094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:49.907859 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2316/4543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:49 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:49.918250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.921119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.921730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.922578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.927350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.935150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:49.935784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:49.937843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.963415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.964321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.967302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:49.968295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:49.971723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:49.973188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.167475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:51.202395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69a3568c-5b41-4a8b-8bd7-9ecf2010bf09 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 1.322107 Oct 10 10:59:51.219103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2228/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:49 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:51.223204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:51.225931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:51.225931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:51.236329 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb0923c6-afbc-4383-be4e-928763771263 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.306677 Oct 10 10:59:51.236664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.237371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.238045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.238932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.239727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.241894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.256027 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2317/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:49 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:51.270785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:51.276225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:51.315025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.316148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.317609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.318436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.320013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.321915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.423837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lazy-loading 'flavor' on Instance uuid 0e5761c7-a969-4328-8d74-e0b31a0c915f {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 10:59:51.755839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:51.775247 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-572b9abe-8acf-45b1-88b5-90852567cd52 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1295 microversion: 2.1 time: 0.556752 Oct 10 10:59:51.797811 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2229/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:51 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1295 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:51.916457 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fa550058-da09-4b37-9fc1-bcb13a8150fd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.657221 Oct 10 10:59:51.917260 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2318/4547] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 10:59:51 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 10:59:51.926747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:51.927465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:51.948725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.950226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.950689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:51.959752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:51.961014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:51.962428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:52.237622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:52.239302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:52.247338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:52.248074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:52.248755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:52.249626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:52.250247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:52.250830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:52.651027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:52.664492 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94439763-4bbe-460b-bc88-38ffb4fb063e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.433451 Oct 10 10:59:52.687928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2319/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:52 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:52.734711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:52.750396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05e59125-33d5-4669-a744-83ac9603e640 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 0.824041 Oct 10 10:59:52.751690 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2230/4549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:51 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:52.799535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:52.800158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:52.820573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:52.821625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:52.822402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:52.823684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:52.824353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:52.825333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:52.831766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:53.068154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:53.079249 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0eed5138-4ff3-4100-a6e1-e6226482be9b tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1295 microversion: 2.1 time: 0.283407 Oct 10 10:59:53.081487 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2320/4550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:52 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1295 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:53.694353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:53.695207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:53.707938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:53.711922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:53.712718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:53.715107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:53.715887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:53.719686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:53.776081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:53.777392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:53.796099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:53.798286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:53.799524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:53.801887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:53.804281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:53.814212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:54.661436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:54.680068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d8ec78d-dd2c-444a-82e2-125f14b6ca63 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.993128 Oct 10 10:59:54.698664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2231/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:53 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:54.714660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:54.715580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:54.734882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:54.737176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:54.737641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:54.738374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:54.738838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:54.739290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:54.901393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:54.909256 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-476b982c-bc26-4c45-9cb2-ebe2a26a39ce tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 1.137938 Oct 10 10:59:54.910380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2321/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:53 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:55.231772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-50dc91fc-2669-41a2-941a-4ffa754d7b9a tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] Calling method '.version_select at 0x7f677779d040>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.336694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:55.347773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-50dc91fc-2669-41a2-941a-4ffa754d7b9a tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef/defaults" status: 200 len: 371 microversion: 2.1 time: 0.436092 Oct 10 10:59:55.351181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2322/4553] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:59:54 2022] GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef/defaults => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:55.363446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b86b6ab-3871-4e6b-a9a4-5bcc5e2b897e tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] Calling method '.version_select at 0x7f6777640280>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.531028 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b86b6ab-3871-4e6b-a9a4-5bcc5e2b897e tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef" status: 200 len: 371 microversion: 2.1 time: 0.172749 Oct 10 10:59:55.531920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:55.532248 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2323/4554] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 10:59:55.547755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2eeadb53-cd7b-4cdf-aba4-0a8d3e67a50f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.849128 Oct 10 10:59:55.548363 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2232/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:54 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:55.565637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d664f4e-f4cf-464a-8922-eca0786f2734 tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] Calling method '.version_select at 0x7f677760ab80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.706238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.707422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:55.714778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d664f4e-f4cf-464a-8922-eca0786f2734 tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef/defaults" status: 200 len: 371 microversion: 2.1 time: 0.166456 Oct 10 10:59:55.716642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:55.720509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:55.721148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:55.723620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:55.725734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:55.727258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:55.731784 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2324/4556] 10.222.0.16 () {58 vars in 1269 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef/defaults => generated 371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:55.745858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0fcb484-46a4-4787-b595-d2d9f7ea7654 tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] Calling method '.version_select at 0x7f6777640160>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.849806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f0fcb484-46a4-4787-b595-d2d9f7ea7654 tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef" status: 200 len: 371 microversion: 2.1 time: 0.116400 Oct 10 10:59:55.860030 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2325/4557] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:55.867305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bc2b1d3-8303-4d25-9f6a-b4bfd45ea08e tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] Calling method '.version_select at 0x7f6777623ee0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:55.980194 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bc2b1d3-8303-4d25-9f6a-b4bfd45ea08e tempest-QuotasTestJSON-187522691 tempest-QuotasTestJSON-187522691-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef?user_id=55eff3b4ed244e7ba3d6e8e5c9a717ae" status: 200 len: 371 microversion: 2.1 time: 0.117053 Oct 10 10:59:55.981527 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2326/4558] 10.222.0.16 () {58 vars in 1323 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/os-quota-sets/a84ae8769e7c48588a0c1426da185bef?user_id=55eff3b4ed244e7ba3d6e8e5c9a717ae => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:56.023039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:56.023785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:56.040625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:56.041147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:56.041593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:56.042310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:56.042764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:56.047356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:57.280714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:57.784805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:57.798506 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa05d6c6-5c45-4997-bc27-bfdc53f49160 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 1.805171 Oct 10 10:59:57.811087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2327/4559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:57.811342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:57.811770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:57.827244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:57.828050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:57.828745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:57.831657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:57.833063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:57.835636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:57.870462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:57.885915 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45e7b277-445e-42b0-b49c-5bc1c6905ccc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 2.183594 Oct 10 10:59:57.889615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2233/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:55 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 10:59:58.503012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:58.511690 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1410819d-33a2-4b2a-b5b4-787ba5fb3f4e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.708839 Oct 10 10:59:58.528155 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2328/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:57 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:58.748294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc02db9-8522-4c05-a7d5-b215863e5054", "tag": "9b58f609-7808-4b53-a952-6ad8073e0793"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 10:59:58.759723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 10:59:58.776687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:58.777648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:58.780029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:58.800784 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] Creating event network-changed:9b58f609-7808-4b53-a952-6ad8073e0793 for instance 1bc02db9-8522-4c05-a7d5-b215863e5054 on n-h2-860687-2 Oct 10 10:59:58.810203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9fb86dec-c090-4f90-81eb-4004555bdd32 req-19485011-4f7a-4b75-ad8d-cda9c5447e5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065747 Oct 10 10:59:58.814063 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2234/4562] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 10:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 10:59:58.827250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:58.828593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:58.844721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:58.845258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:58.849063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:58.849839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:58.850374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:58.850807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:58.928038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:58.930383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:58.946796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:58.947885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:58.949094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:58.950461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:58.952840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:58.954442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:59.575227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 10:59:59.583096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b111e48d-ed12-48ce-a593-080a68aacab5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 0.759646 Oct 10 10:59:59.583990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2329/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:58 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 10:59:59.603883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 10:59:59.609400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 10:59:59.620476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:59.620980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:59.621426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 10:59:59.625077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 10:59:59.625639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 10:59:59.626299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:00.726636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:00.744865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0645eeee-da1f-47fb-98e2-a3a73b502d03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 1.823865 Oct 10 11:00:00.747355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2235/4564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:58 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:00.761732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:00.765692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:00.795200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:00.795890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:00.796507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:00.799541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:00.800882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:00.802733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:00.816006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:00.827681 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e6dc37a-5d9b-4a4e-9e76-4dc06a33db48 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 1.242207 Oct 10 11:00:00.831435 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2330/4565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 10:59:59 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:01.295640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:01.313518 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19ce6003-04d0-49ea-af8e-d3c76738c1a8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 0.556629 Oct 10 11:00:01.316942 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2236/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:00 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:01.773196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:01.773816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:01.805646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:01.807162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:01.808561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:01.810132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:01.812468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:01.814965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:01.856077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:01.856714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:01.879261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:01.884743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:01.886071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:01.887569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:01.888253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:01.888896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:02.506667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:02.535394 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4849919-21a6-41d2-bfe0-941c6f0a6157 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.679899 Oct 10 11:00:02.537273 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2237/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:01 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:02.549337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:02.563137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:02.604122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:02.610256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:02.613076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:02.616225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:02.621669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:02.625511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:02.649295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:02.657152 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1205de7-7d9b-4b07-a9fa-feaa3971fa45 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.887846 Oct 10 11:00:02.662838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2331/4568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:01 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:03.478603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:03.506882 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7ab939b-6ad8-4094-b830-ec3a13010847 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1533 microversion: 2.1 time: 0.964046 Oct 10 11:00:03.508637 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2238/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:02 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1533 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:03.567217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:03.567897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:03.576083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:03.576835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:03.577464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:03.578344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:03.579047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:03.579683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:03.690516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:03.696652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:03.709855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:03.710702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:03.711440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:03.712542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:03.713561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:03.714457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:04.648974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:04.661373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a183721-f093-451b-b898-5c427b6c8ad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.976407 Oct 10 11:00:04.663678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2239/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:03 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:04.671784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:04.673765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:04.683022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:04.684074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:04.685050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:04.686469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:04.688034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:04.690172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:04.722042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:04.735756 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d62c054-d4ac-439d-8b2f-5e1b1c33d0a0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 1.169535 Oct 10 11:00:04.741486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2332/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:03 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:05.118053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:05.130935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8cac093a-0c3a-4bdb-bbba-5db13bc7b1eb tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.465878 Oct 10 11:00:05.156406 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2240/4572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:04 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:05.690814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:05.692127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:05.702587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:05.703115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:05.703568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:05.704439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:05.710097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:05.710835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:05.773199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:05.773821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:05.795708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:05.796218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:05.808574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:05.815093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:05.815732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:05.824212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:05.935449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:05.972495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:06.484225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:06.491578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:06.498005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef4860b6-8d1a-427b-94f3-3b79ef2711a6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.738563 Oct 10 11:00:06.504802 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2241/4573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:05 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:06.512664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:06.516196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:06.535535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:06.539096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:06.539807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:06.541890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:06.543973 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c724bc5-5d09-45b0-a1b7-988a3ba6ca34 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.850742 Oct 10 11:00:06.544763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:06.546017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:06.552128 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2333/4574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:05 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:07.246144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:07.263132 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c76e99cd-85e5-4b2f-90a0-9754b295faf0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.755419 Oct 10 11:00:07.264063 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2242/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:06 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:07.530943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:07.535902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:07.549939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:07.557438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:07.558264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:07.559392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:07.560079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:07.560741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:07.585632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:07.586629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:07.603337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:07.610364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:07.611231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:07.616649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:07.617491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:07.624228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:08.305913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:08.324136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1e54aeed-ce54-43c2-9e9a-bf37bc4febc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.797838 Oct 10 11:00:08.344283 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2334/4576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:07 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:08.373199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "name": "network-vif-plugged", "status": "completed", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:08.397827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:08.401262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:08.403353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:08.430979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:08.441447 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-201d5419-edda-4602-be55-2cf82411bde9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.863642 Oct 10 11:00:08.455838 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2243/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:07 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:08.464278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:08.478629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] Creating event network-vif-plugged:e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1 for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f on n-h1-860687-2 Oct 10 11:00:08.481461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:08.515977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:08.516510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:08.528059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:08.532162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:08.537973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:08.538698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:08.540860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b8aec136-1f3d-4ca3-8ea5-9fbaab6b68b6 req-5087ef73-b549-43c4-ab87-5d956b5d8561 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195233 Oct 10 11:00:08.542387 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2335/4578] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:09.044613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:09.054291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9511f24d-eb4b-4023-bb8d-d3374f0929cd tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.597175 Oct 10 11:00:09.063233 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2244/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:08 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:09.358575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:09.359863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:09.376545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:09.379630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:09.385917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:09.386881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:09.390723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:09.395046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:09.482198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:09.482831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:09.503283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:09.503861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:09.504308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:09.505039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:09.505495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:09.505964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:10.186885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:10.198536 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9bf15996-48c1-478d-af73-6790bbc4b78a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1509 microversion: 2.1 time: 0.720173 Oct 10 11:00:10.203103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2245/4580] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:09 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1509 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:10.229052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:10.238426 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3cb41659-8af4-49a6-b010-dd68886f6b0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 0.885421 Oct 10 11:00:10.242576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:10.264047 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2336/4581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:09 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:10.269615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:10.299678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:10.300303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:10.300805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:10.301515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:10.303154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:10.308904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:10.656522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc02db9-8522-4c05-a7d5-b215863e5054", "name": "network-vif-plugged", "status": "completed", "tag": "9b58f609-7808-4b53-a952-6ad8073e0793"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:10.681542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:10.682026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:10.682454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:10.714853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] Creating event network-vif-plugged:9b58f609-7808-4b53-a952-6ad8073e0793 for instance 1bc02db9-8522-4c05-a7d5-b215863e5054 on n-h2-860687-2 Oct 10 11:00:10.763339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-298c1b44-ad07-46c7-9087-824655f04aee req-73edcdf9-27ba-4045-8c57-b76eebb26d5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110286 Oct 10 11:00:10.764726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2337/4582] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:00:11.226267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:11.227130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:11.267679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:11.268219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:11.268613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:11.272776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:11.276482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:11.277952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:11.282899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:11.284728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49bad3d6-5b74-4f27-937b-48530391c388 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.080244 Oct 10 11:00:11.303052 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2246/4583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:10 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:11.324022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:11.328945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:11.360485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:11.364522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:11.371125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:11.373501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:11.380359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:11.386586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.116737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:12.133770 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24ed2e20-c249-478c-9a88-9998e1e67e19 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1486 microversion: 2.1 time: 0.912420 Oct 10 11:00:12.137147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2338/4584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:11 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1486 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:12.165602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:12.168608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:12.207203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.208134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.208888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.211963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.212719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.215602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.315278 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03d9ac1f-4d7a-4ebc-bdd2-6ea13cb8c73f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 200 len: 129 microversion: 2.1 time: 0.156150 Oct 10 11:00:12.317064 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2339/4585] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:12 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 129 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:00:12.327108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:12.328520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:12.353726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.355215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.357302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.365812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.367441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.369763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.864831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:12.883660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a492681f-d1dc-4478-8212-28bc71332173 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.560176 Oct 10 11:00:12.884303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2340/4586] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:12 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:12.899267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:12.907390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:12.925802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.926305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.926746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:12.935405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:12.935972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:12.936423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:13.141936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:13.150143 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e208e54-0a36-4a3e-8f7f-9dad836a9c12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1362 microversion: 2.1 time: 1.857735 Oct 10 11:00:13.159684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2247/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:11 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1362 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:13.435601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:13.447502 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8fcad57e-6b00-41d8-a5f7-1dfb54b63546 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.561728 Oct 10 11:00:13.448697 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2341/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:12 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:13.478834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:13.479740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:13.486803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:13.488795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:13.491555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:13.492526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:13.493158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:13.497919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:13.911058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:13.912504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:13.924549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:13.932991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:13.934740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:13.936071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:13.940788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:13.946171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.176558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:15.187523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ad98ab14-b2c6-4e6e-a417-3ea631a610a2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.280255 Oct 10 11:00:15.188312 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2342/4589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:13 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:15.194255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:15.199485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:15.210938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.216580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.218348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.218617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.219316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.220754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.233559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:15.259310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdad410c-49f6-4f30-a9de-66f8297250bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.785572 Oct 10 11:00:15.276100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:15.289022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2248/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:13 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:15.307970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:15.312254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:15.331553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.337457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.340265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.341145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.343827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.345552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.805695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:15.816219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac393870-9bc9-4100-acbe-bdbd333b01d4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1548 microversion: 2.1 time: 0.625919 Oct 10 11:00:15.823974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2343/4591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:15 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1548 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:15.850467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:15.864031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:15.917783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.919619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.942336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:15.948224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:15.950650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:15.952617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:16.237695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:16.250696 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17ea10ae-1576-435d-9d4e-055c92ea30d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.958870 Oct 10 11:00:16.251391 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2249/4592] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:15 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:16.269734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:16.274453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:16.311035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:16.311940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:16.312464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-059cfc92-3ea3-4320-8e0c-b53d8a5c93ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.466780 Oct 10 11:00:16.318950 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2344/4593] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:00:15 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-interface => generated 285 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:16.324779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:16.325596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:16.328241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:16.329216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:16.330154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:16.330681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:16.359126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:16.383094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:16.384130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:16.384420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:16.384903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:16.385337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:17.163086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:17.178911 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5fcfe87b-6acb-4854-8eba-81eb0d2d9ea4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.923809 Oct 10 11:00:17.205216 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2250/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:16 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:17.283507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:17.292046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4bea6661-ebbd-4e02-9b0b-ba076856c022 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.971904 Oct 10 11:00:17.302868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2345/4595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:16 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:17.539242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2139747009", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "d4170c24-8757-45a8-8f28-ac22cc23fbd1"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:18.236291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:18.237205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:18.245563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:18.252643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:18.255232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:18.258067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:18.258747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:18.265398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:19.589581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:19.598820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98cebd29-8735-4e97-a028-e14767b95d3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.367915 Oct 10 11:00:19.609678 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2346/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:18 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:20.641555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:20.643920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:20.657273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:20.663267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:20.665479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:20.666425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:20.668611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:20.669892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:21.844753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] validate_networks() for [('d4170c24-8757-45a8-8f28-ac22cc23fbd1', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:00:22.172957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:22.193778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95f7e53b-819e-463e-9943-1fd8afd46bf8 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.557471 Oct 10 11:00:22.214974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2347/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:20 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:22.231637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc02db9-8522-4c05-a7d5-b215863e5054", "tag": "9b58f609-7808-4b53-a952-6ad8073e0793"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:22.329986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:22.329986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:22.329986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:22.446206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] Creating event network-changed:9b58f609-7808-4b53-a952-6ad8073e0793 for instance 1bc02db9-8522-4c05-a7d5-b215863e5054 on n-h2-860687-2 Oct 10 11:00:22.476742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4730a339-553c-4dae-be41-167865119aa5 req-ef805d96-fffe-42ce-a4b5-a434949d96e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266153 Oct 10 11:00:22.489253 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2348/4598] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:23.242425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:23.243991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:23.275305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:23.279145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:23.280462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:23.282258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:23.285636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:23.288826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:24.880999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:24.889568 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c669cea2-f22d-4255-9109-58bb9750db61 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.653337 Oct 10 11:00:24.911026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2349/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:23 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:25.864906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:00:25.866067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:00:25.866719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:00:25.867378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:00:25.867989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:00:25.873040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=48 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:25.893643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:25.894584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:25.895236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:25.896738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:25.897581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:25.898173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:25.925145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:25.926392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:25.940300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=64 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:25.947315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:25.957879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:25.959757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:25.962932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:25.962932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:25.969325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:25.971527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:00:25.996528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:00:26.060068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:00:26.062437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:00:26.262419 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cd37632-2822-4cab-9c9d-b018f6c5fda1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.729992 Oct 10 11:00:26.274844 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2251/4600] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 8739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:00:26.291268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11b17c20-64e2-4e8b-a4a4-e7789ead78fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:26.291902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11b17c20-64e2-4e8b-a4a4-e7789ead78fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:26.581796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11b17c20-64e2-4e8b-a4a4-e7789ead78fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:26.590297 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11b17c20-64e2-4e8b-a4a4-e7789ead78fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1215 microversion: 2.1 time: 0.312098 Oct 10 11:00:26.590893 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2252/4601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:26 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:26.961429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:26.976163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b64d0a8-e62f-4008-b8bc-078dffad184c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.054765 Oct 10 11:00:26.985508 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2350/4602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:25 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:27.619620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:27.620242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:27.632192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:27.633531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:27.634984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:27.636143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:27.636792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:27.637665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:28.009220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:28.009864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:28.031831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:28.032299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:28.040530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:28.041610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:28.042271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:28.047583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:28.056761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:28.086747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc83e282-33d0-4d80-a591-69fc15d3c512 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1211 microversion: 2.1 time: 0.472663 Oct 10 11:00:28.091420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2253/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:27 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1211 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:28.986187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:29.004053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e67de1f7-f3db-4ff1-b367-97070661dc5c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.996603 Oct 10 11:00:29.009168 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2351/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:28 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:29.124186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:29.124810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:29.139959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:29.140593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:29.141057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:29.145303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:29.150201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:29.150947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:29.565992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:29.582593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cb75378-4f4f-4da2-95a2-38779d92019b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1273 microversion: 2.1 time: 0.466257 Oct 10 11:00:29.592546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2254/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:29 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1273 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:30.037818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:30.038627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:30.047708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:30.062246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:30.063985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:30.072117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:30.073942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:30.075612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:30.618878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:30.619649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:30.628220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:30.635240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:30.640410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:30.641519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:30.642907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:30.643893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:30.835978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:30.872967 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5381f2b2-9e30-4094-bd04-3b1aa7d7505b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.839293 Oct 10 11:00:30.887697 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2352/4606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:30 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:31.914258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:31.914868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:31.932357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:31.933663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:31.937719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:31.938744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:31.940944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:31.943628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:32.117792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:32.128060 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57946330-97a0-4745-b537-be1c5a6fda9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 1.514189 Oct 10 11:00:32.134698 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2255/4607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:30 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:33.162164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:33.162807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:33.177826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:33.188835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:33.189334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:33.190108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:33.190591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:33.201315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:33.404293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:33.419534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb83fdab-e7ce-43d1-8025-5f97b7ba6e27 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 1.504395 Oct 10 11:00:33.441221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2353/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:31 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:34.183374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:34.201079 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bfe828e-7aab-4670-b21f-2293b168c0ef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 1.043587 Oct 10 11:00:34.216221 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2256/4609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:33 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:34.467633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:34.468875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:34.496219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:34.496992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:34.497586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:34.498478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:34.499142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:34.511671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:35.158643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:35.170748 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-edaaa3b6-1fc9-4194-a341-17b1f88d82c5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.725049 Oct 10 11:00:35.176156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2354/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:34 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:35.246969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:35.247726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:35.260243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:35.261054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:35.262076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:35.263739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:35.264835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:35.265896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:35.793023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:35.808870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2373ade1-a396-4754-ab17-549472d691b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 0.581462 Oct 10 11:00:35.821410 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2257/4611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:35 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:35.887414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22017dc-9e30-4f8a-88ac-2d26b42940f0", "tag": "9db59aa4-a993-421b-a9bf-cc1bf6a10ab9"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:35.953213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:35.961530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:35.962384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:36.022492 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] Creating event network-changed:9db59aa4-a993-421b-a9bf-cc1bf6a10ab9 for instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 on n-h2-860687-2 Oct 10 11:00:36.046978 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-466160b7-c4b1-4308-b10d-c01ec2d9b48a req-bec08d2c-dad5-40fd-a281-8baa7f55e10c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166515 Oct 10 11:00:36.049454 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2355/4612] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:36.202147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:36.202876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:36.218689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:36.228041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:36.228837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:36.229463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:36.233199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:36.236679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:36.238360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:36.272667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=90 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:36.589727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:36.672587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:36.682928 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd49a75c-8df7-42b8-a513-d861d1caa123 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.485446 Oct 10 11:00:36.686414 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2258/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:36 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:36.840024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:36.840024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:36.857189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:36.857689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:36.863883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:36.865211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:36.865864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:36.866523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:37.678897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:37.693686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dfc75964-75c1-4a33-bd28-d0a4124e66de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 0.858997 Oct 10 11:00:37.694789 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2356/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:36 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:37.710935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:37.712795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:37.734106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:37.734602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:37.735074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:37.745587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:37.746178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:37.746631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:38.570657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:38.590774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffc4f7e3-3227-4c38-968c-28c9c651b84e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.884795 Oct 10 11:00:38.610155 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2259/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:37 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:38.717001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:38.717609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:38.730816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:38.733113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:38.733725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:38.737807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:38.738497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:38.740265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:39.617412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:39.619366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:39.632745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:39.637339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:39.637993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:39.640005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:39.640625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:39.646818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:39.830022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:39.864231 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f98bd60f-34b3-4ad7-9a32-33ecdda4a531 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 1.151162 Oct 10 11:00:39.899450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2357/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:38 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:40.178301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:40.207358 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e38b90c9-ccf5-427e-b74c-7f44d0a1c36d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1528 microversion: 2.1 time: 0.595282 Oct 10 11:00:40.212103 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2260/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:39 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1528 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:40.903457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:40.905111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:40.916839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:40.920656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:40.922886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:40.925510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:40.927702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:40.930256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:41.241227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:41.243465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:41.274814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:41.276817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:41.278104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:41.280295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:41.281408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:41.283362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:41.949445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:41.969254 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66d4566b-1d91-4604-8b2d-5e85aa6b5c58 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 1.068875 Oct 10 11:00:41.969874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2358/4618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:40 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:42.186831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:42.216966 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc908e1c-aff9-4dec-b9d4-d227ff686f8b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1510 microversion: 2.1 time: 0.982583 Oct 10 11:00:42.217579 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2261/4619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:41 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1510 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:42.961516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22017dc-9e30-4f8a-88ac-2d26b42940f0", "name": "network-vif-plugged", "status": "completed", "tag": "9db59aa4-a993-421b-a9bf-cc1bf6a10ab9"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:42.979060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:42.979565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:42.980004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:42.994960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:42.996219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:43.008662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:43.009170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:43.009614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:43.019650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:43.021819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:43.023120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:43.035832 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] Creating event network-vif-plugged:9db59aa4-a993-421b-a9bf-cc1bf6a10ab9 for instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 on n-h2-860687-2 Oct 10 11:00:43.053783 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-700a9de9-58ad-4f5c-921f-245455627365 req-ef9553df-90fe-4057-9019-e88d78a60b7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096068 Oct 10 11:00:43.057577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2359/4620] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:43.247040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:43.248047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:43.255775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:43.256487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:43.257123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:43.258395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:43.259168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:43.261611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:44.689202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:44.704386 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd91ebd8-f7c9-49dc-9d5e-c30cb9f3edcc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1513 microversion: 2.1 time: 1.458883 Oct 10 11:00:44.704386 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2360/4621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:43 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1513 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:44.734282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:44.736029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:44.749462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:44.749962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:44.750411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:44.758094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:44.761928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:44.762675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:44.988639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:44.999816 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f233ecf-e935-42b5-b8ba-6e6fdfb60bea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 2.008143 Oct 10 11:00:45.001123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2262/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:42 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:45.144088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:45.157262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-653a6856-7e44-4783-9d38-44eaf0b27f63 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1453 microversion: 2.1 time: 0.428345 Oct 10 11:00:45.162619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2361/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:44 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1453 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:45.253216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:45.254199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:45.271926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.276512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.280976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.282023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.282656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.283331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.336148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:45.343809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lazy-loading 'flavor' on Instance uuid 0e5761c7-a969-4328-8d74-e0b31a0c915f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:00:45.362264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.362796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.363214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.377310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'shelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state shelved_offloaded Oct 10 11:00:45.381540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 14 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: {"shelve": {}} Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: exception: Cannot 'shelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state shelved_offloaded Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'shelve': {}}} Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 11:00:45.402233 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state shelved_offloaded Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state shelved_offloaded Oct 10 11:00:45.407539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:00:45.409665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'shelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state shelved_offloaded {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:00:45.411703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90acaace-205b-45cb-afed-e513c54190ec tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 155 microversion: 2.1 time: 0.161690 Oct 10 11:00:45.412595 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2263/4624] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:45 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 155 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 11:00:45.421312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:45.421918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:45.424167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_external_events [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] Unable to find a host for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f. Dropping event network-vif-unplugged {{(pid=128800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 11:00:45.438056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.438596 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-005f75c8-b825-4b82-8f36-d5f22fab3164 req-896e50af-d0db-492c-b249-830abcd02e35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.099730 Oct 10 11:00:45.442691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.443212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.444024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.444420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.444849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.445620 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2362/4625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 111 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 10 11:00:45.529485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:45.530016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:45.537638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 11:00:45.558269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.558795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.559289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.560021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.560493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.560934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.652331 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0de109b-83d6-4d06-b528-8ba6b4863ae8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/ips" status: 200 len: 146 microversion: 2.1 time: 0.127818 Oct 10 11:00:45.664208 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2363/4626] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:00:45 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/ips => generated 146 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:00:45.672173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7bcba49e-1dfb-4e3d-9de3-868b6fe49f86 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.255075 Oct 10 11:00:45.673076 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2264/4627] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:45 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:00:45.686803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:45.690473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:45.710958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.713036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.713368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:45.718440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:45.719355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:45.721406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:46.027493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:46.029029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:46.044766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:46.055840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:46.058771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:46.059735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:46.060348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:46.062783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:46.490340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:46.504580 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3413a23-7bff-4eb6-8d1a-b7af92aeed9e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1461 microversion: 2.1 time: 0.826414 Oct 10 11:00:46.505638 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2364/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:45 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1461 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:46.835752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:46.849050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75d2abf6-95c2-4e5c-96df-5307a2c48fcf tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1315 microversion: 2.1 time: 0.824631 Oct 10 11:00:46.855011 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2265/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:46 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:00:47.530195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:47.530819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:47.546602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:47.547133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:47.547587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:47.548306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:47.548762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:47.549196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:47.888146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:47.889675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:47.905690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:47.906592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:47.909640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:47.912692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:47.913549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:47.914233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:47.915344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:47.930925 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-942655b8-eb31-457e-be2a-482df17c7532 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1461 microversion: 2.1 time: 0.397755 Oct 10 11:00:47.936263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2365/4630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:47 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1461 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:48.220418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:48.231509 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cccf471-c3c3-4d39-9d7a-ebd044481f0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1500 microversion: 2.1 time: 0.348676 Oct 10 11:00:48.232067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2266/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:47 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1500 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:48.260405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:48.269686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:48.291536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:48.366180 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-215e4642-e5a2-4cd9-8563-ef7cfb1ecb44 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.110040 Oct 10 11:00:48.367318 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2366/4632] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:48 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:48.959585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:48.960434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:48.974544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:48.976068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:48.977646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:48.979428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:48.982275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:48.983098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:49.377526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:49.383289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:49.404366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:49.407944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:49.408411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:49.409336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:49.409810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:49.410241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:49.520408 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0567f263-45eb-4b01-a40e-e51f1b1495f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.146379 Oct 10 11:00:49.521249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2367/4633] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:49 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 11:00:49.532034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:49.542358 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51aa1c05-63cf-48eb-b1ab-e567d9a44082 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1461 microversion: 2.1 time: 0.587836 Oct 10 11:00:49.554074 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2267/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:48 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1461 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:50.141315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7372eae6-9549-458d-b8cb-00ca2fc54c47"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:50.143844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:50.156714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.164277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.170361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.171486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.172120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.172844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.540933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:50.558699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:50.580051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.583478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.584341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.585334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.591998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.592826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.636256 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3819b97c-4782-40d0-90d4-013532782fa5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499235 Oct 10 11:00:50.639808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2368/4635] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:00:50 2022] POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:00:50.653022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:50.656897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:50.674208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.675085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.675776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.677295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:50.677991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:50.678661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:50.738114 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7244f3ad-7ce7-429f-89ae-d3a0bd215d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.209610 Oct 10 11:00:50.743140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2268/4636] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:50 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:51.489032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:51.500972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b8b211b-e953-4a27-8424-51f6040a0c20 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.859100 Oct 10 11:00:51.501564 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2369/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:50 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:51.761249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:51.766613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:51.804572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:51.805384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:51.805844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:51.806569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:51.810043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:51.810653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:51.922267 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35a50d2c-9e3e-42a9-aa5a-a7844d6f2769 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.175903 Oct 10 11:00:51.923659 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2269/4638] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:51 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:52.532965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:52.534239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:52.564577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:52.567479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:52.568222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:52.592752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:52.594491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:52.595257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:52.940792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:52.946109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:52.948931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:52.958137 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6647c4c5-fe38-4f4e-8f94-483735023b6f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.430901 Oct 10 11:00:52.965862 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2370/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:52 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:52.968290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:52.970386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:52.972722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:52.975627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:52.976448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:52.979455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:53.076107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f1b54f4-06e9-4fa2-afcb-4b1da198ce98 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.143448 Oct 10 11:00:53.079566 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2270/4640] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:52 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:53.981769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:53.982355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:53.991359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:53.991860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:53.992298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:53.993057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:53.993473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:53.993899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:54.092195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:54.108916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:54.138516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:54.158202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:54.159431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:54.166838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:54.171695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:54.172865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:54.241354 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc2e0919-7611-42fd-83d6-6b3dbba9b758 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.154580 Oct 10 11:00:54.243121 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2271/4641] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:54 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:54.490123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:54.506985 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72c8fedb-511e-4132-bc53-0b20eafee9ef tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.528848 Oct 10 11:00:54.507611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2371/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:53 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:55.255524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:55.259333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:55.340291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:55.342171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:55.342700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:55.343546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:55.344026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:55.352980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:55.514422 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c88bd34a-008f-4616-87f0-22624a5eb662 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 0.264226 Oct 10 11:00:55.522287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2272/4643] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:55 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:00:55.534587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:55.536160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:55.564506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:55.565042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:55.565497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:55.566250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:55.570736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:55.571302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:56.568074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:00:56.578666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-407f7976-bb9e-4064-8a6f-41514a892680 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 1.048467 Oct 10 11:00:56.586376 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2372/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:55 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:57.546989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:57.556680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:57.576993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:57.615449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:57.616165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:57.629713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=46 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:00:57.631390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:57.631892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:57.641021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:57.642954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:57.645011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:57.645922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:57.653501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:57.654568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:57.658048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:57.662192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:57.676305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:57.676897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:57.808291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad02a935-6b5a-429c-b777-b0302a442170 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 14 microversion: 2.1 time: 1.282435 Oct 10 11:00:57.814273 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2273/4645] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:56 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 14 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 11:00:57.837106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5df2178-2fc5-4a1f-9518-22a9a5ae3bf9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Action: 'create', calling method: .version_select at 0x7f67778e2ee0>, body: {"keypair": {"name": "tempest-keypair-1173423335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzkxI4MdTMET+UYfHZiCBiTeibnDqYVRc6QRRw40WJYCX5brZlYJHPr9uAt38CzGFz3tlmwqCHT6BcLPoKB2nuPCEItyv3Ziqs7yvKZH0WwLQt6bJkyHeqXRW6NVaH4cQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:57.949483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a5df2178-2fc5-4a1f-9518-22a9a5ae3bf9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Getting quotas for project 0dc27860ae3a4763a82a0ec70e493ff6. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:00:57.981107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a5df2178-2fc5-4a1f-9518-22a9a5ae3bf9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Getting quotas for user ea123efcf86e4f57a9e7f760285a3621 and project 0dc27860ae3a4763a82a0ec70e493ff6. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:00:58.095890 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5df2178-2fc5-4a1f-9518-22a9a5ae3bf9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.278965 Oct 10 11:00:58.100585 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2274/4646] 10.222.0.16 () {62 vars in 1200 bytes} [Mon Oct 10 11:00:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 11:00:58.823710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:00:58.830912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:58.870414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:58.872379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:58.873904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:58.876681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:58.880701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:58.881372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:58.976196 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50d14c5c-c963-44ce-ae99-319bef5d2503 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action" status: 200 len: 8206 microversion: 2.1 time: 0.159093 Oct 10 11:00:58.978067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2275/4647] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:00:58 2022] POST /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0/action => generated 8206 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:00:58.990124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:00:58.991361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:00:59.013726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:59.017735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:59.020660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:00:59.022629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:00:59.025198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:00:59.025867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:00.513525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:00.532545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33cec3d5-afe8-4b79-8ab7-39fd26cd6370 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 2.920362 Oct 10 11:01:00.535410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2373/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:57 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:00.847247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Calling method '.version_select at 0x7f6777af5700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:00.849735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:00.850947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:00.851832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:00.913235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:00.915699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:00.918806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:00.951834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:00.952839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:00.953622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:00.973612 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63be1454-2722-403f-b76f-ff66aea25a56 tempest-PortsAdminExtendedAttrsTestJSON-1263446195 tempest-PortsAdminExtendedAttrsTestJSON-1263446195-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.433322 Oct 10 11:01:00.975772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2374/4649] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 11:01:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:01.567222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:01.568079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:01.595849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:01.596409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:01.596889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:01.597683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:01.608574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:01.612708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:02.025789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:02.038534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1de77296-2064-45f8-890a-0ab053f68248 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 3.054853 Oct 10 11:01:02.041378 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2276/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:00:58 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 3059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:02.076672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:02.077332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:02.089679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:02.093988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:02.094560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:02.095500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:02.096420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:02.096864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:02.135583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:02.213882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:02.231367 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c4e5aae-8343-40b8-b9b7-463a01df33af tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.666534 Oct 10 11:01:02.233606 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2375/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:01 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:03.260881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:03.261593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:03.286628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:03.287347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:03.287797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:03.288601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:03.289078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:03.289616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:03.309010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:03.329768 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58b0c9c6-5dad-4f49-89c0-67da17cc3c90 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.254874 Oct 10 11:01:03.349774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2277/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:02 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:03.365086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:03.374364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:03.407364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:03.408083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:03.408534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:03.410379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:03.410866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:03.422710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:04.602025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:04.613950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12487234-ceaf-4a09-93b1-b026092449b1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.254745 Oct 10 11:01:04.619779 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2278/4653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:03 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:04.625129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1151957790", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8fbea19e-a201-421f-910b-d4c64062cd14"}, {"port": "b6844420-e64a-422e-92aa-2e4e3e5ff595", "tag": "port-1"}, {"port": "6c90b31c-cd92-49d2-aa0d-2ad7d7935346", "tag": "port-2"}, {"uuid": "e6782c12-2130-4b7e-8ecc-7ef5b83521b4", "tag": "net-1"}, {"uuid": "e6782c12-2130-4b7e-8ecc-7ef5b83521b4"}, {"uuid": "38bb4776-fdfe-4fb9-ac5a-c027ce19b7c3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "38bb4776-fdfe-4fb9-ac5a-c027ce19b7c3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d75dd50b-9b57-4158-82eb-b8357e8ad28a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "af300839-5b03-4783-ab49-52835d6cc4f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f4fd3879-6dde-46bf-a6d8-21aa2102f3dc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1035797902"}], "key_name": "tempest-keypair-1173423335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:05.313095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:05.335792 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e17abeea-3bca-448c-9f1c-d712352b7b82 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 2.071698 Oct 10 11:01:05.336657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2376/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:03 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:05.343643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:05.360011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:05.387751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:05.388635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:05.389360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:05.390565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:05.391442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:05.392257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:05.446055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] validate_networks() for [('8fbea19e-a201-421f-910b-d4c64062cd14', None, None, None, None, None), (None, None, 'b6844420-e64a-422e-92aa-2e4e3e5ff595', None, None, None), (None, None, '6c90b31c-cd92-49d2-aa0d-2ad7d7935346', None, None, None), ('e6782c12-2130-4b7e-8ecc-7ef5b83521b4', None, None, None, None, None), ('e6782c12-2130-4b7e-8ecc-7ef5b83521b4', None, None, None, None, None), ('38bb4776-fdfe-4fb9-ac5a-c027ce19b7c3', '10.2.2.100', None, None, None, None), ('38bb4776-fdfe-4fb9-ac5a-c027ce19b7c3', '10.2.2.200', None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:01:06.116959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:06.133200 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b704c365-7e69-4b27-a866-58e65ab08142 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.793832 Oct 10 11:01:06.151955 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2377/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:05 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:06.172021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:06.172958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:06.185483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:06.186243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:06.187790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:06.189608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:06.190418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:06.191357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:06.294127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:06.309287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Locking {{(pid=128800) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 10 11:01:06.416334 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-06d5fd0d-386b-4d6e-bc1a-87d233bed987 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.250166 Oct 10 11:01:06.420585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2378/4656] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:06 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:06.449637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:06.450204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:06.468607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:06.469116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:06.469563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:06.470288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:06.470760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:06.471221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:07.651896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:07.665403 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a30a998a-8073-4174-9701-7874ac1d2289 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 1.242593 Oct 10 11:01:07.678648 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2379/4657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:06 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:07.686827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:07.687795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:07.701466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:07.706522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:07.707489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:07.709282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:07.719417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:07.720160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.020928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:08.041989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:08.058740 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f81ea56-91e9-4f21-b434-63438fcb67ee tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.377290 Oct 10 11:01:08.060520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2380/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:07 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:08.087245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:08.102736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.107820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.108997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.167591 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action HTTP/1.1 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: {"os-stop": {}} Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '99c98dac-c643-47fd-a1e8-11e7afcb35b8', 'body': {'os-stop': {}}} Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked Oct 10 11:01:08.172837 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:08.178388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 409 to user: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 is locked {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:08.178388 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ad1065c-7faf-47c1-b5bd-2cd14a6f1a03 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 409 len: 107 microversion: 2.1 time: 0.096995 Oct 10 11:01:08.182369 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2381/4659] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:08 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 107 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 11:01:08.197693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:08.199321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:08.216858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.219584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.220564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.224450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.225932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.226813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.334554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Unlocking {{(pid=128800) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 10 11:01:08.553745 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54ba275e-77f0-4354-8305-70fb64922346 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.367586 Oct 10 11:01:08.554783 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2382/4660] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:08 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:08.564102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:08.593080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.593643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.594099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.654366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:01:08.809153 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8f2a3511-2934-4ac6-b0e7-f0e700f666c3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.249991 Oct 10 11:01:08.809585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2383/4661] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:08 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:01:08.836531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:08.837678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:08.860548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.861204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.861828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:08.862746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:08.863374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:08.863910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:09.356614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:09.379398 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d663923-8f24-41d3-8de5-e3eadcd38351 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.556539 Oct 10 11:01:09.379398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2384/4662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:08 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:09.379398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:09.379398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:09.398155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:09.398155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:09.398155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:09.398555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:09.400316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:09.407761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:09.806515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:09.815096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0390f9ad-0aea-4606-bf74-32e1007b6f6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.445998 Oct 10 11:01:09.815720 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2385/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:10.396084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:10.396921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:10.414598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:10.415290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:10.415773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:10.416504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:10.416971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:10.417408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:10.745259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:10.754484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b864e09a-9a3e-4da5-a302-b2867583eaba tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.362924 Oct 10 11:01:10.759410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2386/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:10 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:10.839301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:10.840729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:10.850965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:10.855644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:10.856300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:10.857223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:10.857700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:10.858137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:11.476748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:11.525084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80e0c31c-c507-4c13-9abe-a2bd0998470e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.690170 Oct 10 11:01:11.527740 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2387/4665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:10 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:11.772670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:11.790111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:11.790111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:11.790111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:11.822603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:01:11.895515 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a58fd883-c630-4913-9ec5-bf2c33d4ac74 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action" status: 202 len: 0 microversion: 2.1 time: 0.126408 Oct 10 11:01:11.902641 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2388/4666] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:11 2022] POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:11.911813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:11.914298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:11.925976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:11.927321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:11.927958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:11.928926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:11.929783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:11.930394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:11.977533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=10,nova_cell1:INSERT=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:12.028942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:01:12.029645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:01:12.036224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:01:12.036923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:01:12.037225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:01:12.060676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.061279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.064335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:12.065144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.069087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.069539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:12.112489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Getting quotas for project 0dc27860ae3a4763a82a0ec70e493ff6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:01:12.132584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Getting quotas for user ea123efcf86e4f57a9e7f760285a3621 and project 0dc27860ae3a4763a82a0ec70e493ff6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:01:12.343172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:12.354290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e69cd54-ddb2-4ba8-bba2-0cfded8b2eb0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.446611 Oct 10 11:01:12.355308 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2389/4667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:11 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:12.364443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:12.367065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:12.392452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.393892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.395606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:12.400146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.401214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.401837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:12.484380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:01:12.496472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d75dd50b-9b57-4158-82eb-b8357e8ad28a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='af300839-5b03-4783-ab49-52835d6cc4f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4fd3879-6dde-46bf-a6d8-21aa2102f3dc',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:01:12.814652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:12.827736 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a07b6d6b-e1f6-4276-8165-2101328e5eca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.467257 Oct 10 11:01:12.828983 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2390/4668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:12 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:12.842880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:12.847929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:12.869219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.870004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.870625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:12.871569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:12.872201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:12.873994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:13.105756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:13.117444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-472e8037-c669-40dd-9e8f-04926b38b3bd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.287178 Oct 10 11:01:13.119027 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2391/4669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:12 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:13.144142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-648485a2-ecbe-48c9-8a9b-58bfdf1ff2d8 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.522848 Oct 10 11:01:13.146522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2279/4670] 10.222.0.16 () {62 vars in 1189 bytes} [Mon Oct 10 11:01:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 8526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 11:01:13.161725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:13.162494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:13.260315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:13.268628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:13.271096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:13.272376 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8a35dce1-18f1-4d61-9adc-a8a81db02e55 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1286 microversion: 2.32 time: 0.118469 Oct 10 11:01:13.273026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2392/4671] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:13 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:13.389279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:13.390130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:13.404438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:13.405114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:13.405736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:13.406921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:13.407579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:13.408175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:13.624815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:13.635752 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5957fc48-5b06-4c40-93d9-acf006f646c4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.254394 Oct 10 11:01:13.638694 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2280/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:13 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:13.854178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:13.854803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:13.882366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:13.888428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:13.888888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:13.896965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:13.898333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:13.911942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:14.141895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:14.142513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:14.157525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:14.158866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:14.159554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:14.171534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:14.172373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:14.173089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:14.306191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:14.317336 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-13932562-e301-41dd-9cef-eb4aeadf371d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.467177 Oct 10 11:01:14.333429 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2393/4673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:13 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:14.348854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:14.351984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:14.905825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:14.927454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:14.934549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:14.939929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9647300-18ba-4cdf-a11a-9a2b56c2f874 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1286 microversion: 2.32 time: 0.604126 Oct 10 11:01:14.940549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2394/4674] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:14 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1286 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:14.956244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:14.959592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:14.974977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:14.975652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:14.976114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:14.976965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:14.981734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:14.982574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:15.013733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:15.026748 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e806b25-1b4e-4641-9d82-1b69bdf309c2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.885271 Oct 10 11:01:15.043188 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2281/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:14 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:15.346312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:15.349676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:15.355122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:15.370722 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b60ef826-d0c9-4207-9799-27805095807f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.425274 Oct 10 11:01:15.372789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:15.387097 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2395/4676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:14 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:15.387881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:15.387881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:15.387881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:15.387881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:15.387881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:15.633741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:15.645468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "name": "network-vif-plugged", "status": "completed", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:15.654038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-117785df-94af-44f9-b477-b32451261da6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.311622 Oct 10 11:01:15.654675 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2282/4677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:15 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:15.665853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:15.666357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:15.666799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:15.689271 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] Creating event network-vif-plugged:e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1 for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f on n-h1-860687-2 Oct 10 11:01:15.705624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7b740163-695e-469d-885f-eabbd8632c36 req-760d9862-9094-4467-aa2a-ca3bae6b2a39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064287 Oct 10 11:01:15.706761 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2396/4678] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:15.974883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:15.975710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:15.986153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:15.990393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:15.991271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:15.992514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:15.994565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:15.997008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.054627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:16.055328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:16.076194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.076739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.077176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.078094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.082620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.083345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.157070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:16.181947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:16.184018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:16.185391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-912af8e8-74f0-457b-9938-4ff1c7051c07 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1576 microversion: 2.32 time: 0.215990 Oct 10 11:01:16.186372 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2283/4679] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:15 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:01:16.323204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:16.333242 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-546101b7-21a9-4657-9010-155a931c0d22 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.283475 Oct 10 11:01:16.336087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2397/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:16 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:16.403744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:16.404887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:16.419787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.420594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.421907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.422849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.423566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.424378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.682147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:16.682760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:16.693730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.694373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.695674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:16.698922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:16.700777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:16.701307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:17.178560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:17.194651 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-740f9167-1df8-4ce8-a7d4-ac93a5908688 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.792460 Oct 10 11:01:17.197760 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2284/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:16 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:17.221480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:17.224370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:17.243798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:17.245246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:17.245922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:17.246972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:17.247706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:17.248384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:17.322782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:17.331886 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93459f2e-0fff-4079-b798-63c9dc2c10c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.653969 Oct 10 11:01:17.336501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2398/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:16 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:17.360501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:17.361148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:17.371593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:17.372292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:17.372800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:17.373254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:17.373977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:17.374452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:17.374892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:17.391643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:17.399191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:17.405041 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b433b52f-cbfe-42ff-8536-f24304423b8b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1594 microversion: 2.32 time: 0.191579 Oct 10 11:01:17.407200 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2285/4683] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:17 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1594 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:01:18.231257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:18.238957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:18.240260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:18.259850 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56291366-9d6d-4a40-ba67-c7b01d958129 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.902080 Oct 10 11:01:18.262317 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2399/4684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:17 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:18.263318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.264146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.264807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:18.266438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.267167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.267887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:18.359771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:18.360577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:18.369475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.371528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.372077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:18.374047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.377317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.378722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:18.837994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:18.850606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3f37069-650a-4749-9881-cdfa7fbbec2c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1519 microversion: 2.1 time: 0.625764 Oct 10 11:01:18.854819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2286/4685] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:18 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1519 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:18.867083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:18.870607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:18.892999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.897390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.899565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:18.900801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:18.903559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:18.904633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:19.069319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:19.074521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:19.093666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-371c9429-592c-4b63-9dd1-d507bb85be2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.738214 Oct 10 11:01:19.107780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:19.119904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:19.120669 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2400/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:18 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:19.122607 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0486fb0c-bb74-4ef2-8e2f-60473cb828d9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1594 microversion: 2.32 time: 0.265051 Oct 10 11:01:19.123597 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2287/4687] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:18 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1594 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:19.285576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:19.286557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:19.297273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:19.299605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:19.302744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:19.303828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:19.304417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:19.306494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:19.884566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:19.885208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:19.900651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:19.901451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:19.902268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:19.903195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:19.904230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:19.907658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:20.597621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:20.613987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8522b773-2416-49f8-aa05-bda4e7650766 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 1.333056 Oct 10 11:01:20.639724 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2401/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:19 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:20.646215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:20.656598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:20.688301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:20.689224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:20.689894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:20.691660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:20.692361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:20.692927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:20.759309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:20.772725 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83dc0906-f42c-428e-9bfe-6d9cdba48f54 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.892312 Oct 10 11:01:20.773831 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2288/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:19 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:20.780209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:20.797638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:20.845766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:20.846547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:20.847573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:20.848710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:20.849374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:20.850038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:21.670271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:21.705951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:21.720251 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9b40e85-dc8a-4219-97b8-3dd2b95dc09e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 1.079074 Oct 10 11:01:21.721662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:21.731806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2402/4690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:20 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:21.733619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:21.741310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-221468a3-b742-4786-822e-e2c352aa5261 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1662 microversion: 2.32 time: 0.965564 Oct 10 11:01:21.762252 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2289/4691] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:20 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1662 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:21.784665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:21.785983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:21.788324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:21.791282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:21.817475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:21.824913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:21.827023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:21.828361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:21.829013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:21.829768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:21.830465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:21.832205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:21.833042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:21.834669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:21.839479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:21.840567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:22.093800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:22.143665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:22.466272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:22.483635 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a688983a-cd18-469d-9cbd-d8a18c000fd3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1653 microversion: 2.1 time: 0.716691 Oct 10 11:01:22.484709 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2290/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:21 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1653 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:22.515512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:22.539041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:22.544203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:22.545083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:22.642948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:01:22.699121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:22.718585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d842636-2a6e-4040-b5a6-217becfee192 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.983461 Oct 10 11:01:22.739049 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2403/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:21 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:22.758628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:22.759485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:22.770427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:22.772211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:22.777697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:22.782103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:22.782764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:22.789603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:22.815289 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02843db9-6a6f-4740-a514-30af2efc7306 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.295677 Oct 10 11:01:22.839495 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2291/4694] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:22 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:01:22.857713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:22.867769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:22.895461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:22.902109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:22.905600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:22.906532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:22.908872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:22.910189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:23.532647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:23.547908 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e65568f7-0571-43f2-b047-eb06d08b5a4b tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.796885 Oct 10 11:01:23.549094 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2404/4695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:22 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:23.554280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:23.557488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:23.571500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:23.577999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:23.578693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:23.579886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:23.580118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:23.580555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:23.951778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:23.966383 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef41ba50-d887-414d-b738-f74f4db5ba0d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 1.124691 Oct 10 11:01:23.967938 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2292/4696] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:22 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:23.988341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:23.989495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:24.001656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:24.003711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:24.005844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:24.009279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:24.009852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:24.010228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:24.053872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:24.260902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:24.271252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:24.272686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:24.273895 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-012ae344-2826-439f-9cee-0a3c035cf16f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1709 microversion: 2.32 time: 0.723616 Oct 10 11:01:24.274471 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2405/4697] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:23 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1709 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:24.295862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46e7b4de-2283-4748-9997-c3f33e319021 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:24.312501 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-46e7b4de-2283-4748-9997-c3f33e319021 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46e7b4de-2283-4748-9997-c3f33e319021 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/df92c86c-d18a-4f58-9bc3-3dc49bdf0509/action HTTP/1.1 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: {"os-stop": {}} Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'df92c86c-d18a-4f58-9bc3-3dc49bdf0509', 'body': {'os-stop': {}}} Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:24.327440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. Oct 10 11:01:24.332668 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:24.336153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46e7b4de-2283-4748-9997-c3f33e319021 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance df92c86c-d18a-4f58-9bc3-3dc49bdf0509 has no mapping to a cell. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:24.355935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46e7b4de-2283-4748-9997-c3f33e319021 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/df92c86c-d18a-4f58-9bc3-3dc49bdf0509/action" status: 404 len: 117 microversion: 2.1 time: 0.079124 Oct 10 11:01:24.356849 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2406/4698] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:24 2022] POST /compute/v2.1/servers/df92c86c-d18a-4f58-9bc3-3dc49bdf0509/action => generated 117 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:01:24.374106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:24.375121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:24.401427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:24.411941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:24.413276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:24.415569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:24.416299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:24.417082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:24.910436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:25.580490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:25.594290 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-674849ca-78e9-444a-a37d-7a01a835e691 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1662 microversion: 2.1 time: 1.624847 Oct 10 11:01:25.610830 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2293/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:23 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1662 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:25.626313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:25.629048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:25.656515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:25.657018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:25.657463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:25.658188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:25.658650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:25.665419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:25.720693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:25.732202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab82a127-4fa6-4c61-aef1-6bdc2f6e8b0d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.370891 Oct 10 11:01:25.735796 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2407/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:24 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:25.746449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:25.749532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:25.767218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:25.767737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:25.768186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:25.769339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:25.771012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:25.772034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.321940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:26.328701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:26.336867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16eab10b-5217-4a63-b5ff-90a13dd40786 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.724831 Oct 10 11:01:26.337908 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2294/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:25 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:26.347485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:26.353501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:26.354354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:26.361021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:26.362905 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df795142-6373-471d-bc77-9630231236ef tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1756 microversion: 2.32 time: 0.623202 Oct 10 11:01:26.363553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2408/4702] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:25 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1756 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.375405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.620739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:26.621731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:26.633076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.633881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.636196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.637514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.640520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.641260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.663049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:26.816121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:26.830237 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf8d000c-7641-469c-a48a-830c78effcb9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.490128 Oct 10 11:01:26.833890 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2295/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:26 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:26.858755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:26.859886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 78b33be0-164a-40fe-b12d-a486136f4282] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:26.868393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/78b33be0-164a-40fe-b12d-a486136f4282/action HTTP/1.1 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 15 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: {"suspend": {}} Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '78b33be0-164a-40fe-b12d-a486136f4282', 'body': {'suspend': {}}} Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:26.873554 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 78b33be0-164a-40fe-b12d-a486136f4282 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:26.879297 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-446c0d27-8c23-493e-9e44-672b53d3ad73 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/78b33be0-164a-40fe-b12d-a486136f4282/action" status: 404 len: 111 microversion: 2.1 time: 0.023605 Oct 10 11:01:26.879800 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2296/4704] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:26 2022] POST /compute/v2.1/servers/78b33be0-164a-40fe-b12d-a486136f4282/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:01:26.890116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:26.890737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:26.906603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.907164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.930614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:26.931892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:26.932542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:26.934132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:27.016434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:27.038778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-464fce8c-4013-4021-a8db-f1abcde55c95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1662 microversion: 2.1 time: 0.420342 Oct 10 11:01:27.040531 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2409/4705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:26 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1662 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:27.323448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:27.332158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-672e1f0c-af86-465d-95ad-388702c018b4 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.446651 Oct 10 11:01:27.332761 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2297/4706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:26 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:27.365289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:27.366114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:27.367454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:27.368630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:27.382106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:27.382613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:27.383099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:27.383814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:27.384277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:27.384706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:27.398140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:27.404532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:27.404986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:27.412053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:27.414362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:27.420244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:27.943830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:27.956305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-477a1e42-b8c3-42cb-bacd-2298869fd65e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.595286 Oct 10 11:01:27.961244 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2298/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:27 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:27.980126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:27.981515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:27.983792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:27.991723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:27.998501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:27.999253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:28.000196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:28.005613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:28.006339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:28.207554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:28.225926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2872608-7758-49ed-bda5-a1757f8eae2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.869488 Oct 10 11:01:28.236110 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2410/4708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:27 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:28.260304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:28.260949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:28.280677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=82 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:28.285294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:28.286388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:28.286849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:28.288947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:28.290762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:28.291248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.103581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.123239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.126971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.138884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e40d3927-6b5e-4b74-a438-8e2f319ad8b3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1803 microversion: 2.32 time: 1.176287 Oct 10 11:01:29.151914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2299/4709] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:27 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1803 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:29.229773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:29.230242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:29.285663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.286164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.286634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.300081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.306902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.307474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.307932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.321949 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e818163f-0f01-4920-b929-2c3115aeeabe tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.074009 Oct 10 11:01:29.330158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2411/4710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:28 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:29.355256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:29.357321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:29.384784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.392377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.398873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.400522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.403766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.404416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.411417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lazy-loading 'flavor' on Instance uuid 0e5761c7-a969-4328-8d74-e0b31a0c915f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:01:29.521084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b70e980-009d-49ba-b798-a9d0628214d9 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.321607 Oct 10 11:01:29.527131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2300/4711] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:29 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:29.539613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:29.543120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:29.560951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.562698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.564354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.567411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.568048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.569952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.877469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.886150 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5128962c-39ad-4a19-970f-c0f744ca4baa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.357712 Oct 10 11:01:29.916279 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2301/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:29 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:29.918350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:29.922447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:29.923373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:29.928084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7eb54364-5e1c-4210-bf76-b67012a8ba89 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.593191 Oct 10 11:01:29.933343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.934107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.934717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.935671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.935948 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2412/4713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:29 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:29.953949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.962532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:29.963617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.970018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:29.977864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.978650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.979294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:29.980181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:29.980815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:29.981414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.038510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Unlocking {{(pid=128800) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 10 11:01:30.140048 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e87da82-0205-4479-93b5-ab07a7c5e6bb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.186732 Oct 10 11:01:30.141298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2413/4714] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:29 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:30.152391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:30.153392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:30.161126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.161973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.162642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.163621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.164327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.165002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.486081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:30.504894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae333711-6383-40e8-9772-f94bc1155f75 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1514 microversion: 2.1 time: 0.581199 Oct 10 11:01:30.506321 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2302/4715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:29 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1514 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:30.515932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:30.519629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:30.531886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.535293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.536092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.539651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.542277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.542908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.716031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:30.729284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0df1c9a-1a3b-4e7f-8406-24fc125f2922 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.578920 Oct 10 11:01:30.752334 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2414/4716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:30 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:30.757955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:30.764916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:30.777440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.778709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.779373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:30.780263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:30.782334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:30.785041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:31.653007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:31.667722 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c12a22c-bcce-42b8-abc4-21e686cfc91c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.910888 Oct 10 11:01:31.668945 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2415/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:30 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:31.679774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:31.681213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:31.693235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:31.700716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:31.701631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:31.702243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:31.703117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:31.705769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:31.707048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:31.708355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:31.711507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:31.729893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f76b99a2-dfd8-4dc9-aa81-197eed015a3b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1850 microversion: 2.32 time: 1.222100 Oct 10 11:01:31.730684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2303/4718] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:30 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1850 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:31.764653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:31.773532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:31.789830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:31.790630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:31.791305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:31.792096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:31.792627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:31.793429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.117912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:32.126458 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95ea5775-5879-4bcf-a151-abb6c0f73a96 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1497 microversion: 2.1 time: 0.372300 Oct 10 11:01:32.127079 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2304/4719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:31 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1497 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:32.158770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:32.160122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:32.176789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.177294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.177954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.178830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.179474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.187619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.335980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:32.351200 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61953ec0-3ce3-4388-8730-9fe5ccc5029a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.680509 Oct 10 11:01:32.353976 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2416/4720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:31 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:32.365817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:32.367562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:32.385744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.386464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.387104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.388067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.389491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.390105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.452260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lazy-loading 'flavor' on Instance uuid 0e5761c7-a969-4328-8d74-e0b31a0c915f {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:01:32.477723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'suspend' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state suspended Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: {"suspend": {}} Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'suspend' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state suspended Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'suspend': {}}} Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state suspended. Cannot suspend while the instance is in this state. Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 10 11:01:32.486465 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state suspended Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state suspended Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'suspend' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state suspended {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:32.493664 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a42c3f61-6874-433e-9ac7-f605db3a6d44 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 148 microversion: 2.1 time: 0.132842 Oct 10 11:01:32.495261 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2417/4721] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:32 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 148 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 11:01:32.506578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:32.507178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:32.525620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.526132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.535925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.537071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.537760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.538444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.688500 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96daf7b1-eee0-4bbb-b1a7-fc0f69b0a315 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 202 len: 0 microversion: 2.1 time: 0.189994 Oct 10 11:01:32.703581 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2418/4722] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:32 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:32.710827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:32.711858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:32.729297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.730260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.730948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.732218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.733042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.733715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.772230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:32.788429 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9469541-83a5-4824-a137-354662622343 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.636353 Oct 10 11:01:32.789312 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2305/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:32 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:32.794144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:32.803988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:32.824285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.839792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.841061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:32.842932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:32.844509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:32.855891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:33.829892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:33.845367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:33.858509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:33.859172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98ad6581-6547-49d9-b383-2691d3f8abc1 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1503 microversion: 2.1 time: 1.150364 Oct 10 11:01:33.859965 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2419/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:32 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1503 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:33.868319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:33.870235 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3132ff7-5770-476e-97e9-1f22f2bcd67e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1850 microversion: 2.32 time: 1.079793 Oct 10 11:01:33.871339 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2306/4725] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:32 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1850 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:33.881927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:33.890243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:33.896149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:33.896785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:33.910933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:33.916254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:33.917147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:33.919654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:33.928967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:33.929849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:33.931195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:33.931351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:33.931966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:33.932864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:33.936154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:33.936799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:34.140534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-affa4314-8e0b-4d89-a592-244656e38723 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.274010 Oct 10 11:01:34.145845 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2420/4726] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:33 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:34.452668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "ef417eee-43f2-4ecc-8d65-b4a386e3c1c1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:34.475779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:34.476315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:34.476790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:34.511110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] Creating event network-changed:ef417eee-43f2-4ecc-8d65-b4a386e3c1c1 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:34.522295 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6b95599f-1fa8-495c-b1c5-07a6e247f07b req-6c61e364-72b4-4846-936c-886cb1fb864c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374881 Oct 10 11:01:34.522920 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2421/4727] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:34.532624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:34.534349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:34.558908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:34.559477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:34.559932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:34.560671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:34.564338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:34.566976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:34.577618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:34.587623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:34.597533 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7da21116-40ce-463f-8714-b14e16073cf4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.713079 Oct 10 11:01:34.603072 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2307/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:33 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:34.887964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:34.889420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:34.898751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:34.907117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:34.907671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:34.908492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:34.909505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:34.909971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:35.233731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:35.247824 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24c927b1-59b0-410f-8c39-3982c5d3b3d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1651 microversion: 2.1 time: 0.719254 Oct 10 11:01:35.249114 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2422/4729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:34 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1651 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:35.258963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:35.259996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:35.266698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:35.267555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:35.268839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:35.269993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:35.271267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:35.271920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.174038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:36.197053 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75282a46-6040-4e4b-bdc2-4ec0494415c2 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1503 microversion: 2.1 time: 1.312869 Oct 10 11:01:36.216016 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2308/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:34 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1503 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:36.222271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:36.222271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:36.236495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.251784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.252706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.253645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.254289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.254881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.302195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:36.457110 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b5b6533-40d6-42ff-9229-173e8a533b08 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.239389 Oct 10 11:01:36.458060 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2309/4731] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:36 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:36.466300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:36.467027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:36.474453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.488178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.488890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.489819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.490442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.491082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.614080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:36.630618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:36.637865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:36.641702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c8c355d-c62d-4ae3-9312-934bfccd0f19 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1871 microversion: 2.32 time: 1.389559 Oct 10 11:01:36.642602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2423/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:35 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1871 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:36.660929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:36.662550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:36.693253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.696381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.697456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.701803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:36.703218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:36.704740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:36.982588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:36.995729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ea20de2-2871-4d78-b27b-b66fbded4752 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1723 microversion: 2.1 time: 0.536237 Oct 10 11:01:36.996861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2310/4733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:36 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1723 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:37.006874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "b6844420-e64a-422e-92aa-2e4e3e5ff595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:37.031432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.032174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.036317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.061657 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] Creating event network-changed:b6844420-e64a-422e-92aa-2e4e3e5ff595 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:37.072793 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f43bda06-69fb-4e27-818d-db30051c2908 req-c73d401d-553b-4380-9aff-48b2d773d9a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069345 Oct 10 11:01:37.074348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2311/4734] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:37.075763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:37.092496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc8f15e4-e69c-4311-9cfc-8f2f46eb9e12 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.447317 Oct 10 11:01:37.093339 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2424/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:36 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:37.124423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:37.125126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:37.135993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.139532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.140405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.141443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.142152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.142859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.245563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:37.246251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:37.261386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.261914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.262374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.265207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.265717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.267411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.823350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:37.836794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52292327-a2fe-4300-bb79-c2005e5d0a2e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.715933 Oct 10 11:01:37.853150 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2312/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:37 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:37.874267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:37.875224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:37.884233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.885022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.885681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.887259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:37.887935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:37.888620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:37.999760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.012815 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4eaf865-d0a9-4d70-866f-a79aab367e2d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.772923 Oct 10 11:01:38.014379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2425/4737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:37 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:38.036716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:38.039268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:38.047014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.048027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.050330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.051602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.052395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.053320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.306171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.327247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.340999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.342253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ac79574-d984-4416-9271-434d282929b9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1892 microversion: 2.32 time: 0.479473 Oct 10 11:01:38.342851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2313/4738] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:37 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1892 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:38.375184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.386187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:38.386187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:38.386408 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9cfd372-af40-4abb-bc60-3eb72fd9aee2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.369837 Oct 10 11:01:38.391152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2426/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:38 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:38.396369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:38.403556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:38.406628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.407705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.408359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.410425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.411293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.412196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.423033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.423543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.423996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.425627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.425956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.426389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.857887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.889632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:38.906036 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f25ce5f3-eeae-47ec-863f-65a68e3d5d0e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.513671 Oct 10 11:01:38.912571 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69eb5d41-c377-4710-a6d0-943e104cf5c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1700 microversion: 2.1 time: 0.551195 Oct 10 11:01:38.913170 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2314/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:38 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1700 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:38.919688 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2427/4741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:38 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:38.932152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:38.932783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:38.933201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:38.933758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 9c39dbd7-409c-4025-b990-0ececdd936ab] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:38.943730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/9c39dbd7-409c-4025-b990-0ececdd936ab/action HTTP/1.1 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: {"unpause": {}} Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '9c39dbd7-409c-4025-b990-0ececdd936ab', 'body': {'unpause': {}}} Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:38.945422 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 9c39dbd7-409c-4025-b990-0ececdd936ab could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:38.951345 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f43ecb51-640f-47c8-9f9a-d03ef817f545 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/9c39dbd7-409c-4025-b990-0ececdd936ab/action" status: 404 len: 111 microversion: 2.1 time: 0.018027 Oct 10 11:01:38.958155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.958810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.960746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.961285 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2428/4742] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:38 2022] POST /compute/v2.1/servers/9c39dbd7-409c-4025-b990-0ececdd936ab/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:01:38.962032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.962809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.963985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:38.966572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:38.980817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:38.984122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:38.984765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.036561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Going to try to start instance {{(pid=128800) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:01:39.126421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-985eafc8-16e8-4bd9-89b8-34ade3241ac1 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action" status: 202 len: 0 microversion: 2.1 time: 0.163678 Oct 10 11:01:39.131180 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2429/4743] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:38 2022] POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:01:39.141791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:39.143115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:39.152654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.153296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.154047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.170451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.171336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.172115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.617023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:39.626742 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea3c0c99-13a4-45f8-8896-57d1fe1e2109 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.712373 Oct 10 11:01:39.631431 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2315/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:38 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:39.640261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:39.644188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:39.662254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.663039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.663671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.664825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.665448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.666292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.746266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:39.757215 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8014b5c9-889d-4a4c-9006-2205592cf299 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.624093 Oct 10 11:01:39.759470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2430/4745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:39 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:39.774730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:39.775719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:39.793667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.793924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.794454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:39.795241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:39.795721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:39.799633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:40.813989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:40.838703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d7f5671-ff89-4422-829f-db0382441c03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1709 microversion: 2.1 time: 1.205774 Oct 10 11:01:40.839612 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2316/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:39 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1709 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:40.854130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "6c90b31c-cd92-49d2-aa0d-2ad7d7935346"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:40.856834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:40.866380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:40.867867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:40.869068 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6706e822-393b-45a8-b52d-a66755a3a610 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1892 microversion: 2.32 time: 1.107882 Oct 10 11:01:40.869624 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2431/4747] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:39 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1892 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:40.874505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:40.875366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:40.891050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:40.891858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:40.892485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:40.893945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:40.894579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:40.895239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:40.895366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:40.895794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:40.897945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:40.921183 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] Creating event network-changed:6c90b31c-cd92-49d2-aa0d-2ad7d7935346 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:40.933813 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-101f6ea7-73a7-4382-8916-e2486158a1c2 req-854c697f-32e4-40ba-bbdb-59ccae41bce8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092716 Oct 10 11:01:40.935227 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2317/4748] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:40.941277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:40.946483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:40.966055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:40.966648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:40.967209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:40.967839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:40.968293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:40.968719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:42.358958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:42.374109 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-358da9cc-56c5-4bb3-b630-b7045fba3f52 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.500322 Oct 10 11:01:42.377691 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2432/4749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:40 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:42.389268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:42.392340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:42.405021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:42.409133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:42.411339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:42.414422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:42.415161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:42.415800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:42.658218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:42.668320 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea91e885-e363-44a4-b2e0-d560a34cd3cc tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 1.731721 Oct 10 11:01:42.670963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2318/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:40 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:42.676123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:42.684121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:42.700839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:42.701666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:42.702270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:42.703186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:42.703811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:42.704396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.342007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:43.359147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:43.369741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:43.372888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:43.384690 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1797ce5-7b92-4cc7-b655-7d0b10242950 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1892 microversion: 2.32 time: 0.712423 Oct 10 11:01:43.389221 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2319/4751] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:42 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1892 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:43.397568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:43.400248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7bf307b2-855b-4bb7-bf95-000501b117e3 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1709 microversion: 2.1 time: 1.019551 Oct 10 11:01:43.401692 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2433/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:42 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1709 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:43.404033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:43.415555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.416326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.419366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:43.419785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.420157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:43.420868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.421511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.422104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.438130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.438715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.440441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.442577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.444713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.445212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.531756 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'unpause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 15 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: {"unpause": {}} Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'unpause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'unpause': {}}} Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state active. Cannot unpause while the instance is in this state. Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:43.539501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:43.547530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:43.547530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:43.547530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:43.547530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:43.547530 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:43.552138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'unpause' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:43.556315 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d84f9896-6bee-49e0-99aa-0b6f6e4bc4a6 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 145 microversion: 2.1 time: 0.152099 Oct 10 11:01:43.560421 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2434/4753] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:43 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 145 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 11:01:43.570258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "9b5d88be-0f1d-4984-b018-d971f0cb8488"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:43.590164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.591163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.592219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.641496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] Creating event network-changed:9b5d88be-0f1d-4984-b018-d971f0cb8488 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:43.660247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-53d3ce68-5e84-450a-8032-2aaab9320bd7 req-0a8f9cb2-a121-4e61-9580-911bbf1d46be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093122 Oct 10 11:01:43.662194 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2435/4754] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:43.682905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:43.686011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:43.702477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.704467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.707683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:43.712034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:43.715205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:43.716146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:44.489299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:44.512287 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d466e7b-16ad-4214-b1ec-5268f8bd8cbc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.118498 Oct 10 11:01:44.516313 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2320/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:43 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:44.542953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:44.543998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:44.550568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:44.551444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:44.552085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:44.552982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:44.553812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:44.554713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:44.572921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:44.587454 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ec707ab-42ed-4f43-9c89-8c55fa0ac895 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.919472 Oct 10 11:01:44.590401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2436/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:43 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:44.604003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:44.606931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:44.629995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:44.630539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:44.631027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:44.635225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:44.635798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:44.636281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:45.272532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:45.293208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:45.295201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:45.295976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:45.298933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02064bbd-8b59-4ea9-9f27-b470f2430559 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.762374 Oct 10 11:01:45.311208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fafd2a1-8bbe-45d1-bc55-1f6d2f3f5d8a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1713 microversion: 2.1 time: 0.712943 Oct 10 11:01:45.311208 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2437/4757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:44 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1713 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:45.313472 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2321/4758] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:44 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:45.326909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:45.327566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:45.347275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:45.347777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:45.348227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:45.348954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:45.349606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:45.350198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:45.686331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "d4742c03-23a9-4fa4-9122-c52d2657aabe"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:45.706332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:45.707149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:45.707820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:45.725808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] Creating event network-changed:d4742c03-23a9-4fa4-9122-c52d2657aabe for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:45.740644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f096ecc0-4b62-4753-8f39-6e31026265a4 req-11666dba-971d-461e-8b97-9e4913b2b7e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061131 Oct 10 11:01:45.742246 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2322/4759] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:45.946971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:45.955742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f626f2e-7a89-4e5c-813c-abc25e724e35 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.649731 Oct 10 11:01:45.959644 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2438/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:45 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:45.999719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:46.000433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 08ab3e2d-3749-4522-be4e-2601ab40031a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:46.011154 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/08ab3e2d-3749-4522-be4e-2601ab40031a/action HTTP/1.1 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 18 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: {"unshelve": null} Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '08ab3e2d-3749-4522-be4e-2601ab40031a', 'body': {'unshelve': None}} Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:46.020123 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. Oct 10 11:01:46.027298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:46.031600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 08ab3e2d-3749-4522-be4e-2601ab40031a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:46.032441 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cd233a6-99fc-40e2-a17f-c4c4765fd4d5 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/08ab3e2d-3749-4522-be4e-2601ab40031a/action" status: 404 len: 111 microversion: 2.1 time: 0.046628 Oct 10 11:01:46.033049 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2323/4761] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:45 2022] POST /compute/v2.1/servers/08ab3e2d-3749-4522-be4e-2601ab40031a/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:01:46.043370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:46.044133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:46.063756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.064903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.065719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:46.066969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.067706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.068383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:46.331048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:46.331927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:46.355283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.356096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.359547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:46.360649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.361352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.362908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:46.472532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:46.485101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:46.489044 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44270af6-904d-470d-a0a5-b6117c4df107 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.450371 Oct 10 11:01:46.492626 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2439/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:46 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:46.521683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:46.522623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:46.543030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.545976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.550371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:46.553980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:46.556883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:46.557603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.245189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:47.260185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:47.270653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-000971e8-0282-469b-ab17-dcdf64d539b7 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.753664 Oct 10 11:01:47.272572 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2440/4763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:46 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:01:47.275044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:47.276854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:47.278334 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-daf454a2-d03e-4489-82c5-c09d0754a63c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.953590 Oct 10 11:01:47.279433 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2324/4764] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:46 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:47.316103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:47.317140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:47.328182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.333229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.334956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.335938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.337422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.337874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.397589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Cannot 'unshelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action HTTP/1.1 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 18 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: {"unshelve": null} Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: exception: Cannot 'unshelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'unshelve': None}} Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f in vm_state active. Cannot unshelve while the instance is in this state. Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 11:01:47.399600 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active Oct 10 11:01:47.404719 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:47.406612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 409 to user: Cannot 'unshelve' instance 0e5761c7-a969-4328-8d74-e0b31a0c915f while it is in vm_state active {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:47.415455 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83d890f5-3935-4fe0-8919-8ae6a1b9191f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action" status: 409 len: 146 microversion: 2.1 time: 0.110521 Oct 10 11:01:47.416414 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2441/4765] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:01:47 2022] POST /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f/action => generated 146 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 11:01:47.424822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:47.425388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:47.433575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.434181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.434704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.435561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.436376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.437155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.670163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:47.682566 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32b080b3-7957-482a-8e1f-aced6697aa71 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.261536 Oct 10 11:01:47.684028 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2325/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:47 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:47.712308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:47.714241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:47.727946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.729508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.730540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.740175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.741407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.744625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.829088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "9103eba2-b909-4e1e-b25f-b6d0a9eb4b97"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:47.842167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:47.843148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:47.843980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:47.871992 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] Creating event network-changed:9103eba2-b909-4e1e-b25f-b6d0a9eb4b97 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:47.879389 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a07348cd-058d-461a-826e-fa05ba71bbc0 req-4da5a3fd-4298-46a0-a550-80690070ce75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053815 Oct 10 11:01:47.880645 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2326/4767] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:01:48.170744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:48.201848 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca834155-24a9-4dd0-95ff-630e05590558 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.486514 Oct 10 11:01:48.204565 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2442/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:47 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:48.231867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1253941614_updated"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:48.234633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: d313c6e9-80a0-46ca-8e96-c55898f1627b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:48.251759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/d313c6e9-80a0-46ca-8e96-c55898f1627b HTTP/1.1 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 81 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1253941614_updated"}} Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd313c6e9-80a0-46ca-8e96-c55898f1627b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1253941614_updated'}}} Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 10 11:01:48.253888 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance d313c6e9-80a0-46ca-8e96-c55898f1627b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:48.262544 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85c0e391-1f5d-42de-98d4-f109105dac4a tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "PUT /compute/v2.1/servers/d313c6e9-80a0-46ca-8e96-c55898f1627b" status: 404 len: 111 microversion: 2.1 time: 0.028421 Oct 10 11:01:48.265493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:48.266127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:48.271159 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2327/4769] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 11:01:48 2022] PUT /compute/v2.1/servers/d313c6e9-80a0-46ca-8e96-c55898f1627b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:01:48.273115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.273846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.274524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.275463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.276140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.276739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.318424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:48.319357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:48.334620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.335909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.336548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.337515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.338615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.339280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.820657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:48.851910 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc2057aa-5424-42eb-b27a-516149b84b3d tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.590066 Oct 10 11:01:48.869561 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2443/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:48 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:48.881498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:48.882474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:48.888911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.889502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.890026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.890827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:48.891599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:48.892301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:48.915059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:48.925891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:48.928325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:48.929936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1431c0e-4734-45d6-bd1d-11e47f63d289 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.616071 Oct 10 11:01:48.948435 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2328/4771] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:48 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:01:49.269103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:49.284699 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba7f9726-8d2f-4f76-8b86-0bf1bcf2340c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.407606 Oct 10 11:01:49.295047 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2444/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:48 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:49.312897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-161c4b40-ad85-41f9-a7b5-277ab3124c7f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-161c4b40-ad85-41f9-a7b5-277ab3124c7f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f HTTP/1.1 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 280 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.318785 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-161c4b40-ad85-41f9-a7b5-277ab3124c7f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-161c4b40-ad85-41f9-a7b5-277ab3124c7f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 400 len: 619 microversion: 2.1 time: 0.012366 Oct 10 11:01:49.324906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2329/4773] 10.222.0.16 () {60 vars in 1257 bytes} [Mon Oct 10 11:01:49 2022] PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 11:01:49.334003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:49.334671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:49.341570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.342327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.342976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:49.344270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.344749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.345188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:49.689827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:49.699436 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d86ce1c5-cf3f-4e8d-bbd7-228f0a1c1848 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.371553 Oct 10 11:01:49.700612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2445/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:49 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:49.727969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:49.728595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:49.736563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.737332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.737986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:49.738889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.739542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.740168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:49.959410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:49.960126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:49.969275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.970040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.971278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:49.972317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:49.973018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:49.973823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:50.038828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:50.041761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:50.050162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86ad7dfe-e757-4737-8e55-d2aa91fbfe5f tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.325889 Oct 10 11:01:50.051479 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2330/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:49 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:50.075708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cb12dbb-4e38-4bd1-a4ab-b854916d3fa0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cb12dbb-4e38-4bd1-a4ab-b854916d3fa0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f HTTP/1.1 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 24 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: {"server": {"name": ""}} Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f', 'body': {'server': {'name': ''}}} Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:01:50.078596 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 11:01:50.084688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:50.087238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cb12dbb-4e38-4bd1-a4ab-b854916d3fa0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:50.089449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cb12dbb-4e38-4bd1-a4ab-b854916d3fa0 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 400 len: 108 microversion: 2.1 time: 0.019321 Oct 10 11:01:50.093882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2331/4776] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 11:01:50 2022] PUT /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 11:01:50.103009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:50.103974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:50.112219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:50.113247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:50.113899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:50.115370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:50.116140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:50.116809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:50.485306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:50.494516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:50.496212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:50.497508 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6f38c614-f646-4213-9891-f37d238737be tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.542386 Oct 10 11:01:50.498549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2446/4777] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:49 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:50.504658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "b305834f-1ac8-45ca-a45f-a0c20cb5d72b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:01:50.516110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:50.516938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:50.517696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:50.557384 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] Creating event network-changed:b305834f-1ac8-45ca-a45f-a0c20cb5d72b for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:01:50.564178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d79b3a95-6adb-4558-9fd4-a8cc04821989 req-c841e017-d386-465d-a26f-e949dccf20e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064438 Oct 10 11:01:50.565828 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2447/4778] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:01:50.633239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:50.652195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f0f4466-030e-4a42-9d5f-61a72d09f962 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1506 microversion: 2.1 time: 0.556395 Oct 10 11:01:50.652851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2332/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:50 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:51.530648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:51.531454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:51.560194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:51.561916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:51.564087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:51.566382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:51.568104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:51.568688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:53.446472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:53.460552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:53.462067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:53.463546 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6b41dd2-f35e-4d71-8403-b05da5a97686 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 1.939095 Oct 10 11:01:53.464118 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2448/4780] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:51 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:54.494722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:54.495394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:54.510739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:54.519847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:54.520316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:54.521061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:54.521518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:54.521954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:54.917133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:54.950774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:54.953211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:54.954579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f018ddb-063e-485b-9bb3-89bfee3032d4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.464535 Oct 10 11:01:54.956669 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2333/4781] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:54 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:55.984738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:55.986623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:55.998774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:56.003677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:56.004519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:56.005594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:56.008535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:56.009176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:56.276010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:56.291073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:56.294939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:56.300685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-807d15ff-8323-4693-8a43-d21334265255 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.321471 Oct 10 11:01:56.301612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2449/4782] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:55 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:57.337942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:57.339017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:57.351145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.351904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.353200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.354719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.355651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.356239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.715057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:57.716188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:57.723683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.724162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.727476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:57.730512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.732044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.735783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.736605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.743360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:57.751331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:57.752874 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-926a4447-d2d1-492b-81fb-b70c4f2f5d1d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.424859 Oct 10 11:01:57.753979 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2334/4783] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:57 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:01:57.772952 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 HTTP/1.1 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0'} Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:57.774710 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b00feca6-d829-4d74-8547-f6b700dd6934 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 404 len: 111 microversion: 2.1 time: 0.065924 Oct 10 11:01:57.779440 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2450/4784] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:01:57 2022] DELETE /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:01:57.785950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:57.786571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:57.797116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.797618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.798089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.804678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.805213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.805659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.840921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 HTTP/1.1 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0'} Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:01:57.842556 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. Oct 10 11:01:57.848166 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:01:57.849121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:01:57.850037 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31df4efd-7b58-48a8-9956-d272fdae3a08 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0" status: 404 len: 111 microversion: 2.1 time: 0.068903 Oct 10 11:01:57.850943 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2335/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:57 2022] GET /compute/v2.1/servers/eaf1e7a1-56f9-4da3-923f-4051b7e2f2a0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:01:57.858734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:57.859288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:57.866679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.867220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.867672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.868402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:57.868870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:57.869309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:57.897738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:01:58.011830 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fffb587f-a328-429d-9b09-dd669c8ae111 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 204 len: 0 microversion: 2.1 time: 0.155875 Oct 10 11:01:58.013552 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2451/4786] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:01:57 2022] DELETE /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:01:58.024878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:58.026066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:58.029850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=70 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:58.035209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:58.036005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:58.036611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:58.037921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:58.038499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:58.039064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:58.461322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:58.477061 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be8bb1da-57f7-41a6-8c8e-f8134d307670 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 0.457328 Oct 10 11:01:58.500349 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2336/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:58 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:01:58.787471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:58.789947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:58.797517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:01:58.820326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:58.820842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:58.821294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:58.822028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:58.822496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:58.822923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:59.510306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:01:59.511078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:01:59.526049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:59.528744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:59.529309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:59.532560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:01:59.534236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:01:59.536744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:01:59.638979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:59.656424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:59.659949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:01:59.661197 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fbe3698a-8c5b-4250-9fed-a991ac515635 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.882360 Oct 10 11:01:59.664836 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2452/4788] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:01:58 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:00.126532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:00.136542 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfff5c1b-a92e-4fc1-b712-4cd705ce0f3e tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1512 microversion: 2.1 time: 0.630374 Oct 10 11:02:00.143153 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2337/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:01:59 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:02:00.693295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:00.693931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:00.710722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:00.711617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:00.712235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:00.713386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:00.714536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:00.715233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:01.171205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:01.171834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:01.174367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:01.182277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:01.182781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:01.183240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:01.188863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:01.189575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:01.191105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:01.191571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:01.193680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:01.195708 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cfb9d37a-2396-46ce-a33f-584b4f81c1c4 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.506654 Oct 10 11:02:01.217950 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2453/4790] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:00 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:01.371670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79a951557ef44ce88ccb6219e784dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f897475932274086b7c53142bdc1143f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:01.384789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5761c7-a969-4328-8d74-e0b31a0c915f", "name": "network-vif-deleted", "tag": "e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:01.405482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f0a9d1e-9f89-4e21-8a64-c50d56c6b711 tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 200 len: 1470 microversion: 2.1 time: 0.239392 Oct 10 11:02:01.406889 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2338/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:01 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:01.408940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:01.409490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:01.410003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:01.439814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] Creating event network-vif-deleted:e6c45e4b-9baf-47fa-9bd0-4d5025f14cc1 for instance 0e5761c7-a969-4328-8d74-e0b31a0c915f on n-h1-860687-2 Oct 10 11:02:01.451144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-97cc3b55-1f12-4ed3-bcbe-f2aed7d136eb req-b19ebfb3-0628-45f1-98e1-82ae0c015bdf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069947 Oct 10 11:02:01.456481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2454/4792] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:02:02.227119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:02.227982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:02.243127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:02.244080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:02.244750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:02.245784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:02.246495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:02.247270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:02.444365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:02.446957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] [instance: 0e5761c7-a969-4328-8d74-e0b31a0c915f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:02.463446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:02.465832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:02.466441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:02.467502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:02.468352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:02.475185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:02.495696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] HTTP exception thrown: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Request method failure captured: Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f HTTP/1.1 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_qtrOsTr4iQDqS4BzZK5TKTHacbDLP9UT1cy5SnPVNU7Xu-gSYxSYHNbviDNHwXkBfdLT8kgbxSc_0eHdJZToKa6TIZWG3256L7-ctyQI5SvtkQuqzgvX1yh1fzOKLrxYXceHT7gy7Qr5pWpNx3KwctRI2fR7ZZARJgbb6DEMbnle0 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f897475932274086b7c53142bdc1143f Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f897475932274086b7c53142bdc1143f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f897475932274086b7c53142bdc1143f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f897475932274086b7c53142bdc1143f"}]}] Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f897475932274086b7c53142bdc1143f Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1182027613 Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a79a951557ef44ce88ccb6219e784dbf Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1182027613-project Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '0e5761c7-a969-4328-8d74-e0b31a0c915f'} Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:02:02.498835 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. Oct 10 11:02:02.505469 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:02:02.507335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] Returning 404 to user: Instance 0e5761c7-a969-4328-8d74-e0b31a0c915f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:02:02.510979 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f02b8c63-ae62-4cc3-a651-4738c3ad417c tempest-ServersNegativeTestJSON-1182027613 tempest-ServersNegativeTestJSON-1182027613-project] 10.222.0.16 "GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f" status: 404 len: 111 microversion: 2.1 time: 0.081673 Oct 10 11:02:02.512104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2455/4793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:02 2022] GET /compute/v2.1/servers/0e5761c7-a969-4328-8d74-e0b31a0c915f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:02:03.083220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:03.093063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:03.094500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:03.111361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ada52912-07d6-412f-9dd6-45769ba15aee tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.874122 Oct 10 11:02:03.112711 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2339/4794] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:02 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:03.662080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:03.665362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:03.703435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:03.705057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:03.705820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:03.706881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:03.708252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:03.708994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:03.826671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:03.856957 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a273261-53b0-42a0-a2f4-a97d8f6ebad0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.210164 Oct 10 11:02:03.861527 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2456/4795] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:02:03 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:02:03.866468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:03.867179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:03.883340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:03.883968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:03.884414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:03.885158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:03.885623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:03.886473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:04.142553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:04.144417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:04.161546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:04.162352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:04.163921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:04.169373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:04.169919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:04.170382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:04.684782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:04.700215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb85ebbb-d44a-4d2d-9152-e19f5f4711d8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1668 microversion: 2.1 time: 0.836180 Oct 10 11:02:04.702044 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2340/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:03 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1668 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:04.788800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:04.801843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:04.806625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:04.808665 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d081b546-200d-49af-bb89-a4ad243e3d9d tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.671512 Oct 10 11:02:04.810001 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2457/4797] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:04 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:05.726891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:05.728296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:05.737895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:05.738940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:05.739622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:05.740545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:05.741317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:05.741962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:05.843017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:05.843638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:05.851584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:05.852090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:05.852536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:05.853339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:05.853786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:05.863985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:06.291356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:06.304768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:06.307072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:06.309840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-632ea3c6-394c-4bf1-9706-f7f730ba7f9c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.473328 Oct 10 11:02:06.327346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:06.341165 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2458/4798] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:05 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:06.347728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92bafb1b-8fc9-4e28-baca-5f3c655a6515 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1668 microversion: 2.1 time: 0.625526 Oct 10 11:02:06.352188 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2341/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:05 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1668 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:07.341334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:07.342584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:07.354462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:07.354969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:07.355449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:07.356185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:07.356652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:07.357094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:07.390525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:07.391063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:07.402873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:07.403588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:07.404460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:07.405257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:07.406473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:07.407121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:08.304365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:08.315258 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9dd1ff84-da58-415a-b51a-02575faddd3c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1673 microversion: 2.1 time: 0.930671 Oct 10 11:02:08.316733 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2342/4800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:07 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1673 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:08.553149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:08.568062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:08.569923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:08.571368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8bda7e0b-49cd-4ad1-a5dc-c2bd01446edf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 1.234185 Oct 10 11:02:08.572868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2459/4801] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:07 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:09.342300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:09.342919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:09.350339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:09.351245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:09.352170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:09.353266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:09.354149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:09.354750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:09.599909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:09.606646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:09.624051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:09.624619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:09.625093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:09.625911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:09.630499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:09.631803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:10.874855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:10.885294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b74cdc2c-593b-4458-8671-94ff6d888511 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1673 microversion: 2.1 time: 1.546938 Oct 10 11:02:10.910137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2343/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1673 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:11.339108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:11.388105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:11.396238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:11.404229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d485fcf1-a3a5-4efe-8633-1127ee69551a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 1.804489 Oct 10 11:02:11.409333 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2460/4803] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:09 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:11.920303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:11.922979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:11.949628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:11.950394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:11.950951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:11.951841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:11.953973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:11.955986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:12.437930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:12.438846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:12.462674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:12.472927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:12.473913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:12.474890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:12.480556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:12.482793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:12.937079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:12.956040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:12.964027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:12.965685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b423de9-84b5-4c38-9619-9e3b4121592a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.532831 Oct 10 11:02:12.968149 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2461/4804] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:12 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:13.043244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:13.053840 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5c6a2bd-a303-4b7e-a891-314771505617 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.138789 Oct 10 11:02:13.055185 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2344/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:13.848533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:13.849731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:13.864256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:13.866297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:13.867825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:13.868828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:13.874677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:13.875629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:13.994414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:13.995423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:14.021570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lazy-loading 'services' on Instance uuid 1bc02db9-8522-4c05-a7d5-b215863e5054 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:02:14.025412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:14.026261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:14.026568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:14.027337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:14.043409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:14.044612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:14.194165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b1d7866-0fa3-4efe-9b00-ad21e4849912 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments/7372eae6-9549-458d-b8cb-00ca2fc54c47" status: 202 len: 0 microversion: 2.1 time: 0.361857 Oct 10 11:02:14.194907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2462/4806] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:02:13 2022] DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments/7372eae6-9549-458d-b8cb-00ca2fc54c47 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:02:14.559692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:14.572741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:14.574629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:14.576178 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-553b39ac-184d-4081-ac09-cfe3693775e9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.586270 Oct 10 11:02:14.577210 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2345/4807] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:13 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:15.608185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:15.608946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:15.625047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:15.627687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:15.628412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:15.630081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:15.632313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:15.632948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:16.177754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:16.202253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:16.204167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:16.212247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46cf1649-dd2a-4240-9472-a7f35a251ee5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.608325 Oct 10 11:02:16.213130 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2463/4808] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:15 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:17.250190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:17.252727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:17.275956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:17.276960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:17.277883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:17.278652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:17.283902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:17.284290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:18.232326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:18.256693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:18.258549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:18.262479 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-714f1193-b585-4c16-adc1-9fb499c8dcdf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 1.019744 Oct 10 11:02:18.263327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2346/4809] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:17 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:19.296918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:19.297657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:19.315025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:19.321243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:19.323088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:19.324029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:19.325677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:19.331612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:19.431755 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:02:19.432011 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 (ip 10.222.0.16) !!! Oct 10 11:02:19.657564 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:02:19.658005 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 (ip 10.222.0.16) !!! Oct 10 11:02:19.972710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:19.990501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:19.992558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:19.994083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a295f86-5f23-485f-9253-c1daaf20b66e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.702510 Oct 10 11:02:19.997906 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2464/4810] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:19 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:21.026333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:21.027037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:21.056059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:21.059293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:21.063717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:21.066802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:21.071632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:21.074188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:21.094388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=88 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:21.856455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:21.881766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:21.889002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:21.894679 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7beeafc-0a85-4541-a2f5-c7c15a1d8c9a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.872810 Oct 10 11:02:21.896254 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2347/4811] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:21 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:22.926805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:22.930025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:22.945573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:22.950165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:22.952346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:22.955418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:22.959407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:22.960125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:23.452171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:23.466453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:23.467144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:23.470198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:23.522530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:02:23.551740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:23.566016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:23.575203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:23.580055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0a21a31-806b-4aa1-b1cb-d8961b619612 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.657408 Oct 10 11:02:23.581130 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2465/4812] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:22 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:23.629638 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8093929d-4225-491c-a4b4-042c1ee014c6 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action" status: 202 len: 0 microversion: 2.1 time: 0.181623 Oct 10 11:02:23.631877 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2348/4813] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:02:23 2022] POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:02:23.640834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:23.641891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:23.654214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:23.655082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:23.655824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:23.659268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:23.660042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:23.663260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:24.085932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:24.101395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f161fda-450d-45c6-8651-11cb8bfd87ba tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.463599 Oct 10 11:02:24.102159 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2466/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:23 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:24.613916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:24.614525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:24.630792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:24.633775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:24.634771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:24.637056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:24.637647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:24.638122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:25.127878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:25.129094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:25.145801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:25.148412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:25.149234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:25.151408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:25.152150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:25.153340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:25.223422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:25.243462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:25.245527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:25.247071 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38a86a7d-870c-463e-af08-7be345b22302 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.641537 Oct 10 11:02:25.260082 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2349/4815] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:24 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:25.586180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:25.597574 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47d8972c-3f17-4e0a-bda0-953dd46503bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.475072 Oct 10 11:02:25.601219 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2467/4816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:25 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:02:26.275475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:26.276101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:26.287035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:26.299904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:26.300373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:26.301423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:26.302125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:26.302735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:26.626409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:26.627243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:26.644508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:26.646808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:26.647315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:26.650052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:26.650584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:26.651047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:26.863057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:26.885313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:26.888936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:26.892430 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc7b9bab-5e92-492d-a33a-27114b8a64e3 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.619062 Oct 10 11:02:26.893451 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2350/4817] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:26 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:27.155526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:27.167774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3c531c2-13fb-48f4-9121-1ef6bc1f7918 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.547105 Oct 10 11:02:27.171589 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2468/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:26 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:27.921652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:27.923145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:27.940610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:27.941120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:27.941566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:27.942341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:27.942807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:27.943276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:28.196851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:28.197704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:28.200251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:28.213327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:28.215657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:28.217164 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f906332d-7921-4317-ad86-b74d5a255f79 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.299357 Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:28.231034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:28.232475 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2351/4819] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:27 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:28.419257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:28.428650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-49a5bae2-e568-4be2-b43a-766f02fba94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.236863 Oct 10 11:02:28.431586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2469/4820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:28 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:29.251875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:29.255400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:29.276334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:29.280292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:29.281081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:29.284231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:29.285268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:29.287118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:29.288415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:29.457171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:29.457791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:29.460827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:29.477794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:29.481101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:29.486213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:29.490208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:29.491412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:29.494363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:29.991227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:30.001130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:30.002628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:30.014485 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62e59ccd-e25f-4e61-92b0-076c23d04ecd tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.769094 Oct 10 11:02:30.015453 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2352/4821] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:29 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:30.059728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:30.073985 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bcbab056-6378-4ed6-944d-e1e97f4b4854 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.619090 Oct 10 11:02:30.075127 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2470/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:29 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:31.046256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:31.048092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:31.067975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:31.068601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:31.069054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:31.069788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:31.070455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:31.071118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:31.107401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:31.108036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:31.126482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:31.127033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:31.127470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:31.135847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:31.136322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:31.136778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:31.887788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:31.908295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:31.920466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:31.922240 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.880798 Oct 10 11:02:31.935090 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2353/4823] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:31 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:32.370497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:32.372199 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1fb2dece-bbe1-4b97-b752-23d446985ed5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002069 Oct 10 11:02:32.372556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2354/4824] 10.222.0.16 () {56 vars in 886 bytes} [Mon Oct 10 11:02:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 11:02:32.478281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:32.496677 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca29660b-9fd7-4d6f-81f6-300f0231f6ee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 1.387931 Oct 10 11:02:32.498807 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2471/4825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:31 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:32.951791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:32.952413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:32.966584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:32.967102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:32.967463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:32.968177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:32.971829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:32.972644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:33.526235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:33.528534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:33.540140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:33.541015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:33.541714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:33.542735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:33.543579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:33.544706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:33.743876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:33.763064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:33.765096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:33.767778 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0287202-8eb9-46df-8f2b-d882a0f5cc30 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.820249 Oct 10 11:02:33.768922 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2355/4826] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:32 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:34.094939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:34.107298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:34.182416 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be09388a-7abf-4f6a-9e3d-c14b545e1e03 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1677 microversion: 2.1 time: 0.662457 Oct 10 11:02:34.189124 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2472/4827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:33 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1677 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:02:34.800583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:34.801528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:34.821021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:34.822876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:34.827787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:34.832350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:34.832861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:34.838147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:35.212649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:35.218457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:35.225438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:35.231281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:35.233585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:35.237651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:35.239316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:35.240820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:35.242525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:35.244064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:35.245625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:35.259575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-342e71e1-aef8-42bb-8bb3-935e31931443 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.461073 Oct 10 11:02:35.260680 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2356/4828] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:34 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:35.689234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:35.708602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b9d8a57-781a-4eaf-b7fd-7b554d19e0cf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1654 microversion: 2.1 time: 0.501507 Oct 10 11:02:35.714209 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2473/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:35 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1654 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:35.753246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:35.766217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:35.767550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:35.770320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:35.809706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:02:35.901969 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54967617-f534-40ef-9566-d566f97e6ecf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action" status: 202 len: 0 microversion: 2.1 time: 0.163395 Oct 10 11:02:35.905772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2357/4830] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:02:35 2022] POST /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:02:35.914294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:35.915807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:35.922340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:35.926015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:35.926664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:35.927852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:35.932066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:35.932814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:36.291627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:36.292455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:36.309233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:36.313128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:36.316339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:36.317350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:36.318985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:36.324919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:36.794222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:36.808016 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0596d64-0e60-4f43-b167-d9b5af76c94d tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1663 microversion: 2.1 time: 0.898848 Oct 10 11:02:36.809522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2474/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:35 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1663 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:36.971600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:36.984478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:36.987686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:36.991429 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43d6456f-6aab-4ede-9b1f-f03e0352a224 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.703268 Oct 10 11:02:36.993168 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2358/4832] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:36 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:37.657867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "9103eba2-b909-4e1e-b25f-b6d0a9eb4b97"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:37.679344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:37.680147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:37.680764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:37.706807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] Creating event network-vif-plugged:9103eba2-b909-4e1e-b25f-b6d0a9eb4b97 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:37.717447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ee4bcb09-43db-44be-a465-e0631eeec699 req-649989d6-003e-4c93-863c-e61aad3aac95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063998 Oct 10 11:02:37.720131 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2475/4833] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:02:37.834077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:37.834700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:37.848838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:37.849288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:37.849738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:37.851573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:37.853245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:37.853696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:38.022093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:38.023675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:38.035693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:38.036493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:38.037156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:38.041140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:38.041963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:38.042720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:38.350214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:38.393442 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08520bac-3d3b-46dd-9f4f-3403c4bd1bb0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1663 microversion: 2.1 time: 0.555916 Oct 10 11:02:38.395678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2359/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:37 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1663 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:38.623269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:38.641683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:38.647721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:38.651977 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a18710a3-e355-456e-96d0-cd21c47be18b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.632679 Oct 10 11:02:38.656023 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2476/4835] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:38 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:39.433176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:39.435245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:39.485415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:39.486145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:39.489908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:39.490911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:39.494646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:39.495136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:39.691594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:39.692428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:39.706773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:39.708611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:39.711414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:39.716229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:39.716949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:39.719535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:40.163556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:40.174349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92170529-a4dc-4773-9062-c42fdf06c9e7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1667 microversion: 2.1 time: 0.757509 Oct 10 11:02:40.178750 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2360/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:39 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1667 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:40.188747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "d4742c03-23a9-4fa4-9122-c52d2657aabe"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "b305834f-1ac8-45ca-a45f-a0c20cb5d72b"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "ef417eee-43f2-4ecc-8d65-b4a386e3c1c1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:40.213546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:40.213878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:40.219284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:40.243670 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Creating event network-vif-plugged:d4742c03-23a9-4fa4-9122-c52d2657aabe for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:40.244397 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Creating event network-vif-plugged:b305834f-1ac8-45ca-a45f-a0c20cb5d72b for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:40.245078 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] Creating event network-vif-plugged:ef417eee-43f2-4ecc-8d65-b4a386e3c1c1 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:40.261652 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3bb79410-aa9b-4c69-b4a2-2c7a2612a5a3 req-e61929e8-6d3c-479b-827b-0b46e34eaf95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081519 Oct 10 11:02:40.262885 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2361/4837] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:02:40.519689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:40.537446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:40.539368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:40.540764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-328ca161-c7a1-407d-b3de-e83c3d0fe457 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.860522 Oct 10 11:02:40.542941 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2477/4838] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:39 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:41.570770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:41.571539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:41.586811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:41.587626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:41.588488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:41.589384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:41.598622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:41.600183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:42.310760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "9b5d88be-0f1d-4984-b018-d971f0cb8488"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "b6844420-e64a-422e-92aa-2e4e3e5ff595"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-plugged", "status": "completed", "tag": "6c90b31c-cd92-49d2-aa0d-2ad7d7935346"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:42.325243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:42.326089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:42.326778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:42.343302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Creating event network-vif-plugged:9b5d88be-0f1d-4984-b018-d971f0cb8488 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:42.362552 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Creating event network-vif-plugged:b6844420-e64a-422e-92aa-2e4e3e5ff595 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:42.365271 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] Creating event network-vif-plugged:6c90b31c-cd92-49d2-aa0d-2ad7d7935346 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:42.373162 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-16a8b0a0-60c8-4b2f-9cbe-837eeda3fb50 req-cd7fa0bf-df1c-4a97-8c48-f623dd382ed1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068264 Oct 10 11:02:42.375632 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2478/4839] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:02:42.513055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:42.524384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:42.526708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:42.528486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9810fb7-3a33-4739-8f1f-5f0fca3d9246 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.963017 Oct 10 11:02:42.529249 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2362/4840] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:41 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:43.558049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:43.558921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:43.569813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:43.577551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:43.578659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:43.579877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:43.580599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:43.581291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:44.063626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:44.076830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:44.079524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:44.081259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-86dc8092-d46b-476f-9103-4173036ad768 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1880 microversion: 2.32 time: 0.528356 Oct 10 11:02:44.084234 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2479/4841] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:43 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1880 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:44.955566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:44.956207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:44.973849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:44.974274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:44.974717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:44.975468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:44.975932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:44.981517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:45.027361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:02:45.109173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:45.110664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:45.126790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:45.128171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:45.128732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:45.130142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:45.132684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:45.133237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:45.893981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:45.905914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89ccb552-1218-4d9a-8279-6bb744060ed4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.953118 Oct 10 11:02:45.907653 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2363/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:44 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:45.940571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:45.941564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:45.949387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:45.950221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:45.951424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:45.953796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:45.954524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:45.955168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:45.977329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:45.993624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:45.995386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:45.996774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db860080-058b-4c77-a7a1-a9db179bbc25 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2832 microversion: 2.32 time: 0.891930 Oct 10 11:02:45.997355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2480/4843] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:02:45 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2832 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:02:46.034646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:46.035274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:46.042945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:46.043560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:46.044185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:46.044915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:46.045381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:46.045812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:46.382559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b14af54-e95c-457b-a240-6caa8a4ab391 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.353485 Oct 10 11:02:46.385496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2481/4844] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 11:02:46 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5/os-interface => generated 1831 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:02:46.556704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:46.568176 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-781319a8-bbc7-4541-ba63-47f6d1e2cacd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.631097 Oct 10 11:02:46.571206 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2364/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:45 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:02:46.594209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:46.594985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:46.611721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:46.612232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:46.612682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:46.613407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:46.613880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:46.614314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:47.012635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:47.030339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0cb76e05-9de4-4d0d-afa1-fdf203f9a441 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.439966 Oct 10 11:02:47.033559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2482/4846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:46 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:47.056572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:47.057802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:47.074514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:47.075383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:47.077604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:47.080749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:47.081488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:47.084116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:47.544364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:47.556316 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3477090-8dd2-4444-b5ce-ad789781a239 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.501322 Oct 10 11:02:47.559770 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2365/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:47 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:47.857567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1827696341", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "d4170c24-8757-45a8-8f28-ac22cc23fbd1"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:47.902770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "tag": "ef417eee-43f2-4ecc-8d65-b4a386e3c1c1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:47.938665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:47.939589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:47.940280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:47.968171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] Creating event network-changed:ef417eee-43f2-4ecc-8d65-b4a386e3c1c1 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:02:47.978887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] validate_networks() for [('d4170c24-8757-45a8-8f28-ac22cc23fbd1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:02:47.990089 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-627809f1-6642-47f4-b925-b15cc3e4514b req-56d6333a-8fc8-4fb8-b914-dd271c106a0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091369 Oct 10 11:02:48.006576 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2366/4848] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:02:50.455595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:02:50.456138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:02:50.456557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:02:50.457029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:02:50.457726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:02:50.479036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:50.479553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:50.480082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:50.480849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:50.481325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:50.481766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:50.527300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:02:50.535389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:02:50.555757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:02:50.558152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:02:50.620873 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-01c7ea1b-9e52-4293-8345-91be1667dbf5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.769988 Oct 10 11:02:50.626251 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2483/4849] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:02:50.639336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-217ca374-3c0e-4b77-bc3f-82d43b4aa7e8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:50.640140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-217ca374-3c0e-4b77-bc3f-82d43b4aa7e8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:50.724540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-217ca374-3c0e-4b77-bc3f-82d43b4aa7e8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:50.735295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-217ca374-3c0e-4b77-bc3f-82d43b4aa7e8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1215 microversion: 2.1 time: 0.101041 Oct 10 11:02:50.741283 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2367/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:50 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:51.767837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:51.769182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:51.781118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:51.781891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:51.782533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:51.783610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:51.784276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:51.785068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:51.928421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:51.938755 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-05fa2f11-ee9a-4e9b-82a8-f58e6572089b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1267 microversion: 2.1 time: 0.177630 Oct 10 11:02:51.955928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2484/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:51 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:52.969092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:52.969749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:52.980780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:52.981708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:52.982407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:52.983402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:52.984768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:52.985569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:53.117458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:53.131755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96ce3528-dde2-41e7-b76f-cf3c941f8fd6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1273 microversion: 2.1 time: 0.167436 Oct 10 11:02:53.135950 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2368/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:52 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:54.166111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:54.167498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:54.178605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:54.185455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:54.186384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:54.192434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:54.195432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:54.196453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:54.701261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:54.713530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-936624a1-a03f-419e-9f09-6cd9da2ab7db tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.559553 Oct 10 11:02:54.715088 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2485/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:54 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:55.743879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:55.744880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:55.760578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:55.765711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:55.766254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:55.767188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:55.767689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:55.768121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:56.323529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:56.335510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7b2c762-6c04-4b6e-8af9-a6b6e2130aea tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.598266 Oct 10 11:02:56.338478 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2369/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:55 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:02:57.364667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:57.366283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:57.380785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:57.384326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:57.384787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:57.385523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:57.385990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:57.391707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:57.606189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fc8cd7-d601-43d5-8ffb-e563cff1382d", "tag": "d8fb2443-4942-4ea5-8d8c-ae528fd079c5"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:02:57.631688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:57.632571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:57.635571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:57.673962 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] Creating event network-changed:d8fb2443-4942-4ea5-8d8c-ae528fd079c5 for instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d on n-h2-860687-2 Oct 10 11:02:57.686406 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bb1720b1-b551-4cbb-8ef0-65977ba4ca92 req-74bc14ee-0275-421e-8308-18a8a1b6b585 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546973 Oct 10 11:02:57.691383 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2486/4855] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:02:58.347200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:58.360589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8582eea-c5e0-4ded-8c82-29c2c18cd331 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.999282 Oct 10 11:02:58.363105 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2370/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:57 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:02:59.395955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:02:59.396779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:02:59.422146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:59.422744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:59.423245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:59.424003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:02:59.424480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:02:59.424912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:02:59.824011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:02:59.842678 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e750c114-9674-4d00-9986-c40285fb3348 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.450003 Oct 10 11:02:59.854634 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2487/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:02:59 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:00.869283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:00.872152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:00.879516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:00.880687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:00.882287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:00.882966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:00.883843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:00.884737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:00.888868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:00.890481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:01.323309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:01.339046 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1de59f58-77e7-42fe-9e06-a112c63ff12f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.473250 Oct 10 11:03:01.352710 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2371/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:00 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:02.365629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:02.366867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:02.381484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:02.387317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:02.391270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:02.397512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:02.402273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:02.402773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:02.403558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:02.404036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:02.404472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:02.821547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:02.837243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-06cc0eb8-ad12-416f-8ff6-be182036e2b6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.473356 Oct 10 11:03:02.837243 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2488/4859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:02 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:03.867539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:03.868159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:03.886356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:03.886870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:03.889029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:03.889800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:03.890279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:03.890715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:04.329524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:04.335733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7b8637b-87af-4c6c-b6d5-dd93e4e50a68 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.473818 Oct 10 11:03:04.362037 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2372/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:03 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:05.090341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fc8cd7-d601-43d5-8ffb-e563cff1382d", "name": "network-vif-plugged", "status": "completed", "tag": "d8fb2443-4942-4ea5-8d8c-ae528fd079c5"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:05.112541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:05.113031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:05.113473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:05.137367 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] Creating event network-vif-plugged:d8fb2443-4942-4ea5-8d8c-ae528fd079c5 for instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d on n-h2-860687-2 Oct 10 11:03:05.150074 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ac8b44fb-5310-427f-82ad-11735178edbb req-6ffcf54c-219d-443c-9fe1-631997c512ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063668 Oct 10 11:03:05.150699 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2489/4861] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:05.378520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:05.379338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:05.395265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:05.395799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:05.401497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:05.402399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:05.402990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:05.403390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:05.649435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:05.659289 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-440748e5-fbba-4aac-be83-7c431733cc39 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.292996 Oct 10 11:03:05.659870 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2373/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:05 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:06.689747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:06.692204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:06.717020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:06.720926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:06.722078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:06.722205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:06.722580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:06.723031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:06.735123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=81 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:07.078257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:07.089229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c53c8513-073f-4ac2-8482-c7a35536a14a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1315 microversion: 2.1 time: 0.407682 Oct 10 11:03:07.090156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2490/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:06 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:08.117051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:08.118382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:08.130436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:08.132317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:08.134332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:08.135496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:08.139990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:08.140635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:08.417765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:08.428119 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef1436c6-cb7c-40d3-bee4-91325ecb255b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1501 microversion: 2.1 time: 0.315071 Oct 10 11:03:08.454789 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2374/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:08 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:08.461442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:08.462869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:08.481305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:08.482648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:08.483250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:08.489543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:08.490060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:08.490530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:08.859825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Removing security group 383bd98e-f220-42a6-bcc5-3e547c3e01f4 from port d8fb2443-4942-4ea5-8d8c-ae528fd079c5 Oct 10 11:03:09.681037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5a21572-22d7-4877-b8ab-790ec65a0df2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d/action" status: 202 len: 0 microversion: 2.1 time: 1.226233 Oct 10 11:03:09.683220 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2491/4865] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:03:08 2022] POST /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d/action => generated 0 bytes in 1229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:03:09.702333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:09.702333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:09.711066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:09.711558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:09.715590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:09.722786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:09.723539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fc8cd7-d601-43d5-8ffb-e563cff1382d", "tag": "d8fb2443-4942-4ea5-8d8c-ae528fd079c5"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:09.726961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:09.728011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:09.754612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:09.757521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:09.759938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:09.797544 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] Creating event network-changed:d8fb2443-4942-4ea5-8d8c-ae528fd079c5 for instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d on n-h2-860687-2 Oct 10 11:03:09.821870 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ece32b00-b25d-4a77-b859-4e598c6f0970 req-7694d2a6-f4df-4cb2-8d78-da9df6a9a35d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128979 Oct 10 11:03:09.847322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2492/4866] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:09.966055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:10.001907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09eabb13-a0d9-4bf2-8984-da14c70b8493 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1459 microversion: 2.1 time: 0.311131 Oct 10 11:03:10.003614 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2375/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:09 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1459 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:10.027227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:10.028299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:10.041873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:10.042365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:10.042813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:10.051235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:10.056961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:10.057439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:10.455041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:10.469378 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ba31d85-eb36-4307-acbd-9257acdc5d49 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.446430 Oct 10 11:03:10.474762 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2493/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:10 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:10.507387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:10.508823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:10.527580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:10.529789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:10.531102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:10.533224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:10.535750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:10.537888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:11.199476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:11.222004 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f0f278e-ca7f-4adb-9e14-153ae02105ce tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.718815 Oct 10 11:03:11.225054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2376/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:10 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:11.250300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:11.251255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:11.261280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:11.261864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:11.262378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:11.263299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:11.264119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:11.265115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:11.526242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:11.539140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3832f834-53f9-471d-88ce-714541f39856 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.293904 Oct 10 11:03:11.557399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2494/4870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:11.563980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:11.564713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:11.571230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:11.571964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:11.572703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:11.573706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:11.574394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:11.575095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:11.901819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:11.925016 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-482e8751-1b91-4e54-b6c0-b5e8ba05a656 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.364965 Oct 10 11:03:11.926166 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2377/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:12.085373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1720811285", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "d4170c24-8757-45a8-8f28-ac22cc23fbd1"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:12.194122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:12.196335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] validate_networks() for [('d4170c24-8757-45a8-8f28-ac22cc23fbd1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:03:12.198678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:12.220373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.222544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.223606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.225214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.228349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.230683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.317845 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54c1f5a3-4600-43ea-ae3a-a5d6af99523f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130952 Oct 10 11:03:12.318832 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2378/4872] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:03:12 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:03:12.425807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:12.427108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:12.450642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.453624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.454446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.458033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.459549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.461484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.550015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:03:12.705525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-147b70ca-0da2-4cf1-9f3d-0c181124e0f7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 204 len: 0 microversion: 2.1 time: 0.285691 Oct 10 11:03:12.709619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2379/4873] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:03:12 2022] DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:03:12.715674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:12.716397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:12.733156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.734433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.734769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.735529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:12.736018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:12.736454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:12.741918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:12.990796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:03:12.992052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:03:12.993744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:03:13.001844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:03:13.004052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:03:13.041493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:13.042609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:13.044576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:13.045294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:13.048073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:13.052048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:13.052452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d132100f-d1cb-44a8-a367-a6e5239c7fef tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1673 microversion: 2.1 time: 0.340546 Oct 10 11:03:13.055044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:13.055230 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2380/4874] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:12 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1673 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:13.090750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:03:13.100055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Getting quotas for user b128f21e803142dfaea0f2ca2acc0d16 and project d1a9b3e4da4e4c25ac8641738682fb0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:03:13.117876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:03:13.130799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:03:13.198861 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-213373cc-0426-4d01-ad24-2109a3707951 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118365 Oct 10 11:03:13.200045 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2495/4875] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:03:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:03:13.219856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bbe7436-4689-4ce9-b337-4023a58a5074 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:13.221777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bbe7436-4689-4ce9-b337-4023a58a5074 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:13.500969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bbe7436-4689-4ce9-b337-4023a58a5074 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:13.510507 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bbe7436-4689-4ce9-b337-4023a58a5074 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1215 microversion: 2.1 time: 0.296468 Oct 10 11:03:13.529297 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2381/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:13 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:14.084666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:14.086025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:14.100029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:14.103139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:14.104205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:14.107577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:14.109097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:14.109794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:14.537472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:14.538097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:14.554423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:14.555273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:14.555911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:14.556831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:14.557473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:14.558084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:14.756228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:14.780980 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d879a458-5916-4260-b5a6-d9beba2bb9c9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1211 microversion: 2.1 time: 0.248155 Oct 10 11:03:14.801759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2382/4877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:14 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1211 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:14.892575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:14.904685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6570bf36-1834-43fb-ae4e-4477db12d006 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1673 microversion: 2.1 time: 0.823524 Oct 10 11:03:14.907943 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2496/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:14 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1673 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:15.808730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:15.810140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:15.831516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:15.832300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:15.835796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:15.839314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:15.841430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:15.844940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:15.935287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:15.936439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:15.949353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:15.951455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:15.952690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:15.964077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:15.964922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:15.965741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:16.019394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:16.035771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72ef762a-dcd8-4f45-9718-5dc8b4b086e2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1273 microversion: 2.1 time: 0.227913 Oct 10 11:03:16.036829 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2383/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:15 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:16.400518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:16.413410 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80766608-97c4-4730-b7e8-1910190f2cfd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1673 microversion: 2.1 time: 0.482014 Oct 10 11:03:16.417087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2497/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:15 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1673 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:17.063514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:17.064131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:17.070674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:17.080215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:17.082662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:17.084681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:17.086650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:17.087861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:17.439382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:17.440212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:17.457111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:17.463632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:17.464531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:17.465497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:17.466172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:17.466774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:17.750151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:17.768264 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22cb69d3-fd0e-4ab8-b738-8be37617f5ce tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1606 microversion: 2.1 time: 0.334390 Oct 10 11:03:17.777874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2498/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:17 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1606 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:17.992818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:18.004741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ccd757c-faee-4949-ba82-c260db75f201 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 0.945710 Oct 10 11:03:18.025172 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2384/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:17 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:18.411905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc02db9-8522-4c05-a7d5-b215863e5054", "name": "network-vif-deleted", "tag": "9b58f609-7808-4b53-a952-6ad8073e0793"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:18.442870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:18.449251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:18.450409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:18.499361 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] Creating event network-vif-deleted:9b58f609-7808-4b53-a952-6ad8073e0793 for instance 1bc02db9-8522-4c05-a7d5-b215863e5054 on n-h2-860687-2 Oct 10 11:03:18.510471 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-544632a8-1560-4282-954a-a89b4c74aafe req-62184e51-d451-41ed-b912-85af47f594de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107213 Oct 10 11:03:18.511061 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2499/4883] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:18.806722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:18.807679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:18.823056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:18.823811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:18.824487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:18.826115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:18.834711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:18.836111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:18.911990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:18.919285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:18.921576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:18.923038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lazy-loading 'fault' on Instance uuid 1bc02db9-8522-4c05-a7d5-b215863e5054 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:03:19.032880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:19.033973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:19.052314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:19.063475 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb084d05-1b4b-4bce-b5cd-6648d9c28c84 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 200 len: 1327 microversion: 2.1 time: 0.261520 Oct 10 11:03:19.066977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:19.068093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:19.069502 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2385/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:18 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 1327 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:19.079369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:19.079369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:19.079369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:19.079369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:19.188472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff2829f-3659-4083-8506-89b6b6558ee5", "tag": "ca9d5754-4e97-43aa-b9c4-80092c138438"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:19.218557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:19.219434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:19.221841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:19.266975 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] Creating event network-changed:ca9d5754-4e97-43aa-b9c4-80092c138438 for instance cff2829f-3659-4083-8506-89b6b6558ee5 on n-h2-860687-2 Oct 10 11:03:19.296487 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-58be3f4b-d6d0-4885-ba92-5da52a1d6a20 req-ff9ffc75-f657-447d-8ef7-73bdc52fc9b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109201 Oct 10 11:03:19.300419 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2386/4885] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:20.096780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:20.098105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:20.117154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:20.117154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:20.117154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:20.117154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:20.117154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:20.117738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:20.180922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 HTTP/1.1 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1bc02db9-8522-4c05-a7d5-b215863e5054'} Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:03:20.185352 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:03:20.193423 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:03:20.195601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:03:20.197085 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3540ede8-7660-4cfa-9edb-7cc05074a910 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 404 len: 111 microversion: 2.1 time: 0.106437 Oct 10 11:03:20.197853 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2387/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:20 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:03:20.209216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a04a35a-9c9b-43df-9929-3e4c076e6299 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '.version_select at 0x7f6780d0f040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:20.215840 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9a04a35a-9c9b-43df-9929-3e4c076e6299 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [21bd7560-9ba7-42e8-9028-dc838971d640] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:03:20.268964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:20.277330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23289c96-98dc-43e4-9dbf-37a2c6dfaf6d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 1.250010 Oct 10 11:03:20.291498 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2500/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:19 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:21.225478 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-9a04a35a-9c9b-43df-9929-3e4c076e6299 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [21bd7560-9ba7-42e8-9028-dc838971d640] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39558. Oct 10 11:03:21.269535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a04a35a-9c9b-43df-9929-3e4c076e6299 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063213802" status: 202 len: 0 microversion: 2.1 time: 1.065883 Oct 10 11:03:21.270751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2388/4888] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 11:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063213802 => generated 0 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:03:21.304305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:21.305026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:21.315126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:21.315617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:21.319597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:21.320376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:21.320945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:21.321383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:22.172290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:22.200719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-596e6c6b-748d-4a19-8af5-6c1a84f2f076 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 0.901526 Oct 10 11:03:22.203946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2501/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:21 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:23.235108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:23.236793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:23.255192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:23.255696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:23.256470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:23.257235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:23.257791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:23.258163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:23.505302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:23.726170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:23.742993 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9def7709-f449-46df-ade4-9421cc591538 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 0.512490 Oct 10 11:03:23.745505 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2389/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:23 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:23.765734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e4b0583-881c-4cd2-a390-213b43d5df2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: .version_select at 0x7f6780d3d8b0>, body: {"keypair": {"name": "tempest-keypair-43646544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8uMuFcuj7TZhF4+SQLFaSAwTg6tea9664/GRdA4x62SxL9ZCsVbLPZS34rVLgA/CipI964I0eOkTlgRGWQKY4e9cMgwa3quOTL7UJX05zzrgynYf1KxbjGKK76GcqSOw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:23.786651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:23.788274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:23.807703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2e4b0583-881c-4cd2-a390-213b43d5df2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:03:23.817299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-2e4b0583-881c-4cd2-a390-213b43d5df2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for user df4649407d1840178a40fa26e75d6d9a and project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:03:23.861601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e4b0583-881c-4cd2-a390-213b43d5df2a tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.101278 Oct 10 11:03:23.892959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2502/4891] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:03:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:24.775046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:24.776369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:24.793715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:24.796636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:24.797680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:24.798666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:24.799465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:24.800129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:25.426782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff2829f-3659-4083-8506-89b6b6558ee5", "name": "network-vif-plugged", "status": "completed", "tag": "ca9d5754-4e97-43aa-b9c4-80092c138438"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:25.428638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:25.442370 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6284bb3b-2da2-4b65-8a15-8b97867051de tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 0.671557 Oct 10 11:03:25.442975 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2390/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:24 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:25.452021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:25.452569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:25.452944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:25.480033 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] Creating event network-vif-plugged:ca9d5754-4e97-43aa-b9c4-80092c138438 for instance cff2829f-3659-4083-8506-89b6b6558ee5 on n-h2-860687-2 Oct 10 11:03:25.500995 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-dbae9740-0b16-4c58-ac00-27923eed6018 req-d1771cd4-397f-4752-83c1-c6055dce13bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400581 Oct 10 11:03:25.501997 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2503/4893] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:03:26.474863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:26.476234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:26.489374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:26.499505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:26.501953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:26.504141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:26.505509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:26.507766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:26.873781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:26.900868 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ba09e70-16ef-47d7-83cc-cb60c783eeb4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1315 microversion: 2.1 time: 0.434834 Oct 10 11:03:26.905882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2391/4894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:26 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:27.937003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:27.956549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:27.983712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:27.985150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:27.986294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:27.987442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:27.988159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:27.989537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:28.005486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1870974698", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4cb4e26-4e37-4654-be04-42f32ec860ea"}], "security_groups": [{"name": "tempest-securitygroup--1107998845"}], "key_name": "tempest-keypair-43646544", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:28.258899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] validate_networks() for [('f4cb4e26-4e37-4654-be04-42f32ec860ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:03:28.361797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:28.379732 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d873bc16-6dad-4d71-aabf-4b5c78d74c56 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1501 microversion: 2.1 time: 0.448286 Oct 10 11:03:28.384136 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2504/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:27 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1501 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:28.413849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:28.414729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:28.424751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:28.425535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:28.426635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:28.427624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:28.428456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:28.430846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:28.605873 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2dfc9673-584c-484d-8e40-d334b90fed6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.198137 Oct 10 11:03:28.608899 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2505/4896] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:03:28 2022] POST /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:03:28.641786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:28.642568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:28.649566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:28.650080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:28.651584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:28.652649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:28.653555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:28.656279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:29.089387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:29.102490 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e2fbcd8f-56b8-48e5-a215-e74c5d929350 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1506 microversion: 2.1 time: 0.474995 Oct 10 11:03:29.107731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2506/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:28 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:29.145130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:03:29.146283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:03:29.146954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:03:29.147800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:03:29.148493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:03:29.161202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:29.161987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:29.163473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:29.165751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:29.166614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:29.167521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:29.226862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:03:29.240079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Getting quotas for user df4649407d1840178a40fa26e75d6d9a and project f9a532f7d64a4a6f876e1b2a26b7d687. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:03:29.261147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:03:29.263843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:03:29.322884 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:03:30.129040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:30.134212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:30.150651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.151230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.151688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.152435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.152906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.153344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.344786 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39954. Oct 10 11:03:30.361150 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7f0d0e9-26d0-484d-a4fb-aa74817d0a12 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.359949 Oct 10 11:03:30.364791 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2392/4898] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:03:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:03:30.387766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4628e6c3-21b6-4794-b4c5-79829ba2dbc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:30.388329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4628e6c3-21b6-4794-b4c5-79829ba2dbc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:30.475821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:30.521843 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-860e57b7-cc25-47d5-95e4-3f146e718376 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1486 microversion: 2.1 time: 0.394507 Oct 10 11:03:30.522476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2507/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:30 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1486 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:30.550970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4628e6c3-21b6-4794-b4c5-79829ba2dbc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:30.555062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:30.559798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:30.564118 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4628e6c3-21b6-4794-b4c5-79829ba2dbc8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1236 microversion: 2.1 time: 0.194227 Oct 10 11:03:30.568899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2393/4900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:30 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1236 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:30.571339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.572007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.572594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.573478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.574104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.574681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.604353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lazy-loading 'flavor' on Instance uuid cff2829f-3659-4083-8506-89b6b6558ee5 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:03:30.668949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:30.729712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:30.730836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:30.744286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.747674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.747674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.748258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:30.748960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:30.749579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:30.984912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b82f377-b857-4c13-bb28-0ff0d69ff705 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.441308 Oct 10 11:03:30.985788 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2508/4901] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:03:30 2022] POST /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:03:30.994074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:30.994792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:31.031211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.031211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.031477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.032019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.032486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.047067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.577704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:31.591745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:31.597883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:31.602801 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4a80cb1-8dfa-4aab-b6e3-191498e3ef5e tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2951 microversion: 2.32 time: 0.878376 Oct 10 11:03:31.619382 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2394/4902] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:03:30 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2951 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:03:31.630335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:31.638071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:31.639288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:31.640469 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19a5c962-e298-4e43-a648-2b0229474b1d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1492 microversion: 2.1 time: 0.650429 Oct 10 11:03:31.643628 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2509/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:30 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1492 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:31.658871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:31.659626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:31.660162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:31.665234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.666122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.666802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.668028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.668825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.669370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.670366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.674464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.675038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.675863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:31.676639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:31.677382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:31.819286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:31.836612 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b0c25a9-db5c-4a06-bd92-bda441ec27ab tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1288 microversion: 2.1 time: 0.204669 Oct 10 11:03:31.849098 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2395/4904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:31 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1288 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:32.001311 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3a81afa-2063-4c2f-8995-cdbaaa26d074 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.356258 Oct 10 11:03:32.002235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2510/4905] 10.222.0.16 () {60 vars in 1316 bytes} [Mon Oct 10 11:03:31 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5/os-interface => generated 1831 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:03:32.669074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:32.671630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:32.684955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:32.685142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:32.686123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:32.690495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:32.693293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:32.694081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:32.863092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:32.863721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:32.865877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:32.884742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:32.885263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:32.885917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:32.886876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:32.888082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:32.889360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:33.071428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:33.093821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ac74fad-f0fc-4087-924b-1d41e42b2439 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1294 microversion: 2.1 time: 0.235645 Oct 10 11:03:33.094473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2511/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:32 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:33.112054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:33.122242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46d5faab-ccfb-4aac-8c89-4bd5b18b665e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1513 microversion: 2.1 time: 0.460588 Oct 10 11:03:33.141194 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2396/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:32 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1513 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:34.123849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:34.125517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:34.135357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:34.155441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:34.157137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:34.173151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:34.173813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:34.176979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:34.178883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:34.181785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:34.183426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:34.184071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:34.198655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:34.203461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:34.207072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:34.210528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:34.213034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:34.572161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:34.598645 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46f3334a-7a5a-4338-8aaa-d4e9a05d4dee tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1294 microversion: 2.1 time: 0.481043 Oct 10 11:03:34.625595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2512/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:34 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1294 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:34.676480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:34.684953 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a1dd785-14fb-4a02-bb78-a9a9db4286b2 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.534943 Oct 10 11:03:34.688352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2397/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:34 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:35.446864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff2829f-3659-4083-8506-89b6b6558ee5", "name": "network-vif-plugged", "status": "completed", "tag": "ca9d5754-4e97-43aa-b9c4-80092c138438"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:35.475729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:35.476143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:35.483488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:35.540863 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] Creating event network-vif-plugged:ca9d5754-4e97-43aa-b9c4-80092c138438 for instance cff2829f-3659-4083-8506-89b6b6558ee5 on n-h2-860687-2 Oct 10 11:03:35.559444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-85ca2f16-f25e-452c-a3d8-a97972290424 req-8553409f-c507-40ce-bec4-70e67dd74ab6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113306 Oct 10 11:03:35.564559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2513/4910] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:35.636386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:35.639933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:35.658207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:35.660098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:35.661317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:35.663292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:35.665662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:35.667559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:35.720825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:35.721715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:35.746336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:35.751600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:35.754956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:35.756779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:35.765130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:35.766693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:36.338846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:36.355995 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d6f623f-a0f2-49cc-9b43-8106693bd53b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.637428 Oct 10 11:03:36.357786 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2514/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:35 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:36.368856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:36.400904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-479482bd-b68a-4bb8-957d-254edafcb7e5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.777767 Oct 10 11:03:36.403509 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2398/4912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:35 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:37.388052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:37.390377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:37.407541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:37.408085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:37.408629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:37.412294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:37.412831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:37.414039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:37.429060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:37.430447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:37.443566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:37.446258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:37.446913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:37.448431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:37.452399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:37.453112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:38.241486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:38.258167 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b3a031d-346f-4041-891e-4371b4906158 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.874899 Oct 10 11:03:38.262571 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2515/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:37 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:38.276227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9342d50b-dab3-4628-a53b-2dbe6afa8362", "tag": "2a4a9c0b-fb93-4a39-9979-d0724cf95ce8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:38.292644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:38.294918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:38.296000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:38.318965 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] Creating event network-changed:2a4a9c0b-fb93-4a39-9979-d0724cf95ce8 for instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 on n-h1-860687-2 Oct 10 11:03:38.329421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d58e2ddc-2260-4262-b109-7e3d61372602 req-b1a2efb0-e322-4b3c-a193-cb52d2b2c52e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063963 Oct 10 11:03:38.337657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2516/4914] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:38.338650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:38.352030 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-825c62c7-92d8-4406-ac33-575a385ff187 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.927034 Oct 10 11:03:38.358384 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2399/4915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:37 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:39.290509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:39.291400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:39.309360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:39.310392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:39.311114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:39.315091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:39.315716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:39.316271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:39.384305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:39.385786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:39.396826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:39.403076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:39.405872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:39.406518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:39.407476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:39.416387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:39.416944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:39.778980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:39.792195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8da69aef-4c41-48ff-9910-96a15d2f33fa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.507643 Oct 10 11:03:39.792804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2517/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:39 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:40.213390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:40.234317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33eb7855-a928-4d11-8e9b-b056f8378fd7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.853742 Oct 10 11:03:40.235201 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2400/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:39 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:40.829097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:40.829097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:40.871370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:40.872261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:40.873098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:40.874416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:40.875335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:40.876125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:41.267682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:41.268859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:41.278703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:41.340932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:41.349075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:41.352534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:41.355607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:41.360933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:41.366316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:41.477077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:41.497702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-432ed12c-22bc-4b6b-b324-a312d49d903d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.677532 Oct 10 11:03:41.500406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:41.531360 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2518/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:40 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:41.983351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:41.992561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-316faa03-1cf3-4584-83ed-f97839488056 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.733139 Oct 10 11:03:42.016498 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2401/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:41 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:42.556659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:42.557404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:42.572522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:42.573037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:42.573490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:42.574214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:42.582136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:42.582630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:43.030369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:43.031254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:43.040500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:43.040998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:43.041443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:43.042153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:43.042608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:43.043057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:43.658316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:43.673869 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ae8ae7ca-32f2-4225-b451-bc1d5ba5df0c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 1.121610 Oct 10 11:03:43.692756 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2519/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:42 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:43.699114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:43.720086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4105ccae-de11-4d70-9a5a-46784c93e6bf tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.687086 Oct 10 11:03:43.734681 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2402/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:43 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:03:44.707507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:44.708838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:44.722332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:44.723267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:44.723936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:44.724874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:44.725664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:44.726405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:44.754204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:44.755540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:44.770671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:44.775232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:44.775932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:44.780131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:44.785126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:44.786643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:45.338530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:45.348756 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37a32297-9c0d-4424-877f-baa63992a058 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.599375 Oct 10 11:03:45.396033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2403/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:44 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:45.616556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:45.629148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79e22105-7d94-46e2-8f8e-0a96483ab224 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.928027 Oct 10 11:03:45.644661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2520/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:44 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:46.392983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:46.393881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:46.415393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:46.415921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:46.416447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:46.417250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:46.417804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:46.418374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:46.688184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:46.689682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:46.698199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:46.699653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:46.700369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:46.701513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:46.702167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:46.702767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:46.821735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:46.830599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16057bcd-016f-4958-bb2e-9b920acbbcca tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 0.442640 Oct 10 11:03:46.847700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2404/4924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:46 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:46.958966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:46.975645 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6385ea79-117c-41cd-8206-3afe2832163a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.301135 Oct 10 11:03:46.976257 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2521/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:46 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:47.543065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9342d50b-dab3-4628-a53b-2dbe6afa8362", "name": "network-vif-plugged", "status": "completed", "tag": "2a4a9c0b-fb93-4a39-9979-d0724cf95ce8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:47.567916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:47.568601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:47.570476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:47.629505 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] Creating event network-vif-plugged:2a4a9c0b-fb93-4a39-9979-d0724cf95ce8 for instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 on n-h1-860687-2 Oct 10 11:03:47.643626 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f2e30bfb-be3e-4c69-8e0c-d4a2cef2a4f1 req-1ff9846d-d482-4c11-aa21-ecd7cc56f49d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103659 Oct 10 11:03:47.644460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2405/4926] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:47.861988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:47.862764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:47.886829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:47.888690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:47.889173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:47.897283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:47.898695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:47.900478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:48.003164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:48.004356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:48.018538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:48.024124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:48.024622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:48.025326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:48.025796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:48.026236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:49.682648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:49.696456 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-812e7535-0873-4137-a5a7-ff349330054a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 1.697685 Oct 10 11:03:49.702519 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2406/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:47 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:49.924660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:49.934269 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b90f3c9a-7338-4d42-bee9-c362963cd3f8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1362 microversion: 2.1 time: 2.077840 Oct 10 11:03:49.941002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2522/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:47 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1362 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:50.735892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:50.737150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:50.748220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:50.751651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:50.752323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:50.753243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:50.755361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:50.756011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:50.961446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:50.962344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:50.972549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:50.973378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:50.974004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:50.975604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:50.976262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:50.979648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:51.605846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:51.620721 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1b39351-a90f-4ae2-b67c-72de49b054bc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.894927 Oct 10 11:03:51.625925 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2407/4929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:50 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:51.806940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:51.823563 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ca1f28f-db0a-4230-b93e-6bb40833d867 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1548 microversion: 2.1 time: 0.858442 Oct 10 11:03:51.826396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2523/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:50 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1548 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:51.852661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:51.853183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:51.879032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:51.879661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:51.880116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:51.891761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:51.895966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:51.896456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:52.120035 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c808d221-8eb7-4be8-ab6d-bc3d3d35c387 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271316 Oct 10 11:03:52.121218 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2408/4931] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:03:51 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:03:52.658050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:52.659757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:52.667476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:52.669596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:52.670475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:52.671529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:52.672313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:52.673141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:53.526310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:53.538468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8958b0bd-fe51-416f-9dc0-b45ad3f3f438 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.888045 Oct 10 11:03:53.551723 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2524/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:52 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:54.567447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:54.568064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:54.592125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:54.593748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:54.594324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:54.596169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:54.600226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:54.600826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:55.586697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:55.596804 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04556300-5d14-4f06-a292-efe2adfaeb36 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 1.034243 Oct 10 11:03:55.617590 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2409/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:54 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:56.633490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:56.634018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:56.719344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:57.232206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9342d50b-dab3-4628-a53b-2dbe6afa8362", "tag": "2a4a9c0b-fb93-4a39-9979-d0724cf95ce8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:03:57.249771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:57.257275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:57.266284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f029fa05-b6b8-4cd8-8e46-9d76154092fb tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.636702 Oct 10 11:03:57.267918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2525/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:56 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:57.270896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:57.271528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:57.296452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] Creating event network-changed:2a4a9c0b-fb93-4a39-9979-d0724cf95ce8 for instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 on n-h1-860687-2 Oct 10 11:03:57.311802 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a9d54c48-cfa0-41fd-8cdc-b77a1501aa3f req-00d3cb4d-0a22-4b47-9b0e-45e4c7b1bb88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083358 Oct 10 11:03:57.313530 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2410/4935] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:03:58.298753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:58.299972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:58.346811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:58.347421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:58.347890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:58.348642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:58.349294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:58.349898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:58.354069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:03:58.885782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:03:58.908442 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-51d007a5-7735-4848-a555-9445b47a2f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.615483 Oct 10 11:03:58.911067 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2526/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:58 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:03:59.936959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:03:59.938435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:03:59.955387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:59.956081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:59.957496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:03:59.958924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:03:59.959434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:03:59.964752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:00.655972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:00.666851 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e29d483-34c5-428c-a153-fd4c9b6b064d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.734623 Oct 10 11:04:00.669821 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2411/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:03:59 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:01.689650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:01.690367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:01.708501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:01.709129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:01.709656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:01.710493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:01.711068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:01.711580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:02.328410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:02.336265 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ca63613-c1f3-4e8e-b228-d717a676d44c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.650418 Oct 10 11:04:02.351074 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2527/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:01 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:03.367801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:03.369497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:03.383128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:03.390059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:03.392385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:03.394290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:03.396215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:03.398382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:03.399559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:04.204425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:04.212729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d13ac7e3-dd57-4e63-b2b3-e2a95be287ba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1508 microversion: 2.1 time: 0.852327 Oct 10 11:04:04.214080 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2412/4939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:03 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:05.237908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:05.238902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:05.242828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=34 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:05.252563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:05.253212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:05.259033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:05.259886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:05.260563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:05.261176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:05.802281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:05.812685 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-129c5364-358d-4b4d-b27a-5c75d196967f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1505 microversion: 2.1 time: 0.578609 Oct 10 11:04:05.817859 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2528/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:05 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:06.843342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:06.844011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:06.855105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:06.856201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:06.856634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:06.857470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:06.865152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:06.866749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:07.122345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:07.131780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-078e0efa-f20d-4169-9d56-5c77763e58ff tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1505 microversion: 2.1 time: 0.293017 Oct 10 11:04:07.172063 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2413/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:06 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:07.509169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff2829f-3659-4083-8506-89b6b6558ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "ca9d5754-4e97-43aa-b9c4-80092c138438"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:07.539622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:07.540167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:07.540618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:07.607217 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] Creating event network-vif-unplugged:ca9d5754-4e97-43aa-b9c4-80092c138438 for instance cff2829f-3659-4083-8506-89b6b6558ee5 on n-h2-860687-2 Oct 10 11:04:07.634087 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fdc733a3-9f1f-4e0c-bab3-f428dfeb38f8 req-b486077a-780d-4213-8aac-9215f2043738 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128771 Oct 10 11:04:07.635142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2529/4942] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:08.157140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:08.157759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:08.167054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:08.167777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:08.168883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:08.169780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:08.170440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:08.171032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:09.099921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:09.112584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-903fe82a-8231-436e-9759-9260b51d565b tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 200 len: 1448 microversion: 2.1 time: 0.960163 Oct 10 11:04:09.119854 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2414/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:08 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 1448 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:09.145631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:09.147318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:09.156239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:09.157315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:09.157906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:09.158803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:09.159477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:09.160050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:09.665932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:09.690352 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3e51a2b-2db5-4f87-9772-78b83af79913 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.546535 Oct 10 11:04:09.693158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2530/4944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:09.723465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:09.724096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:09.735370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:09.736187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:09.742925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:09.744053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:09.745131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:09.745782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:10.669006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:10.739786 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed014a9b-698e-4aa0-9168-b1863f4ff02d tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 1.015502 Oct 10 11:04:10.742670 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2415/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:09 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:10.778056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:10.780329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:10.791533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:10.792410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:10.793038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:10.795616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:10.796265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:10.796834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:11.257661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:11.274290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d2abee0-5e3b-4eae-a51a-0d60b6c33f80 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.506087 Oct 10 11:04:11.274898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2531/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:10 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:11.310960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:11.311728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:11.323983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:11.325263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:11.326733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:11.327724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:11.331657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:11.335440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:11.729266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:11.742512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=82 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:11.745863 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3fe0320-2094-4a72-bb18-31b8cbe956c8 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.445612 Oct 10 11:04:11.748630 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2416/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:11.775886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:11.792213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:11.794332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:11.796176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:11.862465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:04:11.948400 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-53506612-f9f6-4fdd-829e-d5e1b4b5ccef tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.178292 Oct 10 11:04:11.950818 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2532/4948] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:04:11 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:04:11.961801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:11.962695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:11.971348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:11.971865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:11.972309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:11.973029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:11.973491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:11.973924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:12.453585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:12.464345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8916797-ef79-44f1-9eca-fa9acd2353ac tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.509812 Oct 10 11:04:12.483217 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2417/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:11 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:13.493950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:13.495452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:13.507717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:13.508407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:13.509019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:13.510407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:13.512152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:13.512728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:14.048563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:14.057370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fdb03ea8-1470-4bdf-863f-73ca3e12f398 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.568561 Oct 10 11:04:14.072477 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2533/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:13 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:15.085127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:15.085894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:15.103275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:15.103949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:15.104533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:15.105912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:15.106508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:15.107227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:15.480137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:15.524425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6bac49d-70c1-44b1-9a12-37aa9e6cf812 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.444459 Oct 10 11:04:15.527790 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2418/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:15 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:16.559574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:16.561848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:16.584632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:16.585338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:16.587820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:16.591034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:16.596703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:16.597254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:16.910942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:16.920533 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c5c5fc05-ca87-4a74-8e6f-f2f75aaec55f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.373731 Oct 10 11:04:16.921143 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2534/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:16 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:17.950436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:17.951687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:17.959440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:17.960160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:17.960895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:17.961797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:17.962885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:17.963588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:18.348748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:18.386662 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c2413ba-ca15-4d79-b29c-45f5857020ec tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.440684 Oct 10 11:04:18.391139 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2419/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:17 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:19.423135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:19.424779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:19.442332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:19.443663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:19.444255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:19.446880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:19.447474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:19.448087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:20.112501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:20.129190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b60761a5-099f-4dbe-9946-dc15966683ae tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.710829 Oct 10 11:04:20.135565 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2535/4954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:19 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:21.159210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:21.159837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:21.176087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:21.177820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:21.179513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:21.180542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:21.186535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:21.188721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:21.516242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:21.554047 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1e7976f-4a48-4a56-b2c5-92df7b56f4b3 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1676 microversion: 2.1 time: 0.395772 Oct 10 11:04:21.584218 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2420/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:21 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1676 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:22.612055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:22.612930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:22.626787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:22.628547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:22.629121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:22.631300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:22.634510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:22.637392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:23.156599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:23.182682 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d36f247-70b6-46a2-b5db-86f559ccbd57 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1653 microversion: 2.1 time: 0.573047 Oct 10 11:04:23.187087 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2536/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:22 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1653 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:23.220326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:23.236679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:23.237536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:23.238165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:23.290630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:04:23.399513 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad70bd13-b3c9-4cfd-900d-012a8588d2ad tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.189504 Oct 10 11:04:23.406045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2421/4957] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:04:23 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:04:23.412008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:23.412961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:23.431182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:23.431757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:23.436996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:23.438023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:23.440071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:23.440689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:23.879610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:23.895835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5f271a1-8004-4176-86f4-9331de8c149e tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1662 microversion: 2.1 time: 0.490451 Oct 10 11:04:23.898701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2537/4958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:23 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1662 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:24.925543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:24.927760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:24.937961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:24.938891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:24.940473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:24.941400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:24.942285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:24.943100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:25.507184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:25.516210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af19e3ad-fb1d-49fc-9a24-f661315a527f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1662 microversion: 2.1 time: 0.596467 Oct 10 11:04:25.517386 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2422/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:24 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1662 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:26.554945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:26.556333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:26.573368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:26.573368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:26.583101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:26.584988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:26.586601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:26.588167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:27.144012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:27.152952 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30ae7ad6-8e0f-4023-a9db-885ab973ec9c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.606538 Oct 10 11:04:27.153523 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2538/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:26 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:27.181099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:27.182041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:27.190030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:27.190524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:27.190963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:27.191922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:27.192387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:27.192817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:27.529334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:27.540378 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6376f71c-857c-4a94-9d9f-df0f417a6e16 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.363085 Oct 10 11:04:27.546097 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2423/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:27 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:27.585004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:27.586146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:27.602331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:27.603188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:27.603775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:27.604642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:27.608357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:27.609189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:27.960191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:27.970104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc39cca4-66b2-46dd-a277-5233f2aa3c2c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.389619 Oct 10 11:04:27.971660 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2539/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:27 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:27.999545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:28.000182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:28.008947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.011981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.013559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.015322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.016390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.017036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.216807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:28.217740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:28.232458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.234453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.235883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.236977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.238440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.241326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.313549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3fe55f2c-75aa-45ee-9f43-f2dc7ad34f90 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/ips" status: 200 len: 146 microversion: 2.1 time: 0.102006 Oct 10 11:04:28.316223 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2540/4963] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:04:28 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/ips => generated 146 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:28.900900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:28.912041 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-125eb1df-e750-417b-9d62-5f3cb51c9bf0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.916965 Oct 10 11:04:28.913460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2424/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:27 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:28.951528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:28.952162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:28.962429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.964007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.965399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.969797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:28.971627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:28.972477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:28.978931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:29.378615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:29.395982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bc5167a-a81b-4b78-acb9-ce5bd2d18b6f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.452082 Oct 10 11:04:29.398571 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2541/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:28 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:29.425932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:29.426891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:29.444812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:29.446450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:29.447952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:29.450244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:29.450965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:29.451640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:29.485626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lazy-loading 'flavor' on Instance uuid 99c98dac-c643-47fd-a1e8-11e7afcb35b8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:04:29.640671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5f899b1-8555-424a-91d7-0be245e9a0b5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.215316 Oct 10 11:04:29.642132 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2425/4966] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:04:29 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:04:29.659379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:29.659379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:29.716457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:29.731145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:29.731800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:29.736900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:29.744027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:29.745112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:30.144204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:30.179749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f0c6d11f-af8e-4f58-b29c-593eebebbd1a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1674 microversion: 2.1 time: 0.532303 Oct 10 11:04:30.183174 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2542/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:29 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1674 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:31.185123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4eff84a6-606e-4ed0-a659-251914c0480f"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:31.189166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:31.204370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.206620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.207448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:31.208166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:31.209372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:31.210171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.210836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.212414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:31.242365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.242900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.243382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:31.244126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.250748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.254272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:31.728848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02e21552-1256-4701-8f8e-33baf2036cb2 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550337 Oct 10 11:04:31.733222 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2426/4968] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:04:31 2022] POST /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:31.864286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:31.883041 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c97a97d-8a07-4cce-adfa-4a0a18df7137 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1657 microversion: 2.1 time: 0.679787 Oct 10 11:04:31.884022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2543/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:31 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1657 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:31.916604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:31.917410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:31.942084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.946759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.947362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:31.948197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:31.951126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:31.952741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:32.137862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb61b609-44a8-4b92-87ee-f27f355822b4 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action" status: 202 len: 0 microversion: 2.1 time: 0.228106 Oct 10 11:04:32.141512 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2427/4970] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:04:31 2022] POST /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:04:32.146781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:32.147434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:32.158313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:32.161467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:32.163700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:32.169172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:32.169957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:32.170613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:32.465827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:32.479464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c97c030-bf9f-4f92-a0e5-a73b27cd017a tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1663 microversion: 2.1 time: 0.336435 Oct 10 11:04:32.480442 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2544/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:32 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1663 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:33.506689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:33.507567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:33.520722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:33.525715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:33.527577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:33.530561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:33.533552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:33.534273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:33.534891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:33.593898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:33.837766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:33.853755 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aaba6504-d29a-40c3-9b2d-ae41dc955b95 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1663 microversion: 2.1 time: 0.352684 Oct 10 11:04:33.856328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2428/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:33 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1663 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:34.884099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:34.885661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:34.897660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:34.899587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:34.907721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:34.908759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:34.909448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:34.910083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:35.319915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:35.329850 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6a3dde0-3c04-4861-af1b-e00a1b9a659c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1663 microversion: 2.1 time: 0.449852 Oct 10 11:04:35.356553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2545/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:34 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1663 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:36.385447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:36.387794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:36.394946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:36.395731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:36.396321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:36.397616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:36.398225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:36.398850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:36.748405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:36.767165 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c80399f-964c-4a4a-aa88-85835c9cc1d1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.389740 Oct 10 11:04:36.770673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2429/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:36 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:36.801457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:36.802079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:36.808729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:36.817087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:36.819449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:36.820112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:36.823285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:36.825247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:36.828963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:37.320992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:37.332596 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7cd3bce7-2c93-4225-b8c5-f5b3862b6652 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1666 microversion: 2.1 time: 0.535533 Oct 10 11:04:37.333612 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2546/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:36 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1666 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:37.366676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:37.367457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:37.381557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:37.389419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:37.403583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:37.416451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:37.417213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:37.421551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:37.486064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:04:37.495928 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Working on deleting snapshot 8a4a930f-3633-438d-b818-1c9be6b3c7fd from shelved instance... Oct 10 11:04:38.822521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Doing local delete in cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) {{(pid=128801) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 10 11:04:38.826005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:38.827792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:38.831078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:38.831662 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 10 11:04:38.856642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] deallocate_for_instance() {{(pid=128801) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 10 11:04:40.534715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Updating instance_info_cache with network_info: [] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 11:04:40.545807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff2829f-3659-4083-8506-89b6b6558ee5", "name": "network-vif-deleted", "tag": "ca9d5754-4e97-43aa-b9c4-80092c138438"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:40.593220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:40.594810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:40.596331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:40.648352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_external_events [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] Unable to find a host for instance cff2829f-3659-4083-8506-89b6b6558ee5. Dropping event network-vif-deleted {{(pid=128800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 11:04:40.657313 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-75f0a1f7-dc5d-4581-99f3-25a92ca5e7ea req-7f44dc46-e6e6-4792-966b-56683d46bf51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.117139 Oct 10 11:04:40.661585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2547/4976] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 123 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 11:04:41.478162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c5d52b7-4f00-43d9-add3-084148984073 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 204 len: 0 microversion: 2.1 time: 4.116200 Oct 10 11:04:41.486377 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2430/4977] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:04:37 2022] DELETE /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 0 bytes in 4125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:04:41.496158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:41.497149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: cff2829f-3659-4083-8506-89b6b6558ee5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:41.509017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.512414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.513192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:41.516131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.516635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.517085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:41.543183 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 HTTP/1.1 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'cff2829f-3659-4083-8506-89b6b6558ee5'} Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:41.545336 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. Oct 10 11:04:41.550597 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:41.551720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 404 to user: Instance cff2829f-3659-4083-8506-89b6b6558ee5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:04:41.552961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef7ee935-54a7-4beb-b608-1e3cd92fb5c0 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5" status: 404 len: 111 microversion: 2.1 time: 0.061757 Oct 10 11:04:41.555399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2548/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:41 2022] GET /compute/v2.1/servers/cff2829f-3659-4083-8506-89b6b6558ee5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:04:41.562536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:41.564237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:41.571411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.572207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.572854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:41.574635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.575389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.576003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:41.623294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:04:41.783454 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29a23816-7f29-4a63-b3d3-0fa72064ba6c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 204 len: 0 microversion: 2.1 time: 0.224628 Oct 10 11:04:41.784989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2431/4979] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:04:41 2022] DELETE /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:04:41.794079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:41.794923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:41.817549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.818300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.819183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:41.820685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:41.823858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:41.825108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:42.452536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:42.466658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd17f8aa-27a3-4e0c-81ad-6a2b4e720dba tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1465 microversion: 2.1 time: 0.676442 Oct 10 11:04:42.486918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2549/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:41 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1465 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:43.496593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:43.498202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:43.513265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:43.514783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:43.516664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:43.525325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:43.526745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:43.529255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:43.891524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:43.908438 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a381b9f-4020-4efa-ac5a-da12fc04a817 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 200 len: 1465 microversion: 2.1 time: 0.418237 Oct 10 11:04:43.923327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2432/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:43 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 1465 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:43.939927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fc8cd7-d601-43d5-8ffb-e563cff1382d", "name": "network-vif-deleted", "tag": "d8fb2443-4942-4ea5-8d8c-ae528fd079c5"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:43.977338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:43.980832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:43.982737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:44.029210 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] Creating event network-vif-deleted:d8fb2443-4942-4ea5-8d8c-ae528fd079c5 for instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d on n-h2-860687-2 Oct 10 11:04:44.046062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f1e443df-9188-4556-9036-2455650091a6 req-4bebe949-dbdc-4373-bb31-ffb55a4239ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118715 Oct 10 11:04:44.047787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2550/4982] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:44.940486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:44.941113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 84fc8cd7-d601-43d5-8ffb-e563cff1382d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:44.949691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:44.954127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:44.955167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:44.956543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:44.957250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:44.957887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:44.994369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d HTTP/1.1 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '84fc8cd7-d601-43d5-8ffb-e563cff1382d'} Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:44.998054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 404 to user: Instance 84fc8cd7-d601-43d5-8ffb-e563cff1382d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:04:45.001592 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f002db0-5091-4b37-8947-a0d3dda511fd tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d" status: 404 len: 111 microversion: 2.1 time: 0.063229 Oct 10 11:04:45.003197 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2433/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:44 2022] GET /compute/v2.1/servers/84fc8cd7-d601-43d5-8ffb-e563cff1382d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:04:45.009140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:45.009727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:45.019564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:45.021213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:45.025574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:45.030344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:45.031913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:45.034008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:45.123482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:04:45.338966 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93ac9e9d-f98c-4470-94c8-6143e7894ea7 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 204 len: 0 microversion: 2.1 time: 0.333811 Oct 10 11:04:45.341454 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2551/4984] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:04:45 2022] DELETE /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:04:45.364081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:45.364729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:45.393963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:45.396278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:45.396752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:45.400905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:45.401919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:45.403756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:46.013941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:46.023424 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5be21e81-b5dc-481b-98e9-f32e1f167e15 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1506 microversion: 2.1 time: 0.676784 Oct 10 11:04:46.025359 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2434/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:45 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:47.050791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:47.056019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:47.073815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:47.088954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:47.089636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:47.090478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:47.091182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:47.091745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:47.518417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:47.530829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c118568-6d4d-422c-9abc-4a09cd7a70aa tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 200 len: 1506 microversion: 2.1 time: 0.484756 Oct 10 11:04:47.537418 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2552/4986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:47 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:47.985674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22017dc-9e30-4f8a-88ac-2d26b42940f0", "name": "network-vif-deleted", "tag": "9db59aa4-a993-421b-a9bf-cc1bf6a10ab9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:48.018924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.019798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.023720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.067375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] Creating event network-vif-deleted:9db59aa4-a993-421b-a9bf-cc1bf6a10ab9 for instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 on n-h2-860687-2 Oct 10 11:04:48.090605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f1d2f58f-523e-454d-a9ee-c6e8ef69a3c9 req-7443a745-465d-4134-88de-969fb167d07f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105980 Oct 10 11:04:48.091740 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2435/4987] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:48.561440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:48.562323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: f22017dc-9e30-4f8a-88ac-2d26b42940f0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:48.578098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.582144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.582796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.590020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.590934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.591884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.627727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 HTTP/1.1 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f22017dc-9e30-4f8a-88ac-2d26b42940f0'} Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:48.635098 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. Oct 10 11:04:48.639343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:48.641546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 404 to user: Instance f22017dc-9e30-4f8a-88ac-2d26b42940f0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:04:48.642648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57485b07-c42a-4e01-8b73-a1b2fdeb80f9 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0" status: 404 len: 111 microversion: 2.1 time: 0.088834 Oct 10 11:04:48.644002 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2553/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:48 2022] GET /compute/v2.1/servers/f22017dc-9e30-4f8a-88ac-2d26b42940f0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:04:48.654553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:48.656019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:48.664403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.665287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.665999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.667128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.667881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.668608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.708767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:04:48.783345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:48.823821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f5caca1-6953-46be-97a0-0e4cc9546763 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 204 len: 0 microversion: 2.1 time: 0.175115 Oct 10 11:04:48.826384 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2436/4989] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:04:48 2022] DELETE /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:04:48.834315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:48.835296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:48.844822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.845619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.846288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:48.847263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:48.848057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:48.848716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:49.302788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:49.318330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d008f80-2aa3-4073-9352-f2d8eb4120e1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1492 microversion: 2.1 time: 0.487311 Oct 10 11:04:49.321056 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2554/4990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:48 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1492 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:50.313543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a655e72-4da2-4106-b390-17c26fcc2881", "name": "network-vif-deleted", "tag": "643317f1-516b-4659-9b5e-bcf1795841ff"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:50.340898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:50.344074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:50.346182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:50.361785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:50.368954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:50.386096 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] Creating event network-vif-deleted:643317f1-516b-4659-9b5e-bcf1795841ff for instance 2a655e72-4da2-4106-b390-17c26fcc2881 on n-h1-860687-2 Oct 10 11:04:50.396588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:50.397132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:50.397249 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-69fa7d4e-7dc6-4cd6-99aa-3f2cd9a9ad80 req-2e0cfdc6-cbfe-4243-ab8b-64f9a0a2eaba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087909 Oct 10 11:04:50.397526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:50.398244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:50.398699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:50.399165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:50.403688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2437/4991] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:50.704778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:50.715126 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2116c14d-9753-4b36-8e2a-609edc89274f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 200 len: 1286 microversion: 2.1 time: 0.373608 Oct 10 11:04:50.727488 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2555/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:50 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 1286 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:51.743673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:51.745570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 2a655e72-4da2-4106-b390-17c26fcc2881] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:51.754290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:51.755098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:51.756373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:51.758818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:51.759485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:51.762253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:51.794250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 HTTP/1.1 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '2a655e72-4da2-4106-b390-17c26fcc2881'} Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:51.797067 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. Oct 10 11:04:51.801426 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:04:51.802924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 404 to user: Instance 2a655e72-4da2-4106-b390-17c26fcc2881 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:04:51.803970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0079a439-feb7-48c7-a0ce-c837d6f44fa1 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881" status: 404 len: 111 microversion: 2.1 time: 0.067585 Oct 10 11:04:51.808876 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2438/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:51 2022] GET /compute/v2.1/servers/2a655e72-4da2-4106-b390-17c26fcc2881 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:04:51.813621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:51.814137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:51.823084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:51.823600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:51.824051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:51.824779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:51.825249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:51.825688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:51.897064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:04:52.012348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:52.016949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:52.036074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.038329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.039675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.040491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.042749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.043049 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c515f869-8bb7-458d-beda-33b6662ec9e5 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 204 len: 0 microversion: 2.1 time: 0.232985 Oct 10 11:04:52.043673 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2556/4994] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:04:51 2022] DELETE /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:04:52.048719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.058375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:52.059392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:52.068390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.069525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.070899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.072153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.073314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.073897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.079047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:04:52.130163 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30352728-9971-46dc-8caa-14a40095eebe tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125901 Oct 10 11:04:52.140460 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2439/4995] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:04:52 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:52.148057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:52.148746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:52.157951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.158854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.160463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.161745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:52.162151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:52.162897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:52.203215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb5df075-bf5e-4f12-9b2a-baf11834c6c0 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f" status: 200 len: 194 microversion: 2.1 time: 0.060582 Oct 10 11:04:52.207588 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2440/4996] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 10 11:04:52 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:52.800779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:52.811294 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d91881b1-09bd-49b7-83bd-c2d6e1d87fcc tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1672 microversion: 2.1 time: 0.760628 Oct 10 11:04:52.811897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2557/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:52 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1672 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:53.851416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:53.852627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:53.880868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:53.887723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:53.890670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:53.891648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:53.899679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:53.900297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:54.483895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:54.504054 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bb0f30d-e2b3-4747-8b5e-93f257a76166 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1672 microversion: 2.1 time: 0.655895 Oct 10 11:04:54.504968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2441/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:53 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1672 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:54.937092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "432c2cd7-2dc3-4210-b3cb-186d891bb1bd"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:54.940056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:54.952768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:54.958445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:54.959174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:54.961081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:54.961916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:54.964941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:55.483971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5970f70-f458-4f22-9816-a1797bbf83ae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "POST /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541488 Oct 10 11:04:55.490868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2558/4999] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:04:54 2022] POST /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:55.531614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:55.532241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:55.542879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:55.543332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:55.543754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:55.544491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:55.544927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:55.545350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:55.921321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:55.944893 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-201442fb-0cdc-45dc-b9e4-236db40c0797 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1672 microversion: 2.1 time: 0.417138 Oct 10 11:04:55.945730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2442/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:55 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1672 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:04:56.974061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:56.974777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:57.007659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:57.008435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:57.008896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:57.020220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:57.020839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:57.021972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:57.313265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128f21e803142dfaea0f2ca2acc0d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a9b3e4da4e4c25ac8641738682fb0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:04:57.322951 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a3721168-4ffa-4b48-a59d-f4675644e1c6 tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 200 len: 1604 microversion: 2.1 time: 0.353779 Oct 10 11:04:57.327486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2559/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:56 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:04:57.577214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c98dac-c643-47fd-a1e8-11e7afcb35b8", "name": "network-vif-deleted", "tag": "5e21b81a-43bd-42e8-822e-95eccfc19776"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:04:57.599089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:57.607503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:57.613220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:57.665063 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] Creating event network-vif-deleted:5e21b81a-43bd-42e8-822e-95eccfc19776 for instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 on n-h1-860687-2 Oct 10 11:04:57.689265 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-148ef89a-4921-4bff-8599-5005af1391f5 req-a0b86444-0e4c-44f4-9a26-274b7a0402b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115688 Oct 10 11:04:57.692719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2443/5002] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:04:58.354285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:58.355867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] [instance: 99c98dac-c643-47fd-a1e8-11e7afcb35b8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:04:58.373147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:58.374020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:58.380654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:58.387324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:04:58.388892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:04:58.389701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:04:58.433071 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] HTTP exception thrown: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Request method failure captured: Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 HTTP/1.1 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_o8QYGek7kzN57gkYVwBElxESqE_Y7XAQ0MU4agYALpO0YKik9mc3md877EvMqC7U_9fhM66EO6-usBzfhP6d9dOd7gKFpCiFT-zEioTCX-4F3SOu8YYA1gaqiZMsC_Y5P9MIYAFTB3bPCxS0Z0tIKUa4zZRDvURorIzidYp0V58ZY Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1a9b3e4da4e4c25ac8641738682fb0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1a9b3e4da4e4c25ac8641738682fb0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1a9b3e4da4e4c25ac8641738682fb0c"}]}] Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: d1a9b3e4da4e4c25ac8641738682fb0c Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-564483382 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: b128f21e803142dfaea0f2ca2acc0d16 Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-564483382-project Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '99c98dac-c643-47fd-a1e8-11e7afcb35b8'} Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:04:58.445699 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. Oct 10 11:04:58.450575 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:04:58.452134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Returning 404 to user: Instance 99c98dac-c643-47fd-a1e8-11e7afcb35b8 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:04:58.461379 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b9a6d838-3e39-49b9-903f-ec1718b0711c tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8" status: 404 len: 111 microversion: 2.1 time: 0.109852 Oct 10 11:04:58.462774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2560/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:04:58 2022] GET /compute/v2.1/servers/99c98dac-c643-47fd-a1e8-11e7afcb35b8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:04:58.474750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-314729c1-d862-4f5b-b466-f8ccb7b3817f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] Calling method '.version_select at 0x7f677d2198b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:04:58.528040 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-314729c1-d862-4f5b-b466-f8ccb7b3817f tempest-ServerActionsTestJSON-564483382 tempest-ServerActionsTestJSON-564483382-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319390018" status: 202 len: 0 microversion: 2.1 time: 0.059612 Oct 10 11:04:58.532888 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2444/5004] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 11:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319390018 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:05:12.888442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:12.889326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:13.346313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-916249459", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:13.473070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:05:13.473513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:05:13.474051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:05:13.474483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:05:13.474909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:05:13.518505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:13.519032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:13.519502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:13.520253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:13.520722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:13.521159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:13.699117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Getting quotas for project edcd52eacc8e43b0805cf036ff907570. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:05:13.699117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Getting quotas for user e31a75577bb74b919daf42601ac8348a and project edcd52eacc8e43b0805cf036ff907570. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:05:13.699117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:05:13.813301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:05:13.873166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c37d42fa-85b1-4994-a22d-095fceef56cd tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.991513 Oct 10 11:05:13.874021 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2561/5005] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 11:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 11:05:13.887372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:13.889872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:13.892545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:13.899314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:14.130213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:14.145633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:14.149806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:14.154790 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96b03ac2-9c9c-4878-89cd-63fa51274ccb tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1280 microversion: 2.47 time: 0.273452 Oct 10 11:05:14.157033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2445/5006] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:13 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:15.193533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:15.194379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:15.475578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:15.486819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:15.495288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:15.498535 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b79a8c91-959d-46ab-a84c-2380bc61740c tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1280 microversion: 2.47 time: 0.314840 Oct 10 11:05:15.508309 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2562/5007] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:15 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:16.531168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:16.531890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:16.548501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:16.549020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:16.549466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:16.550224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:16.550671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:16.562012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:16.845886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:16.855731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:16.860859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:16.866107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5fa2abd-6e43-4acd-b1de-2396e2c80849 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1332 microversion: 2.47 time: 0.338900 Oct 10 11:05:16.871137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2446/5008] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:16 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1332 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:17.896522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:17.897734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:17.921095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:17.921598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:17.922043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:17.922767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:17.923256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:17.943136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:18.325815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:18.334659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:18.336127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:18.343818 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a06c31d4-babd-4e10-b643-cd6d168bd826 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1338 microversion: 2.47 time: 0.449113 Oct 10 11:05:18.347396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2563/5009] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:17 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1338 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:19.390177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:19.390932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:19.404274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:19.405975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:19.407470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:19.408449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:19.410098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:19.411291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:19.633564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:19.648380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:19.652149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:19.657763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d85362ca-9376-43d6-ac75-8463e0dbfc14 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1359 microversion: 2.47 time: 0.282591 Oct 10 11:05:19.661546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2447/5010] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:19 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:19.686451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1007844677"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:19.689051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:19.702233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:19.702740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:19.703230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:19.704285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:19.704904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:19.705481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:20.062838 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b3c2a82-7c8c-4241-89d2-c23337533b89 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "POST /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee/action" status: 202 len: 52 microversion: 2.47 time: 0.378182 Oct 10 11:05:20.075717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:20.076232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:20.081569 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2564/5011] 10.222.0.16 () {62 vars in 1319 bytes} [Mon Oct 10 11:05:19 2022] POST /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee/action => generated 52 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 10 11:05:20.084286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:20.088392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:20.089216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:20.097132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:20.097649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:20.098103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:20.188998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:05:20.404644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b64e1c3-629c-4898-a8a0-8aef8284192e tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "DELETE /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 204 len: 0 microversion: 2.47 time: 0.331555 Oct 10 11:05:20.406265 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2448/5012] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:05:20 2022] DELETE /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 11:05:20.423697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:20.424418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:20.434829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:20.437812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:20.438266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:20.439042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:20.443442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:20.444417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:20.720415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:20.739705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:20.771675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:20.791680 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-703a4336-1548-4f6e-8597-f08717660f2d tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1365 microversion: 2.47 time: 0.376882 Oct 10 11:05:20.805036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2565/5013] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:20 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:21.638510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:21.640885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:21.659940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.660478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.660953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:21.661684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.675487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.675998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:21.768062 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84e902d0-7ff0-4d0e-9f7d-cf127c179dc5 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.142006 Oct 10 11:05:21.770577 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2449/5014] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:05:21 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:21.819772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:21.820392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:21.835667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.836583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.837063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:21.837809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.839504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.846575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:21.924507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:21.925298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:21.938787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.943478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.944220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:21.945314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:21.946013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:21.946731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:22.076759 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-550cfc34-ac0c-443b-bb7b-345e5ea3691f tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f" status: 200 len: 194 microversion: 2.1 time: 0.163260 Oct 10 11:05:22.084015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2450/5015] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 10 11:05:21 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:22.098582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:22.100651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:22.117887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:22.118797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:22.119536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:22.120632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:22.121362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:22.122050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:22.124620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:22.134843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:22.141617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:22.146784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4aa9fee-6fac-44b5-966c-0bd256f5b674 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1365 microversion: 2.47 time: 0.331209 Oct 10 11:05:22.147764 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2566/5016] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:21 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:22.296774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lazy-loading 'services' on Instance uuid 9342d50b-dab3-4628-a53b-2dbe6afa8362 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:05:22.462253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a21c702-ca8d-4339-9b56-ff0efae4fd50 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f" status: 202 len: 0 microversion: 2.1 time: 0.369742 Oct 10 11:05:22.477444 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2451/5017] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:05:22 2022] DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/4eff84a6-606e-4ed0-a659-251914c0480f => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:05:23.182287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:23.183426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:23.191677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:23.192097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:23.192539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:23.215369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:23.215369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:23.215821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:23.365800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:23.370034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:23.370616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:23.371922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lazy-loading 'fault' on Instance uuid 82805d19-6c04-4f47-aa70-9aa1e8caacee {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:05:23.561039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:23.615615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:23.631133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:23.636891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e31a75577bb74b919daf42601ac8348a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcd52eacc8e43b0805cf036ff907570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:23.642584 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-79c86beb-283b-43fd-9ce4-58eb8535ffe6 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 200 len: 1370 microversion: 2.47 time: 0.462337 Oct 10 11:05:23.643574 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2567/5018] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:23 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:24.673254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:24.678699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:24.682630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] [instance: 82805d19-6c04-4f47-aa70-9aa1e8caacee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:24.702740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:24.703595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:24.704278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:24.705732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:24.706912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:24.707629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:24.757018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] HTTP exception thrown: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Request method failure captured: Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee HTTP/1.1 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_xoqcTaNigFsMb_GrCozSlF-V2t0Np-ySVLNldVxqYIlgq-RMSJymuIame9Y7w0mQOunVXDhXCSdbSTRQD2jDmi43Dd2sh57tnWuJ0DmsWe3l8XpvUhCq0k2ELzuNckOqCaRXa0u54FlTtbAdU9fVuF5Uu5Yd8hKXX0wyXIFkrIic0 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: edcd52eacc8e43b0805cf036ff907570 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAaction247Test-1373400515 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/edcd52eacc8e43b0805cf036ff907570"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_edcd52eacc8e43b0805cf036ff907570", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/edcd52eacc8e43b0805cf036ff907570"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/edcd52eacc8e43b0805cf036ff907570"}]}] Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAaction247Test-1373400515 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: edcd52eacc8e43b0805cf036ff907570 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAaction247Test-1373400515 Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAaction247Test-1373400515-project Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: e31a75577bb74b919daf42601ac8348a Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAaction247Test-1373400515-project Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '82805d19-6c04-4f47-aa70-9aa1e8caacee'} Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:05:24.759322 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:05:24.763199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] Returning 404 to user: Instance 82805d19-6c04-4f47-aa70-9aa1e8caacee could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:05:24.765879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-409e8518-f5d3-4e61-a03d-bea08fd343f4 tempest-ServersAaction247Test-1373400515 tempest-ServersAaction247Test-1373400515-project] 10.222.0.16 "GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee" status: 404 len: 111 microversion: 2.47 time: 0.089557 Oct 10 11:05:24.767527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2452/5019] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:24 2022] GET /compute/v2.1/servers/82805d19-6c04-4f47-aa70-9aa1e8caacee => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 11:05:34.180262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:34.181535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:34.184877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:34.186170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:34.188770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:34.200586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:34.207382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:34.213648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:34.214547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:34.215082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:34.215536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:34.341291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-825e8e37-3878-4ab5-a8fa-8f507cca6501 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/432c2cd7-2dc3-4210-b3cb-186d891bb1bd" status: 200 len: 194 microversion: 2.1 time: 0.161633 Oct 10 11:05:34.342461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2568/5020] 10.222.0.16 () {58 vars in 1413 bytes} [Mon Oct 10 11:05:34 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/432c2cd7-2dc3-4210-b3cb-186d891bb1bd => generated 194 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:34.365340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:34.367347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:34.392104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:34.392819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:34.393444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:34.394330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:34.395152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:34.395747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:34.587846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lazy-loading 'services' on Instance uuid 9342d50b-dab3-4628-a53b-2dbe6afa8362 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:05:34.744580 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21755921-6bb9-409f-a863-b3499ad463a7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/432c2cd7-2dc3-4210-b3cb-186d891bb1bd" status: 202 len: 0 microversion: 2.1 time: 0.395149 Oct 10 11:05:34.761562 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2453/5021] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:05:34 2022] DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments/432c2cd7-2dc3-4210-b3cb-186d891bb1bd => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:05:38.960345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:38.961010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:38.976164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:38.979720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:38.980216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:38.980975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:38.981460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:38.981906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:39.057998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:05:39.286174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bde913b1-2560-42f4-92c7-2f15cefecc73 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 204 len: 0 microversion: 2.32 time: 0.749651 Oct 10 11:05:39.287380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2569/5022] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:05:38 2022] DELETE /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 11:05:39.306320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:39.309550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:39.327269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:39.329551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:39.330064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:39.331443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:39.335206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:39.335745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:39.422885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-79037319", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "908c4262-03b1-46b6-b2b0-bd1f1fd8089b"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:39.520755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] validate_networks() for [('908c4262-03b1-46b6-b2b0-bd1f1fd8089b', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:05:40.109164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:40.127410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:40.135969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:40.140666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cf8f854-510a-492b-ad51-95c061a9eb03 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2957 microversion: 2.32 time: 0.844177 Oct 10 11:05:40.144598 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2454/5023] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:39 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2957 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:41.174253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:41.175627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:41.189081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:41.189730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:41.190272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:41.191777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:41.192478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:41.194451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:41.868237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:05:41.868745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:05:41.869230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:05:41.869809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:05:41.870381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:05:41.890482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:41.891288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:41.891888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:41.892771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:41.893377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:41.893969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:41.944679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Getting quotas for project a1b4766cf07a4e278a9bcaa2190b36c5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:05:41.963293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Getting quotas for user 4bc16e439f2d49e1b2771eed8155aea8 and project a1b4766cf07a4e278a9bcaa2190b36c5. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:05:41.993436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:05:42.003160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:05:42.108764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3ea8dc0-b08e-4300-b323-1ad033adb2e5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.804558 Oct 10 11:05:42.109436 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2570/5024] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:05:42.121667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-13b0492b-0472-4e37-a70c-a8eda03f44c6 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:42.123031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-13b0492b-0472-4e37-a70c-a8eda03f44c6 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:42.131650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:42.151311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:42.168958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:42.181613 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc68057d-5198-4fad-b824-018223e1abbf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2957 microversion: 2.32 time: 1.012328 Oct 10 11:05:42.184523 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2455/5025] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:41 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2957 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:05:42.308218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-13b0492b-0472-4e37-a70c-a8eda03f44c6 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:42.331835 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-13b0492b-0472-4e37-a70c-a8eda03f44c6 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1213 microversion: 2.1 time: 0.210435 Oct 10 11:05:42.352701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2571/5026] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:42 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:05:43.219849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:43.220505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:43.234774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:43.240090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:43.240878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:43.243120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:43.243638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:43.245546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:43.359630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:43.360253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:43.374877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:43.377713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:43.378180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:43.378983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:43.379437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:43.379876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:43.531075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:43.543689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe80da81-6075-4e09-be30-d5ae11632dd0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1209 microversion: 2.1 time: 0.187798 Oct 10 11:05:43.567621 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2572/5027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:43 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:05:43.886912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:43.908171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:43.941189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:43.950680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c487d345-60a0-4848-9cd7-ce7e37333848 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2957 microversion: 2.32 time: 0.728740 Oct 10 11:05:43.954349 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2456/5028] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:43 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2957 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:44.211621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:44.215568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:44.226170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.228869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.229652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.232308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.233202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.233871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.357045 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-31946ecf-a5bb-447f-af59-198b65fafc94 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150116 Oct 10 11:05:44.369229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2573/5029] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:05:44 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:05:44.574503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:44.575169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:44.579973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:44.593254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.593767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.594209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.594926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.598900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.599566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.637953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:44.642940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:44.657016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.662267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.663509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.665077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.667609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.669259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.753925 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24056c53-065e-4dd0-a95e-a1334dccf5c7 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118362 Oct 10 11:05:44.755010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:44.756802 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2574/5030] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:05:44 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:05:44.867294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:44.900310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66ecd64c-e286-4987-ae41-1fbcf6586c02 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1271 microversion: 2.1 time: 0.330149 Oct 10 11:05:44.903836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2457/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:44 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:44.953066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:44.953580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:44.964047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.964565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.965017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.965749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:44.966217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:44.966654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:44.985027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:44.986023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:45.000700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.004978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.008732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:45.009857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.010721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.013255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:45.066950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:05:45.253397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2936f11-c91a-4981-b755-8d4156136a15 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 204 len: 0 microversion: 2.1 time: 0.304322 Oct 10 11:05:45.256605 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2575/5032] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:05:44 2022] DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:05:45.271265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:45.272951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:45.287237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.291410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.292056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:45.292983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.293603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.294309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:45.356464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:45.375324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:45.377417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:45.379596 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71569c96-8642-4d70-8391-2d09560ca8ab tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2936 microversion: 2.32 time: 0.400698 Oct 10 11:05:45.426543 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2458/5033] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:44 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2936 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:45.731711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-149091053", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "93d05976-fdae-42b6-b9d8-a7a8b2cea49a"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:45.775667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:45.786092 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b9c23aa1-e7fb-4ba8-b1ec-a912557c7e86 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1673 microversion: 2.1 time: 0.523972 Oct 10 11:05:45.800486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2576/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:45 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1673 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:45.869027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] validate_networks() for [('93d05976-fdae-42b6-b9d8-a7a8b2cea49a', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:05:45.927093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:45.927727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:45.951097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.951598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.952035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:45.959444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:45.963274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:45.965492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:46.269041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:46.285223 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a9653c98-9727-4d7b-b1ff-e6fe2d752fcb tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1271 microversion: 2.1 time: 0.363459 Oct 10 11:05:46.285859 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2577/5035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:45 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1271 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:46.421633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:46.422609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:46.447897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:46.450414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:46.452020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:46.453933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:46.458181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:46.458981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:47.108346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:47.136287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:47.156786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:47.158299 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38ebb627-c93a-432d-8020-2935dbd55761 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2936 microversion: 2.32 time: 0.744694 Oct 10 11:05:47.173925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2578/5036] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:46 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2936 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:47.179385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:47.180629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:47.194866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:47.195741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:47.195974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:47.197173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:47.198100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:47.198746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:48.778006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:48.796245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:05:48.796741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:05:48.797121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:05:48.797529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:05:48.797939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:05:48.830972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ffb3baa-a622-4e69-874e-23e0cb5024de tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1673 microversion: 2.1 time: 1.663172 Oct 10 11:05:48.838103 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2579/5037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:47 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1673 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:48.861034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:48.866066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "b305834f-1ac8-45ca-a45f-a0c20cb5d72b"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:48.871423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:48.871991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:48.872825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:48.883791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:48.884266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:48.906429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:48.906905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:48.907374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:48.947426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Getting quotas for project d72470c909c344de98e6b4bfe997b2db. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:05:48.950513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] Creating event network-vif-unplugged:b305834f-1ac8-45ca-a45f-a0c20cb5d72b for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:48.958112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Getting quotas for user b60f8e79980c41c0b4ea63dd593eb6dd and project d72470c909c344de98e6b4bfe997b2db. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:05:48.967086 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a47544e9-bc9a-4692-bf52-a6b994ecbfa8 req-7760f6cd-520d-409f-b34b-55b10015944b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114143 Oct 10 11:05:48.968534 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2580/5038] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:48.973787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:48.980037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:48.991769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:05:48.994244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:05:49.006040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:49.006668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:49.007418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:49.010194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:49.010841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:49.011521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:49.141614 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51d288b0-5342-4b06-a621-ecbdb4599b4b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.713746 Oct 10 11:05:49.150068 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2459/5039] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:05:49.158297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:49.159151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:49.172371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:49.173144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:49.173773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:49.176116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:49.192500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:49.196638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:49.697895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:49.721833 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3cd44903-e9db-471e-aa1e-7c80445f1e53 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 0.749699 Oct 10 11:05:49.737812 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2581/5040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:48 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:49.764851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0352fddd-aaa2-4996-8fde-86afcebebfb2 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:49.767254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0352fddd-aaa2-4996-8fde-86afcebebfb2 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:49.987337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0352fddd-aaa2-4996-8fde-86afcebebfb2 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:49.997497 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0352fddd-aaa2-4996-8fde-86afcebebfb2 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1216 microversion: 2.1 time: 0.253719 Oct 10 11:05:49.998093 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2582/5041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:49 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:50.023895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:50.029169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:50.061247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:50.061817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:50.062269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:50.065457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:50.066153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:50.067057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:50.381265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:50.406789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:50.412783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:50.424330 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b22e8ee-fe90-49df-856f-1772cde28414 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2915 microversion: 2.32 time: 1.266384 Oct 10 11:05:50.427674 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2460/5042] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:49 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2915 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:50.455438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b128b8-f79c-41ce-9fd9-6736e1635c49", "tag": "c515c1f2-d522-498b-9644-089a36020684"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:50.481242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:50.485555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:50.486920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:50.529744 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] Creating event network-changed:c515c1f2-d522-498b-9644-089a36020684 for instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 on n-h2-860687-2 Oct 10 11:05:50.548588 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4ee15515-053f-4f84-883e-3a402bbfddf0 req-4b656917-f638-453f-853d-906f913c5fa6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118169 Oct 10 11:05:50.556373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2461/5043] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:50.748387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:50.750160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:50.763684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:50.765139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:50.766492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:50.769066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:50.771256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:50.772527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:51.029011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:51.049720 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-281d00f3-0109-478f-960e-032a16ab69fd tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1673 microversion: 2.1 time: 1.034918 Oct 10 11:05:51.052157 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2583/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:50 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1673 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:51.058622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:51.078282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:51.123352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:51.124753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:51.127054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:51.130052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:51.132095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:51.134071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:51.217729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:51.928677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:51.936533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:51.948165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e3ab05d-db95-45a7-85e1-b47b025fa582 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1268 microversion: 2.1 time: 0.894664 Oct 10 11:05:51.948883 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2584/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:51 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1268 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:51.953558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "ef417eee-43f2-4ecc-8d65-b4a386e3c1c1"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "9103eba2-b909-4e1e-b25f-b6d0a9eb4b97"}, {"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "9b5d88be-0f1d-4984-b018-d971f0cb8488"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:51.984594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:51.985088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:51.985538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.028882 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Creating event network-vif-unplugged:ef417eee-43f2-4ecc-8d65-b4a386e3c1c1 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:52.032800 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Creating event network-vif-unplugged:9103eba2-b909-4e1e-b25f-b6d0a9eb4b97 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:52.045781 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] Creating event network-vif-unplugged:9b5d88be-0f1d-4984-b018-d971f0cb8488 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:52.058008 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b452aeca-e672-448a-8c63-cf1ef7888e2d req-c6df6932-511a-446f-b9ca-988b0a48ba8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.107794 Oct 10 11:05:52.063356 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2585/5046] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:52.085000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:52.086726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:52.100681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:52.102408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:52.103488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.105114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:52.105850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:52.106479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.272331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:52.281496 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fa91883-8b1a-4b82-97dd-5f4e78a1fbdc tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 1.537592 Oct 10 11:05:52.282105 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2462/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:50 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:05:52.300467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:52.301106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:52.310102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:52.310621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:52.311516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.319068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:52.319719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:52.320693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.512829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:52.528554 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b314d509-c0ff-475e-9027-1b9e2e1bd262 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1605 microversion: 2.1 time: 0.245387 Oct 10 11:05:52.529466 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2463/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:52 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:52.567321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:52.578790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:52.593008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:52.594630 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f124f650-f5af-475e-a694-43b6c40641e5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2868 microversion: 2.32 time: 0.525873 Oct 10 11:05:52.595399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2586/5049] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:52 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2868 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:52.973231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:52.974146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:52.986505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:52.994413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:52.995071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:52.997003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.002217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.002896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.228487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9342d50b-dab3-4628-a53b-2dbe6afa8362", "name": "network-vif-deleted", "tag": "2a4a9c0b-fb93-4a39-9979-d0724cf95ce8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:53.249552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:53.262523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.263824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a047231-1ffe-49d9-a0a5-507667d4a78b tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1274 microversion: 2.1 time: 0.292032 Oct 10 11:05:53.264697 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2464/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:52 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:53.266229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.268094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.289440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] Creating event network-vif-deleted:2a4a9c0b-fb93-4a39-9979-d0724cf95ce8 for instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 on n-h1-860687-2 Oct 10 11:05:53.307666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:53.308939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:53.320963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.333337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.338720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.340793 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-685d21d8-72cd-4acf-8339-b35938885112 req-35a5fe94-71dc-40b7-b5b7-3570cb81832a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116631 Oct 10 11:05:53.341740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.342487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.343654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.344161 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2587/5051] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:05:53.364327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-deleted", "tag": "ef417eee-43f2-4ecc-8d65-b4a386e3c1c1"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:53.409208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.415439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.416638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.480623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] Creating event network-vif-deleted:ef417eee-43f2-4ecc-8d65-b4a386e3c1c1 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:53.497050 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6549ffa8-b116-44bb-a823-2db27be66a04 req-0aebaf99-0c11-4a6d-8cec-655b08c3133f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146399 Oct 10 11:05:53.498394 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2588/5052] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:53.553177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:53.553918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:53.569677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.570237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.578441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.579370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.579879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.580331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.678525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.678944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.679418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.699502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lazy-loading 'fault' on Instance uuid 9342d50b-dab3-4628-a53b-2dbe6afa8362 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:05:53.808447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df4649407d1840178a40fa26e75d6d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a532f7d64a4a6f876e1b2a26b7d687', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:53.824650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:53.836854 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0bec5f80-37c1-4665-8156-ba3955d0e093 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 200 len: 1326 microversion: 2.1 time: 0.287544 Oct 10 11:05:53.837969 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ed3652f-808a-47c2-bd98-976c8af159ba tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 0.534327 Oct 10 11:05:53.838754 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2465/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:53 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:53.840987 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2589/5054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:53 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 1326 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:53.844673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:53.849713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:53.863260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.864036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.864661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:53.865519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:53.866290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:53.866862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:54.194596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:54.210239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:54.218387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:54.224398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dec3131b-cad1-40df-bde2-c0db38a2dcae tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2582 microversion: 2.32 time: 0.383716 Oct 10 11:05:54.232112 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2466/5055] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:53 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2582 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:54.292964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:54.293597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:54.315577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:54.316084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:54.316527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:54.321884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:54.329325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:54.329800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:54.344985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "d4742c03-23a9-4fa4-9122-c52d2657aabe"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:54.372461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:54.372895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:54.373334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:54.428098 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] Creating event network-vif-unplugged:d4742c03-23a9-4fa4-9122-c52d2657aabe for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:54.441674 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-aa3ed91f-4c10-4866-be16-2dcc65e9cdd0 req-29b93f44-83e7-4e72-b932-7ab1d0742e59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100110 Oct 10 11:05:54.446728 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2467/5056] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:05:54.878315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:54.879046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:54.910884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:54.915659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:54.916160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:54.916911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:54.917384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:54.917815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:55.294932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:55.315969 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-365c2a66-fa4b-4312-b0a0-fe64bf73b46e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 1.029029 Oct 10 11:05:55.318874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2590/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:54 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:55.333116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:55.343655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:55.388976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:55.389493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:55.390164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:55.391791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:55.394100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:55.396286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:55.482104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 HTTP/1.1 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '9342d50b-dab3-4628-a53b-2dbe6afa8362'} Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:05:55.487220 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:05:55.492507 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:05:55.500381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:05:55.503030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac06e8da-b3b4-4712-b6bb-6e3566d98aae tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 404 len: 111 microversion: 2.1 time: 0.177047 Oct 10 11:05:55.522513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2591/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:55 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:05:55.535867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:55.536886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:55.549797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:55.552173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:55.553449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:55.555242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:55.555961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:55.556870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:55.850568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:55.865072 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80edca0b-2661-430b-813b-5a97c174b25a tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 0.988778 Oct 10 11:05:55.878008 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2468/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:54 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:05:55.894350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b917079-b445-475a-911e-f8e8cd72bf3e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '.version_select at 0x7f677cade1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:55.938722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b917079-b445-475a-911e-f8e8cd72bf3e tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43646544" status: 202 len: 0 microversion: 2.1 time: 0.059263 Oct 10 11:05:55.940196 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2469/5060] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 10 11:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43646544 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:05:55.952065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-deleted", "tag": "b305834f-1ac8-45ca-a45f-a0c20cb5d72b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:55.986229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:55.986747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:55.987219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:56.011234 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] Creating event network-vif-deleted:b305834f-1ac8-45ca-a45f-a0c20cb5d72b for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:56.021561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e989a461-fccf-4fe5-92ff-9cb40ff0d410 req-84c5f11f-a682-4c43-acfb-e54c4e666a0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079127 Oct 10 11:05:56.028433 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2470/5061] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:56.273266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:56.288423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:56.290919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:56.296560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94fd4252-44fe-4fdd-9c83-1de27c471abf tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2535 microversion: 2.32 time: 0.766043 Oct 10 11:05:56.300343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2592/5062] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:55 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2535 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:56.346889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:56.347763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:56.359712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:56.364033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:56.366166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:56.369338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:56.370641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:56.373141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:56.892439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:56.893083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:56.912265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:56.913001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:56.913474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:56.914851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:56.915357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:56.915792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:57.213479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:57.229379 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8607ef4b-0b49-4326-9de6-83f9a9bd7aae tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.890691 Oct 10 11:05:57.229990 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2471/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:56 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:57.337343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:57.337700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:57.349821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:57.350330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:57.350839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:57.357417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:57.358022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:57.358493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:57.384782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:57.400368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-279326dd-0d69-4baa-a422-631f754de017 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 0.512121 Oct 10 11:05:57.400915 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2593/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:56 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:57.719949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:57.731016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:57.734653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:57.739107 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c40c537e-ef6a-4dcf-a8d8-507e08192bbb tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2374 microversion: 2.32 time: 0.404687 Oct 10 11:05:57.741000 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2472/5065] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:57 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2374 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:57.850099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b128b8-f79c-41ce-9fd9-6736e1635c49", "name": "network-vif-plugged", "status": "completed", "tag": "c515c1f2-d522-498b-9644-089a36020684"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:57.883209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:57.883714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:57.884155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:57.934007 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] Creating event network-vif-plugged:c515c1f2-d522-498b-9644-089a36020684 for instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 on n-h2-860687-2 Oct 10 11:05:57.940099 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-644974a5-5133-481f-a88d-d30b0b50c8d2 req-f7c386ea-f773-4578-b3c3-c5814a37b8a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095109 Oct 10 11:05:57.941272 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2594/5066] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:58.140965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-deleted", "tag": "9b5d88be-0f1d-4984-b018-d971f0cb8488"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:05:58.156306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.156826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.157260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.184765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] Creating event network-vif-deleted:9b5d88be-0f1d-4984-b018-d971f0cb8488 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:05:58.200618 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-68a821ee-711b-4733-b47e-f97db73dec45 req-61a89bbb-ff79-4402-b33c-d2b87f08edab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 Oct 10 11:05:58.201902 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2473/5067] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:05:58.257132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:58.258478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:58.276034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.278188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.278651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.280835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.281318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.281755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.428149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:58.432561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:58.458471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.458958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.465158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.466062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.466493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.466943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.582788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:58.610348 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-198dea78-dcd1-4bf5-8efb-b0d1ce1155dd tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.358468 Oct 10 11:05:58.613800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2595/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:58 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:05:58.768941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:58.769729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:58.775681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:58.784016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.786287 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3310054c-1289-497d-ba0d-9d542c3c61f5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 0.362295 Oct 10 11:05:58.787224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.787791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:58.789529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:58.791560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:58.792355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2474/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:58 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:05:58.803806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:59.062201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:59.075145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:59.076924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:05:59.078477 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d414f854-6496-4dc4-8f02-69895dab253c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2260 microversion: 2.32 time: 0.314899 Oct 10 11:05:59.079590 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2596/5070] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:05:58 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:05:59.637154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:59.638034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:59.641229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:59.643163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:05:59.655579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:59.664326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:59.664960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:59.666123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:59.666644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:59.666992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:59.815933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:05:59.816669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:05:59.833375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:59.834071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:59.834670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:59.836461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:05:59.837097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:05:59.838690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:05:59.992637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:00.892821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:00.901138 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-739e7388-3edc-4b10-a0cf-8d5b502dab28 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 1.269166 Oct 10 11:06:00.916748 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2475/5071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:59 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:00.921850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:00.922481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:00.945669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:00.946170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:00.946614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:00.947357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:00.947824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:00.948250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:01.176803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:01.185172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3496ef72-734f-4518-b07d-67592a4ba550 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1313 microversion: 2.1 time: 1.372930 Oct 10 11:06:01.199404 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2597/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:05:59 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1313 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:01.207370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-deleted", "tag": "d4742c03-23a9-4fa4-9122-c52d2657aabe"}, {"name": "network-changed", "server_uuid": "20ba81e0-271d-416b-9787-33f1232e3dda", "tag": "1eaabd8e-768b-467a-be18-1012fb147427"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:01.227486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:01.228253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:01.228846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:01.244023 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Creating event network-vif-deleted:d4742c03-23a9-4fa4-9122-c52d2657aabe for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:06:01.244745 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] Creating event network-changed:1eaabd8e-768b-467a-be18-1012fb147427 for instance 20ba81e0-271d-416b-9787-33f1232e3dda on n-h1-860687-2 Oct 10 11:06:01.252336 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2ae1bc8b-fcaa-4134-a255-61908db983c4 req-4d7564cf-9fde-4a59-9e8a-060bcb293c16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051380 Oct 10 11:06:01.253445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2598/5073] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:01.919955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:01.930813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:01.931249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:01.946306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:01.949639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:01.951072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:01.951587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:01.952033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:01.964232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:01.964861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:01.965326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:01.988605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b991f5a-d3a3-4016-9ed9-8e710e154416 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 2213 microversion: 2.32 time: 1.078908 Oct 10 11:06:01.989215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2476/5074] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:00 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 2213 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:02.209764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:02.210673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:02.220873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.221445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.221897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.222640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.235233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.235867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.343907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:02.351917 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0904fc93-c263-446e-8403-241718d92edb tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.431480 Oct 10 11:06:02.352515 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2599/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:01 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:02.551362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:02.568971 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95053413-f72f-406d-a224-92443cb40fea tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1500 microversion: 2.1 time: 0.362159 Oct 10 11:06:02.570954 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2477/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:02 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1500 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:02.596629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:02.597252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:02.608471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.609314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.609930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.610801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.611439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.612601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.882830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:02.899537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d6a0266-ce94-4923-8b98-a4309898bfd3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1500 microversion: 2.1 time: 0.306638 Oct 10 11:06:02.911237 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2600/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:02 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1500 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:02.925812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:02.926349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:02.934150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.934647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.935118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.935830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:02.936298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:02.936726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:02.954787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:03.012115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lazy-loading 'flavor' on Instance uuid f0b128b8-f79c-41ce-9fd9-6736e1635c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:06:03.023730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:03.024815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:03.028872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:03.046205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.046708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.047183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.047906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.048365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.048792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.218745 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88deee59-4731-4783-83a6-816483da7222 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action" status: 202 len: 0 microversion: 2.1 time: 0.296698 Oct 10 11:06:03.220600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:03.238001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:03.239036 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2478/5078] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:06:02 2022] POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:06:03.253279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:03.255216 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c9a7549-f823-455e-ad89-bc4100938b71 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.236091 Oct 10 11:06:03.256501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2601/5079] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:03 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:03.282180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:03.284683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:03.303626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.305262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.307728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.308505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.309254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.311831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.387792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:03.389019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:03.404347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.405366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.406045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.406977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.407683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.419507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.756302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:03.765189 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-845130bb-ea96-4cfc-896f-2237232300a0 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1508 microversion: 2.1 time: 0.504474 Oct 10 11:06:03.785416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2479/5080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:03 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:03.795745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceabff7-652d-4d4a-96af-c68e22d87ab5", "name": "network-vif-deleted", "tag": "9103eba2-b909-4e1e-b25f-b6d0a9eb4b97"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:03.831297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:03.844316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:03.844939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29e3d127-06b6-40d9-a852-cc6ca6f23867 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.461050 Oct 10 11:06:03.860621 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2602/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:03 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:03.865353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:03.866071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:03.882020 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] Creating event network-vif-deleted:9103eba2-b909-4e1e-b25f-b6d0a9eb4b97 for instance bceabff7-652d-4d4a-96af-c68e22d87ab5 on n-h1-860687-2 Oct 10 11:06:03.892527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ada9d2d1-df4e-4dcd-8d14-65c4822096c7 req-828168ae-3e3d-453e-8341-045e9a8dc8da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105499 Oct 10 11:06:03.894420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2480/5082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:04.289486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:04.290095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:04.307580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.308110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.308556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:04.309290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.309744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.310173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:04.395682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:04.408115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:04.409715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:04.411441 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ff2f41d-f4c4-431d-9e3d-97559ceab18f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.127950 Oct 10 11:06:04.412528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2603/5083] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:04 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:04.794267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:04.795766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:04.817256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.818076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.818772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:04.820308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.821011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.823630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:04.872449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:04.873622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:04.888905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.899383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.900147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:04.901142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:04.901853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:04.902523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.251529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:05.265088 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25b76520-7387-40c9-9410-55859265a7cf tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1491 microversion: 2.1 time: 0.477217 Oct 10 11:06:05.266187 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2481/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:04 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1491 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:05.292573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:05.293119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:05.300988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:05.307586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:05.308933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.309483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.309962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.310677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.311185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.314939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9ade508-a8cd-4a09-ad44-57fd66d21fb5 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.446416 Oct 10 11:06:05.315744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.330389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2604/5085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:04 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:05.418780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8be25182-3e67-4c7b-94bf-dcedd93e59ef tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action" status: 202 len: 0 microversion: 2.1 time: 0.130108 Oct 10 11:06:05.447530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:05.455364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:05.466318 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2482/5086] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:06:05 2022] POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:06:05.482598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.487423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.488469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.489533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:05.490519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.492479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:05.496488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.498724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.501906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.528693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.529382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.530148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:05.530635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:05.531098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:05.926436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:05.939174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:05.948253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:05.949542 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f3da6f6-5cc2-4943-bc22-a79338a8f619 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.481853 Oct 10 11:06:05.950437 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2483/5087] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:05 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:06.089532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:06.101903 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1b3e507-ee7a-43bc-a2a3-8330c8f56ef7 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1497 microversion: 2.1 time: 0.674618 Oct 10 11:06:06.104402 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2605/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:05 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1497 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:06.365123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:06.365768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:06.388807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:06.389353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:06.389807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:06.390610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:06.395046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:06.397108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:06.557702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ba81e0-271d-416b-9787-33f1232e3dda", "name": "network-vif-plugged", "status": "completed", "tag": "1eaabd8e-768b-467a-be18-1012fb147427"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:06.582383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:06.583189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:06.583835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:06.623987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] Creating event network-vif-plugged:1eaabd8e-768b-467a-be18-1012fb147427 for instance 20ba81e0-271d-416b-9787-33f1232e3dda on n-h1-860687-2 Oct 10 11:06:06.633831 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d4636fb0-c008-48cc-ae80-f9462e1332c0 req-90ae2bf2-0d80-4245-817a-819876850386 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080228 Oct 10 11:06:06.646493 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2606/5089] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:06.840101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:06.849476 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49b45edd-cc92-4f63-b1c4-080e62646699 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.513993 Oct 10 11:06:06.850063 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2484/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:06 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:06.978035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:06.979324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:06.994236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:06.995168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:06.996013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:06.997051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:06.997786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:06.998450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:07.128066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:07.129554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:07.142551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:07.143764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:07.144346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:07.144958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:07.149089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:07.149869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:07.153633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:07.165991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:07.167797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:07.169311 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28d57ba4-ff78-46dd-ab17-60fa6b211a67 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.195868 Oct 10 11:06:07.170256 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2607/5091] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:06 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:07.481224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:07.492024 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc8990d4-b621-4d82-a7b7-1a332339819e tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1497 microversion: 2.1 time: 0.367630 Oct 10 11:06:07.493183 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2485/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:07 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1497 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:07.877205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:07.878464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:07.890347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:07.892067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:07.893263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:07.898736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:07.899619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:07.900327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.179646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:08.189662 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f95a61a-8b4f-4ccc-ab8b-e3cf4b8c9bbe tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1316 microversion: 2.1 time: 0.318520 Oct 10 11:06:08.193808 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2608/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:07 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:08.201158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:08.202352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:08.217850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.219208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.221150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.222104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.224054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.224662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.466219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:08.484247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:08.485923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:08.487372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6588d4a4-7ac9-4a5b-99d0-3d78e143d131 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.290709 Oct 10 11:06:08.488406 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2486/5094] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:08 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:08.520685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:08.521560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:08.537541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.539686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.542020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.543063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.543712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.545346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.854012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:08.864261 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f764e37c-a932-49ac-9a31-69354fb083be tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1500 microversion: 2.1 time: 0.347619 Oct 10 11:06:08.865139 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2609/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:08 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1500 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:08.888304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:08.889087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:08.895545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.896284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.896975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.898316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:08.899052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:08.899706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:08.923703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lazy-loading 'flavor' on Instance uuid f0b128b8-f79c-41ce-9fd9-6736e1635c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:06:09.014239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-775ab336-8641-468c-9636-97884a047d5b tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action" status: 202 len: 0 microversion: 2.1 time: 0.128095 Oct 10 11:06:09.015567 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2487/5096] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:06:08 2022] POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:06:09.028388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.031069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.045687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.048604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.049614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.050574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.051762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.052493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.221448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.222434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.235852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.236350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.236787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.237677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.238159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.238540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.504649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:09.525130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-796e5788-839d-4b50-919f-9719ba4774fe tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1508 microversion: 2.1 time: 0.502122 Oct 10 11:06:09.570156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:09.570930 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2610/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:09.583471 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b537dc6-9c3e-4b3f-b487-ee9404c38fb8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1506 microversion: 2.1 time: 0.366598 Oct 10 11:06:09.584664 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2488/5098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:09.597544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.598205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.616297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.617062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.617597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.618197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.619811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.622532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.624899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.625386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.631118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.632756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.633979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.636251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.638308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.639678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.707682 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6b97ed6-5117-4c43-91f9-c6e7915f5f5d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips" status: 200 len: 110 microversion: 2.1 time: 0.096512 Oct 10 11:06:09.709088 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2489/5099] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips => generated 110 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:09.732777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.737143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.749807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.751592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.758903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.760042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.760784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.761575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.789893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:09.810236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:09.812958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:09.817427 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f0be224-149b-4160-b135-636363545fc1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.245310 Oct 10 11:06:09.821926 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2611/5100] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:09.826835 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-012f6c57-d5cc-42e5-bd28-7ac5da59e76f tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips" status: 200 len: 110 microversion: 2.1 time: 0.097903 Oct 10 11:06:09.844960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2490/5101] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips => generated 110 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:09.856362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.857167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.863804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.869625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.870321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.871307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.873225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.873880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.915583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43e09139-0d7c-4291-87ca-10e67c2ad04d tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips/tempest-ServerAddressesTestJSON-1571181039-network" status: 200 len: 95 microversion: 2.1 time: 0.063030 Oct 10 11:06:09.917064 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2612/5102] 10.222.0.16 () {58 vars in 1401 bytes} [Mon Oct 10 11:06:09 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda/ips/tempest-ServerAddressesTestJSON-1571181039-network => generated 95 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:06:09.931327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:09.931844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:09.938316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.938808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.939271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.939965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:09.940419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:09.940895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:09.969304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:06:09.975306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:10.071531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc485005-25d8-4343-b238-c1b476a3129e tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "DELETE /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 204 len: 0 microversion: 2.1 time: 0.145753 Oct 10 11:06:10.075335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2491/5103] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:09 2022] DELETE /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:10.080363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:10.081498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:10.089850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.090547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.091185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.092045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.095465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.096111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.260029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:10.271303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34e4253f-35ef-4b15-9c93-a0c5ea0e8dfc tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1512 microversion: 2.1 time: 0.194538 Oct 10 11:06:10.272404 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2613/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:10 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:10.557251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:10.558671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:10.566135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.566926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.567626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.568588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.569272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.569967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.774297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:10.785134 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab22a9b3-284d-47c3-87ea-42554f669c51 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1491 microversion: 2.1 time: 0.231957 Oct 10 11:06:10.787695 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2492/5105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:10 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1491 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:10.812292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:10.813046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:10.819707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.821237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.821854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.822739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.823402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.824022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.848488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:10.849477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:10.861433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.862616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.870459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.871833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:10.872801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:10.873402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:10.979895 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-98be126f-20c6-4e3d-ab9c-c24732ad90d5 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action" status: 202 len: 0 microversion: 2.1 time: 0.171520 Oct 10 11:06:10.981455 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2614/5106] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:06:10 2022] POST /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:06:11.022110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:11.024998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:11.057317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:11.057892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:11.058418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:11.062870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:11.063421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:11.064312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:11.099903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:11.132886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:11.133804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:11.135158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1a2c7b6-2544-4496-8bce-99e7fef40a98 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.290463 Oct 10 11:06:11.146470 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2493/5107] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:10 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:11.299010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:11.299629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:11.311952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:11.312744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:11.313341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:11.314246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:11.316174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:11.316762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:11.683384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:11.693607 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-977ac65b-bc51-423d-bc51-e774185fde98 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1512 microversion: 2.1 time: 0.398417 Oct 10 11:06:11.694104 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2494/5108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:11 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:11.699382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:11.712866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bee35ecf-a079-42ca-8509-0bbb007b7af3 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1497 microversion: 2.1 time: 0.714401 Oct 10 11:06:11.715065 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2615/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:10 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1497 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:12.177386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:12.178117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:12.186039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.187225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.187959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:12.188917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.189599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.190243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:12.318140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:12.341200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:12.349060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:12.352606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-131a2890-fb8a-4d64-91bf-2709d694121c tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.178949 Oct 10 11:06:12.355547 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2495/5110] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:12 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:12.720565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:12.721188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:12.739050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:12.740557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:12.741324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.742494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.743148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:12.758024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.758534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.759355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:12.777295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:12.784308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.787872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.807047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:12.815148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:12.815994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:12.825042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:13.015069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60f8e79980c41c0b4ea63dd593eb6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72470c909c344de98e6b4bfe997b2db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:13.025593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4813b03e-7128-4d53-ae33-87ccfe1868ad tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 200 len: 1470 microversion: 2.1 time: 0.308780 Oct 10 11:06:13.031508 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2616/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:12 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:13.041294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ba81e0-271d-416b-9787-33f1232e3dda", "name": "network-vif-deleted", "tag": "1eaabd8e-768b-467a-be18-1012fb147427"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:13.069839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:13.070410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:13.070918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:13.104230 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] Creating event network-vif-deleted:1eaabd8e-768b-467a-be18-1012fb147427 for instance 20ba81e0-271d-416b-9787-33f1232e3dda on n-h1-860687-2 Oct 10 11:06:13.109902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bd253e67-2287-4698-88e0-d85f40023393 req-57b83a8e-88c4-4155-97de-36f7ccb74ac5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076890 Oct 10 11:06:13.110973 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2617/5112] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:13.214359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:13.223728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc3abf1d-e4da-40b9-8680-7c848381c599 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1497 microversion: 2.1 time: 0.489325 Oct 10 11:06:13.224350 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2496/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:12 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1497 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:06:13.381656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:13.383508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:13.405107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:13.406110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:13.406841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:13.407811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:13.408478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:13.409160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:13.532658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:13.547293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:13.549810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:13.551441 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b2b7d4d4-886a-4523-b536-93291a36ed1b tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.174613 Oct 10 11:06:13.553076 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2618/5114] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:13 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:14.069757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:14.071361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] [instance: 20ba81e0-271d-416b-9787-33f1232e3dda] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:14.079552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.080626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.081248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.082139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.082768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.084992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.102864 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] HTTP exception thrown: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Request method failure captured: Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda HTTP/1.1 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_yIFVZdrWsWp3cYgpda4H4C39oidQHSP0ckpGlFsHXN3JvFt4Sg2en_FqLbFV5BR0Az2RW09ePLDs5F37U-uRNpfX2Sw8a2DrW2T05wB7PMQW_qev8JT6yzGmv2_GrPVSK2wCsjB6wFCsYNg34ZzuLlHIiU3-rzLayKH3h7mrbnDrM Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: d72470c909c344de98e6b4bfe997b2db Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerAddressesTestJSON-461223854 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d72470c909c344de98e6b4bfe997b2db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d72470c909c344de98e6b4bfe997b2db", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d72470c909c344de98e6b4bfe997b2db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d72470c909c344de98e6b4bfe997b2db"}]}] Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerAddressesTestJSON-461223854 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: d72470c909c344de98e6b4bfe997b2db Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerAddressesTestJSON-461223854 Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerAddressesTestJSON-461223854-project Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: b60f8e79980c41c0b4ea63dd593eb6dd Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerAddressesTestJSON-461223854-project Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '20ba81e0-271d-416b-9787-33f1232e3dda'} Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:14.105492 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. Oct 10 11:06:14.109822 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:14.111326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] Returning 404 to user: Instance 20ba81e0-271d-416b-9787-33f1232e3dda could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:14.112542 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62e18a2a-b41c-4145-8ee2-2c394f0027d8 tempest-ServerAddressesTestJSON-461223854 tempest-ServerAddressesTestJSON-461223854-project] 10.222.0.16 "GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda" status: 404 len: 111 microversion: 2.1 time: 0.047060 Oct 10 11:06:14.113615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2497/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:14 2022] GET /compute/v2.1/servers/20ba81e0-271d-416b-9787-33f1232e3dda => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:14.250570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:14.252141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:14.265178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.265684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.266137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.266828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.267992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.271900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.512721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:14.521561 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c956037-863a-4949-8a04-60da020aa918 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1500 microversion: 2.1 time: 0.275750 Oct 10 11:06:14.524805 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2619/5116] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:14 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1500 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:14.552875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:14.552875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:14.563354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.565575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.571639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.572761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.573083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.573531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.583824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:14.584462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:14.594330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.597337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.597795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.598543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.599006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.599453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.631152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:06:14.770180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:14.786566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:14.791435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:14.793919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a57bff21-e2f6-4362-925f-21d196b6ea01 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.216791 Oct 10 11:06:14.796358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2620/5117] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:14 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:14.862922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-560f556f-8707-4e5c-a89e-a85c18f5c044 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 204 len: 0 microversion: 2.1 time: 0.318359 Oct 10 11:06:14.863834 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2498/5118] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:14 2022] DELETE /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:14.872454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:14.881208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:14.894451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.903731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.909955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:14.911050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:14.911753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:14.912421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:15.158138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:15.167772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6355dfaa-4a3a-4691-bf30-37d46ccc0e06 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1506 microversion: 2.1 time: 0.299534 Oct 10 11:06:15.174580 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2621/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:14 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:15.823489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:15.825151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:15.848930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:15.849698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:15.852471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:15.855077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:15.855812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:15.857331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:16.077963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:16.103816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:16.106616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:16.110140 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cef5cf2-8c5f-456e-b726-8979a4fe7fe9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.291883 Oct 10 11:06:16.113025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2499/5120] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:15 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:16.201885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:16.203126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:16.214459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:16.218466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:16.219136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:16.220024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:16.220645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:16.221234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:16.269638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:16.503339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:16.512567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7aa6bdc9-5cda-4781-9654-d56d6b6c1814 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1506 microversion: 2.1 time: 0.315245 Oct 10 11:06:16.513837 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2622/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:16 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:17.138726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:17.139493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:17.158145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:17.161619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:17.169289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:17.171333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:17.177209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:17.177794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:17.398654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:17.414622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:17.418221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:17.420986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51009176-1c0a-40dd-a6bd-0c0242a8deec tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.286660 Oct 10 11:06:17.436050 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2500/5122] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:17 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:17.542975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:17.544205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:17.564206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:17.564864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:17.570762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:17.571576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:17.572061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:17.572501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:18.363304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b128b8-f79c-41ce-9fd9-6736e1635c49", "name": "network-vif-deleted", "tag": "c515c1f2-d522-498b-9644-089a36020684"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:18.411558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:18.413803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:18.415889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:18.483558 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] Creating event network-vif-deleted:c515c1f2-d522-498b-9644-089a36020684 for instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 on n-h2-860687-2 Oct 10 11:06:18.528592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc16e439f2d49e1b2771eed8155aea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b4766cf07a4e278a9bcaa2190b36c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:18.541362 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72158c8d-efee-4c10-bca5-cacd317897e8 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 200 len: 1464 microversion: 2.1 time: 0.999262 Oct 10 11:06:18.558109 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2623/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:17 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 1464 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:18.558742 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-04dcc2f3-3f5e-4fff-81ed-2d994af47df8 req-9828b3d1-91e0-426b-b9bc-5f098980a2f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203055 Oct 10 11:06:18.561766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:18.562494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:18.574248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:18.574543 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2501/5124] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:18.575383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:18.576264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:18.577125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:18.577720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:18.578346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:18.784873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:18.811155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:18.814329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:18.817871 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f79e03c-1b02-4ecc-b51f-f3ddbe49e8f9 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.264242 Oct 10 11:06:18.820877 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2624/5125] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:18 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:19.473577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:19.474847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:19.494501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.495034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.495475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.496192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.496732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.497163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.548215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 HTTP/1.1 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9342d50b-dab3-4628-a53b-2dbe6afa8362'} Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:19.564142 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.568634 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.572922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:19.573359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:19.573748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] [instance: f0b128b8-f79c-41ce-9fd9-6736e1635c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:19.574245 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2074d407-57c9-4ae3-b737-393e7003adb4 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 404 len: 111 microversion: 2.1 time: 0.104947 Oct 10 11:06:19.574836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2502/5126] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:19 2022] DELETE /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:19.593932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.594439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.594891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.595501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:19.595635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.596103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.596240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 9342d50b-dab3-4628-a53b-2dbe6afa8362] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:19.596539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.614455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.614956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.615426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.616694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.617160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.617587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.628726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] HTTP exception thrown: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Request method failure captured: Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 HTTP/1.1 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_x_q78-rW4r43B6Ax74yQ7xVmGjEMlieknN7kBFkLyDzs9Q6cEfRYA1lFC7o0_OYTQ9naZYHD4bXtsp7BAX0eHfg8Hun4PBUC7udcCjCCoUVAKugOBcvT1g94PW5o3x0dbJWpamb9Wr_5gt6EhqOiqS8HK7SbYi4OfeADHfHQiCiw4 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: a1b4766cf07a4e278a9bcaa2190b36c5 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestServerAdvancedOps-695093158 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1b4766cf07a4e278a9bcaa2190b36c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a1b4766cf07a4e278a9bcaa2190b36c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a1b4766cf07a4e278a9bcaa2190b36c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a1b4766cf07a4e278a9bcaa2190b36c5"}]}] Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestServerAdvancedOps-695093158 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: a1b4766cf07a4e278a9bcaa2190b36c5 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestServerAdvancedOps-695093158 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestServerAdvancedOps-695093158-project Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4bc16e439f2d49e1b2771eed8155aea8 Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestServerAdvancedOps-695093158-project Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'f0b128b8-f79c-41ce-9fd9-6736e1635c49'} Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.630645 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. Oct 10 11:06:19.634751 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.639017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] Returning 404 to user: Instance f0b128b8-f79c-41ce-9fd9-6736e1635c49 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:19.644102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d340d6a-7dad-4dd2-af94-1686e95dcf68 tempest-TestServerAdvancedOps-695093158 tempest-TestServerAdvancedOps-695093158-project] 10.222.0.16 "GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49" status: 404 len: 111 microversion: 2.1 time: 0.080204 Oct 10 11:06:19.645300 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2625/5127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:19 2022] GET /compute/v2.1/servers/f0b128b8-f79c-41ce-9fd9-6736e1635c49 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:19.660512 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 HTTP/1.1 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9342d50b-dab3-4628-a53b-2dbe6afa8362'} Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:19.662512 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:19.667323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 9342d50b-dab3-4628-a53b-2dbe6afa8362 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:19.668450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22ca85ea-0089-46e0-8545-40acad37ca20 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362" status: 404 len: 111 microversion: 2.1 time: 0.086601 Oct 10 11:06:19.672751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2503/5128] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:19 2022] GET /compute/v2.1/servers/9342d50b-dab3-4628-a53b-2dbe6afa8362 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:19.848217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:19.849316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:19.872436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.876221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.879852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:19.880959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:19.884570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:19.885350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:20.065657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:20.081375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:20.093040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:20.094675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-422b3053-3b4a-4d8d-89bf-16e2f2e6f98f tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.250833 Oct 10 11:06:20.095546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2626/5129] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:19 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:21.124375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:21.125194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:21.139215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:21.141203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:21.141789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:21.143648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:21.145983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:21.146556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:21.415953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:21.426686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:21.448958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:21.450224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2067ca28-9f8c-4bca-a93c-f6a24fdf2752 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.330798 Oct 10 11:06:21.450797 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2504/5130] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:21 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:22.482264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:22.483898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:22.494603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:22.499786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:22.500499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:22.504657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:22.505032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:22.505481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:22.609247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:22.627789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:22.630643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:22.637641 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-871d835d-60d1-43fe-a862-99fed2a8dab5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.160356 Oct 10 11:06:22.640877 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2627/5131] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:22 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:23.666391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:23.667195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:23.682666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:23.683196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:23.683646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:23.684369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:23.688004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:23.688736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:23.804026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:23.814020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:23.815607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:23.817143 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffef2168-10fa-4a6f-bdb4-65859f51df16 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.155281 Oct 10 11:06:23.818259 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2505/5132] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:23 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:24.847078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:24.847899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:24.879274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:24.879718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:24.880181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:24.880924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:24.881489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:24.882433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:25.040976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:25.058584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:25.062396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:25.067315 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-881e08a7-e2b2-42b1-8353-31053edfa89a tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.224607 Oct 10 11:06:25.070556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2628/5133] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:24 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:26.097655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:26.098310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:26.111570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:26.112139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:26.112594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:26.114934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:26.115473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:26.116001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:26.297625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:26.316437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:26.317932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:26.322611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd456b61-97fe-4bc5-84cf-a7a8ed7f0c31 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.230712 Oct 10 11:06:26.327786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2506/5134] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:26 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:27.358699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:27.359492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:27.373243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:27.375462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:27.376027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:27.377328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:27.379931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:27.380607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:27.533436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:27.561806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:27.567516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:27.571935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-febd42a7-57c9-439f-8609-50852c5cbdf5 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.219684 Oct 10 11:06:27.574484 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2629/5135] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:27 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:28.601891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:28.602526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:28.618814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:28.619392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:28.619843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:28.620689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:28.621184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:28.621621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:28.802239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:28.805610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:28.837545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:28.840842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:28.845068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9955fa03-c4b2-4847-ab77-3c4ecacbbbc2 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.247313 Oct 10 11:06:28.853843 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2507/5136] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:28 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:29.892549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:29.893966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:29.909320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:29.910216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:29.910888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:29.913711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:29.916537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:29.917342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:30.181987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:30.192076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:30.198015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:30.202942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ef0ac3e1-e499-4381-9f65-ab79985ee1fc tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.327603 Oct 10 11:06:30.205410 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2630/5137] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:29 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:31.233869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:31.235556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:31.256556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:31.259917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:31.261866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:31.263548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:31.264470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:31.266535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:31.427139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:31.450690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:31.464061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:31.471676 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8656bf9-8711-42c7-9de1-597b82682082 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.237657 Oct 10 11:06:31.475472 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2508/5138] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:31 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:32.503902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:32.504531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:32.516663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:32.527811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:32.528563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:32.529482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:32.530104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:32.530697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:32.705140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:32.721364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:32.723558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:32.727377 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9e85c85-fa90-4e3c-9bd5-f2f4fbcac6b1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1605 microversion: 2.32 time: 0.227254 Oct 10 11:06:32.728981 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2631/5139] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:32 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1605 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:33.765357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:33.766200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:33.785822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:33.790693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:33.791282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:33.799055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:33.799551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:33.799994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:33.918634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:33.919164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:33.919692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:33.920054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lazy-loading 'fault' on Instance uuid bceabff7-652d-4d4a-96af-c68e22d87ab5 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:06:34.009223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:34.019159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:34.021150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea123efcf86e4f57a9e7f760285a3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc27860ae3a4763a82a0ec70e493ff6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:34.023422 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae523343-bc26-4409-af83-20d672b784c0 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 200 len: 1610 microversion: 2.32 time: 0.265323 Oct 10 11:06:34.024976 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2509/5140] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:33 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 1610 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:06:34.542785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: .version_select at 0x7f67775e0d30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1939683909", "policies": ["affinity"]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:34.565256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=61 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:34.590725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:34.599398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:34.732199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:34.742688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:34.787628 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3159f90-8b34-4698-b19e-a43b3e13f546 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.825366 Oct 10 11:06:34.790522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2632/5141] 10.222.0.16 () {60 vars in 1174 bytes} [Mon Oct 10 11:06:33 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:34.807271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: .version_select at 0x7f677cf0ef70>, body: {"server_group": {"name": "tempest-server-group-7311392", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:34.839376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:34.852806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:34.951866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:35.009212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:35.052066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2581663b-8ae3-4408-82a9-2b7926b6c68f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 161 microversion: 2.1 time: 0.254766 Oct 10 11:06:35.054561 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2510/5142] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 11:06:34 2022] POST /compute/v2.1/os-server-groups => generated 161 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:35.062383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.063360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:35.066519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: .version_select at 0x7f677d07ee50>, body: {"server_group": {"name": "tempest-server-group-7311392", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:35.090599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:35.107276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:35.107883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:35.108658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:35.109140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:35.109570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:35.117560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:35.144227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:35.176159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] HTTP exception thrown: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Request method failure captured: Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 HTTP/1.1 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_sY98T77XC3Nu7KaMYKD0LgWW1jYtoYLAorPWPT23v6ad65_pcQy4yTNfwe8cNEKr1UnyzINOjzjhqOB2G0DdOL0_SCaNMUxG7rtsqshEBe90BbVqSpEqkgM6kUa0SoqKqXhJSTGdGBZZTD0bQgR9t_8V-ShgGwgtc7o60WxmdRD_w Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0dc27860ae3a4763a82a0ec70e493ff6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0dc27860ae3a4763a82a0ec70e493ff6"}]}] Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea123efcf86e4f57a9e7f760285a3621 Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'bceabff7-652d-4d4a-96af-c68e22d87ab5'} Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:35.178786 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:35.182925 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:35.187649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Returning 404 to user: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:35.204855 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6216fc1c-bf0d-4227-8136-9ef5ffb7a2d1 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 404 len: 111 microversion: 2.32 time: 0.137672 Oct 10 11:06:35.205886 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2633/5143] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:35 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 11:06:35.225752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-20fc91f8-9c59-4c95-950c-fa17c534ba74 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '.version_select at 0x7f677c92a5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.265810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:35.278862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:35.294110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-20fc91f8-9c59-4c95-950c-fa17c534ba74 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173423335" status: 204 len: 0 microversion: 2.32 time: 0.075836 Oct 10 11:06:35.299228 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2634/5144] 10.222.0.16 () {60 vars in 1262 bytes} [Mon Oct 10 11:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173423335 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 11:06:35.315640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-440e982c-386c-4959-94f2-c550f75190e6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 161 microversion: 2.1 time: 0.253704 Oct 10 11:06:35.318290 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2511/5145] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 11:06:35 2022] POST /compute/v2.1/os-server-groups => generated 161 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:35.330937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb64b96b-1313-48e0-85b5-c7c00c8fd3b2 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.411812 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb64b96b-1313-48e0-85b5-c7c00c8fd3b2 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/07137297-7cb4-4625-9ac3-f1fd7925b738" status: 204 len: 0 microversion: 2.1 time: 0.086759 Oct 10 11:06:35.415721 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2635/5146] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:35 2022] DELETE /compute/v2.1/os-server-groups/07137297-7cb4-4625-9ac3-f1fd7925b738 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:35.424218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97335d2b-487e-459a-98a4-b89d4483f6b8 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.459995 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97335d2b-487e-459a-98a4-b89d4483f6b8 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.039277 Oct 10 11:06:35.463328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2512/5147] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:06:35 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:35.473588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34963934-4b1f-41a8-84cd-567c188c93f0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.547297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34963934-4b1f-41a8-84cd-567c188c93f0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/30df068b-17e7-4c5d-a0bd-9ad349003037" status: 204 len: 0 microversion: 2.1 time: 0.077576 Oct 10 11:06:35.549205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2636/5148] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:35 2022] DELETE /compute/v2.1/os-server-groups/30df068b-17e7-4c5d-a0bd-9ad349003037 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:35.558764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5f578a2-a585-4100-a50e-5cfe8a1ac670 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.586214 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5f578a2-a585-4100-a50e-5cfe8a1ac670 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031937 Oct 10 11:06:35.593839 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2513/5149] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:06:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:35.619540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: .version_select at 0x7f677779da60>, body: {"server_group": {"name": "tempest-server-group-657485850", "policies": ["affinity"]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:35.647105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:35.653937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:35.762035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:35.773640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:35.792579 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96354123-80d6-41db-a6b2-3d45beb838ab tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.186361 Oct 10 11:06:35.799829 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2637/5150] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 11:06:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:35.815254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0c71842-d1bf-4dbd-8d65-6c9d47a7797f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.887397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:35.905066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0c71842-d1bf-4dbd-8d65-6c9d47a7797f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/bd19ba99-cc71-4783-ab79-ec16443dd2a2" status: 204 len: 0 microversion: 2.1 time: 0.101730 Oct 10 11:06:35.909115 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2514/5151] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:35 2022] DELETE /compute/v2.1/os-server-groups/bd19ba99-cc71-4783-ab79-ec16443dd2a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:35.916405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-675c2fb6-f790-4b7d-aef6-ee6a41aeb8c6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:35.940139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-675c2fb6-f790-4b7d-aef6-ee6a41aeb8c6 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.029902 Oct 10 11:06:35.949452 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2638/5152] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:06:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:35.954869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: .version_select at 0x7f677ca290d0>, body: {"server_group": {"name": "tempest-server-group-1138902786", "policies": ["anti-affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:35.998825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:36.019058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:36.120594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:36.136627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:36.172310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73d44212-0b14-4931-b442-8bbce795c35e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.218092 Oct 10 11:06:36.179734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2515/5153] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 11:06:35 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:36.186636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc82efe3-607c-4e83-8ea5-c1a86674d25e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:36.228592 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc82efe3-607c-4e83-8ea5-c1a86674d25e tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/b79167cf-6b66-46cc-9213-d55dd53aca82" status: 204 len: 0 microversion: 2.1 time: 0.046207 Oct 10 11:06:36.234244 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2639/5154] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:36 2022] DELETE /compute/v2.1/os-server-groups/b79167cf-6b66-46cc-9213-d55dd53aca82 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:06:36.240796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ec867cd-1396-409a-8351-0b0192de0e18 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:36.257939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ec867cd-1396-409a-8351-0b0192de0e18 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022536 Oct 10 11:06:36.259136 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2516/5155] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:06:36 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:36.471637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-409530859", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "f33a2b4b-6e35-4370-ac02-4ee7beeed4de"}]}, "os:scheduler_hints": {"group": "5edecc78-f982-4fa4-a81f-ae72be3c8a99"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:36.889649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] validate_networks() for [('f33a2b4b-6e35-4370-ac02-4ee7beeed4de', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:06:37.859875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:06:37.860557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:06:37.861194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:06:37.861765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:06:37.862548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:06:37.908486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:37.914453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:37.915265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:37.916290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:37.916952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:37.917578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:37.956324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:37.973868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:38.006322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:06:38.026653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:06:38.077124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:38.184227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:38.196203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:38.284413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:06:38.297185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Getting quotas for user 10e6ae819436436fb32f6189e6da1d38 and project 7d9d48e8e4ed468e897e1fbc5f4eae5d. Resources: {'server_group_members'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:06:38.377734 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e25b34b5-fc11-4d12-8206-ddf58deb5171 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911728 Oct 10 11:06:38.392687 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2640/5156] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:06:38.404382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-299c19e2-1b45-4dfb-a123-01f85b8ec3e5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:38.404996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-299c19e2-1b45-4dfb-a123-01f85b8ec3e5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:38.592005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-299c19e2-1b45-4dfb-a123-01f85b8ec3e5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:38.604350 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-299c19e2-1b45-4dfb-a123-01f85b8ec3e5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1212 microversion: 2.1 time: 0.204855 Oct 10 11:06:38.619070 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2517/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:38 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1212 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:39.635731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:39.639748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:39.753789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:39.760651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:39.762402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:39.764392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:39.766544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:39.768591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:40.275081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:40.275818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:40.328501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:40.332506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:40.340531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:40.344587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:40.365252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:40.370415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:40.484296 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 HTTP/1.1 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1bc02db9-8522-4c05-a7d5-b215863e5054'} Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:40.498185 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:40.502575 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d330c5c-95ab-4f48-bbe2-76a96d9e7016 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 404 len: 111 microversion: 2.1 time: 0.235368 Oct 10 11:06:40.504140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2518/5158] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:40 2022] DELETE /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:06:40.518815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:40.522444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] [instance: 1bc02db9-8522-4c05-a7d5-b215863e5054] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:40.543654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:40.544071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:40.546083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:40.546829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:40.547328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:40.551518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:40.562769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:40.572454 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-312a102c-18d1-4971-928b-e96ae15e6a1b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1216 microversion: 2.1 time: 0.944043 Oct 10 11:06:40.575250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2641/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:39 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1216 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:40.604288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] HTTP exception thrown: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Request method failure captured: Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 HTTP/1.1 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sXKlrt2qq0pSHNVCakoUjcdHpMZhzkP1qajt_x7pPK7AQXTd_bfpaJdgPVUlB6jLXpSUk-Rv8UazelGO5snSaIw6BNU5lNfy_1g-KH8Ge_JC9378HLkkb9I0WAixUQLJ9hKd9f9ehtP7AfgtYKGSzkovQEUM1nktVnnhTJ4Tv6Glo Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9a532f7d64a4a6f876e1b2a26b7d687", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9a532f7d64a4a6f876e1b2a26b7d687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9a532f7d64a4a6f876e1b2a26b7d687"}]}] Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f9a532f7d64a4a6f876e1b2a26b7d687 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1946684147 Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: df4649407d1840178a40fa26e75d6d9a Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1946684147-project Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '1bc02db9-8522-4c05-a7d5-b215863e5054'} Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:40.609908 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] Returning 404 to user: Instance 1bc02db9-8522-4c05-a7d5-b215863e5054 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-981a7ef3-5ddc-4f18-a4b9-4a799dec7cb8 tempest-AttachVolumeTestJSON-1946684147 tempest-AttachVolumeTestJSON-1946684147-project] 10.222.0.16 "GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054" status: 404 len: 111 microversion: 2.1 time: 0.100337 Oct 10 11:06:40.613736 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2519/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:40 2022] GET /compute/v2.1/servers/1bc02db9-8522-4c05-a7d5-b215863e5054 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:41.610656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:41.611399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:41.646916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:41.650219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:41.652194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:41.657285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:41.657944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:41.659217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:41.816357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:41.852938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19b8da5b-e16a-46a2-8d36-f0edc27a9187 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1282 microversion: 2.1 time: 0.251955 Oct 10 11:06:41.853898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2642/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:41 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:42.877751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:42.878466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:42.889112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:42.900232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:42.901345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:42.902109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:42.902675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:42.903343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:43.038785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:43.051195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cfcda44-86b5-4138-b4f5-778254ffd93c tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1270 microversion: 2.1 time: 0.176296 Oct 10 11:06:43.067514 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2520/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:42 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:44.077155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:44.077907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:44.085186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.086223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.086876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.087848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.088683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.089356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.201014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:44.209702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-629e5764-0a34-4cd9-b51e-42861c1d061f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1270 microversion: 2.1 time: 0.136337 Oct 10 11:06:44.228643 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2643/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:44 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:44.577729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:44.580215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:44.598775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.600634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.601073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.604525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.605198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.606423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.641253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] HTTP exception thrown: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Request method failure captured: Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 HTTP/1.1 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_sY98T77XC3Nu7KaMYKD0LgWW1jYtoYLAorPWPT23v6ad65_pcQy4yTNfwe8cNEKr1UnyzINOjzjhqOB2G0DdOL0_SCaNMUxG7rtsqshEBe90BbVqSpEqkgM6kUa0SoqKqXhJSTGdGBZZTD0bQgR9t_8V-ShgGwgtc7o60WxmdRD_w Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0dc27860ae3a4763a82a0ec70e493ff6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0dc27860ae3a4763a82a0ec70e493ff6"}]}] Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ea123efcf86e4f57a9e7f760285a3621 Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'bceabff7-652d-4d4a-96af-c68e22d87ab5'} Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:44.645369 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.651500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.655378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Returning 404 to user: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:44.657134 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60dc71ff-82e5-43f0-9f81-daf26b565464 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 404 len: 111 microversion: 2.32 time: 0.091795 Oct 10 11:06:44.657721 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2521/5164] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:06:44 2022] DELETE /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:06:44.666785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:44.667870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] [instance: bceabff7-652d-4d4a-96af-c68e22d87ab5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:44.675779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.681469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.681966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.682894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:44.685796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:44.686345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:44.743579 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] HTTP exception thrown: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Request method failure captured: Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 HTTP/1.1 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_sY98T77XC3Nu7KaMYKD0LgWW1jYtoYLAorPWPT23v6ad65_pcQy4yTNfwe8cNEKr1UnyzINOjzjhqOB2G0DdOL0_SCaNMUxG7rtsqshEBe90BbVqSpEqkgM6kUa0SoqKqXhJSTGdGBZZTD0bQgR9t_8V-ShgGwgtc7o60WxmdRD_w Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0dc27860ae3a4763a82a0ec70e493ff6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0dc27860ae3a4763a82a0ec70e493ff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0dc27860ae3a4763a82a0ec70e493ff6"}]}] Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0dc27860ae3a4763a82a0ec70e493ff6 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TaggedBootDevicesTest-757401390 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ea123efcf86e4f57a9e7f760285a3621 Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TaggedBootDevicesTest-757401390-project Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'bceabff7-652d-4d4a-96af-c68e22d87ab5'} Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:44.745173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] Returning 404 to user: Instance bceabff7-652d-4d4a-96af-c68e22d87ab5 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:44.749093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89b4b2d4-c21c-4146-b6cf-097e9c276b84 tempest-TaggedBootDevicesTest-757401390 tempest-TaggedBootDevicesTest-757401390-project] 10.222.0.16 "GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5" status: 404 len: 111 microversion: 2.32 time: 0.084435 Oct 10 11:06:44.750405 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2644/5165] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:06:44 2022] GET /compute/v2.1/servers/bceabff7-652d-4d4a-96af-c68e22d87ab5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:06:45.233124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:45.233741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:45.244431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:45.258035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:45.258748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:45.260936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:45.261701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:45.263181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:45.695798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:45.705821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0da44ad2-d324-4fd4-aae5-d673cbb164de tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.476309 Oct 10 11:06:45.724352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2522/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:45 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:46.738272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:46.738906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:46.749456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:46.756631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:46.757429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:46.758347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:46.758965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:46.759609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:47.043452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:47.052504 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1301b726-21cd-4459-9113-e2874f78a2db tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.318517 Oct 10 11:06:47.074535 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2523/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:46 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:47.325462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7faf21c-5778-458a-a4f8-e74063dfe262", "tag": "4163bcd6-5362-4a89-b9ed-ab3a073cb444"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:47.378718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:47.379398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:47.379872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:47.394196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=79 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:47.446906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] Creating event network-changed:4163bcd6-5362-4a89-b9ed-ab3a073cb444 for instance a7faf21c-5778-458a-a4f8-e74063dfe262 on n-h2-860687-2 Oct 10 11:06:47.466255 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-003566ee-9bb1-4a85-b3db-872e169a6d41 req-1dc48e5e-b376-4a4e-bfbf-6f79dce75768 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.842574 Oct 10 11:06:47.473388 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2645/5168] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:48.080628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:48.081910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:48.098562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:48.099082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:48.099797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:48.103223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:48.103223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:48.103223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:48.485947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:48.499325 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80535708-0f98-4f83-9085-c8e5915b1a38 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.422425 Oct 10 11:06:48.500098 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2524/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:48 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:49.528470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:49.530656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:49.543808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:49.545187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=30 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:49.560600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:49.561312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:49.567283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:49.568297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:49.568943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:49.569542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:49.957428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:49.967430 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d39f43dc-789d-484d-98a6-947b4401ebad tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.446931 Oct 10 11:06:49.968021 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2646/5170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:49 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:50.990966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:50.991731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:50.993754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=26 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:06:51.016854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:51.017509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:51.018053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:51.025668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:51.026269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:51.026820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:51.517680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:51.533643 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0997582-b609-4eb8-aabb-3c86d88d8752 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.546398 Oct 10 11:06:51.534513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2525/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:50 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:52.161436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7faf21c-5778-458a-a4f8-e74063dfe262", "name": "network-vif-plugged", "status": "completed", "tag": "4163bcd6-5362-4a89-b9ed-ab3a073cb444"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:52.186226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:52.188781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:52.189265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:52.223699 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] Creating event network-vif-plugged:4163bcd6-5362-4a89-b9ed-ab3a073cb444 for instance a7faf21c-5778-458a-a4f8-e74063dfe262 on n-h2-860687-2 Oct 10 11:06:52.242198 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-166aa098-ff51-49c7-96e7-ce0532a7dd75 req-892ba7bc-dede-4cb2-b423-977659740b0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085479 Oct 10 11:06:52.243812 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2647/5172] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:52.563621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:52.564871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:52.577785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:52.578522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:52.578918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:52.579664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:52.580135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:52.580567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:52.965240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:52.987833 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c924cfe1-88a1-4a6a-a2c6-794dc5bbc1e1 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1312 microversion: 2.1 time: 0.428223 Oct 10 11:06:52.991084 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2526/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:52 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:54.011679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:54.012393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:54.021461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.022114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.022593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.035697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.036478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.037387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.347725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:54.361927 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf151024-3f8b-42d8-80fa-8a629f60e15b tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1497 microversion: 2.1 time: 0.355159 Oct 10 11:06:54.362748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2648/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:54 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1497 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:54.387995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:54.406653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_groups [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Querying cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) for 1 instances {{(pid=128801) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 11:06:54.407696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.408346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.408965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.426578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11e2b584-e2ab-48c7-b230-95d7b7212e51 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99" status: 200 len: 222 microversion: 2.1 time: 0.042352 Oct 10 11:06:54.428699 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2527/5175] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 11:06:54 2022] GET /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99 => generated 222 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:54.438942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:54.439748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:54.455465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.456261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.456866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.457749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.458954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.459573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.487592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:06:54.603469 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ae2d005-a625-4412-8b07-77d532f03e73 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 204 len: 0 microversion: 2.1 time: 0.167935 Oct 10 11:06:54.606549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2649/5176] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:54 2022] DELETE /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:06:54.616553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:54.617393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:54.627586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.628077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.628508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.629237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:54.629701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:54.630166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:54.871624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:54.885913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a8039dd-b07d-4212-8f43-a6f71400e177 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1503 microversion: 2.1 time: 0.274923 Oct 10 11:06:54.886853 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2528/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:54 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:55.914899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:55.916432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:55.947870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:55.947870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:55.957885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:55.960996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:55.961507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:55.964064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:56.437682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:56.456554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-25a513f2-2f00-428d-a3fc-4f32d21bc566 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1503 microversion: 2.1 time: 0.538495 Oct 10 11:06:56.474772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2650/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:55 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1503 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:57.236436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7faf21c-5778-458a-a4f8-e74063dfe262", "name": "network-vif-deleted", "tag": "4163bcd6-5362-4a89-b9ed-ab3a073cb444"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:06:57.281219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:57.282018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:57.284332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:57.342822 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] Creating event network-vif-deleted:4163bcd6-5362-4a89-b9ed-ab3a073cb444 for instance a7faf21c-5778-458a-a4f8-e74063dfe262 on n-h2-860687-2 Oct 10 11:06:57.374734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-551aec50-6600-4889-839a-3602f11315d5 req-b913b50c-fb12-4964-b4eb-87ea65c830e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137696 Oct 10 11:06:57.374734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2529/5179] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:57.482495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:57.483462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:57.502432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:57.502933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:57.503409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:57.504308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:57.504924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:57.506094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:57.636626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:57.640697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:57.643575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:57.644240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lazy-loading 'fault' on Instance uuid a7faf21c-5778-458a-a4f8-e74063dfe262 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:06:57.809594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e6ae819436436fb32f6189e6da1d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9d48e8e4ed468e897e1fbc5f4eae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:06:57.819983 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f7c2b56-b955-4ba4-bfae-2049ce471e43 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 200 len: 1302 microversion: 2.1 time: 0.342557 Oct 10 11:06:57.829156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2651/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:57 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 1302 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:06:58.874731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:58.875773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:58.900308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:58.900804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:58.901243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:58.901962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:58.902451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:58.913602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:58.937075 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 HTTP/1.1 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a7faf21c-5778-458a-a4f8-e74063dfe262'} Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:58.939371 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:58.946040 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:58.948347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:58.949598 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b77ed05-2c93-4c95-ba99-21f24617bbf5 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 404 len: 111 microversion: 2.1 time: 0.095412 Oct 10 11:06:58.963129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:58.967449 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2530/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:58 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:58.984106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_groups [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Querying cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) for 1 instances {{(pid=128800) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 11:06:58.985404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:58.986129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:58.986818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:58.999283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b25ac64-fdaa-40f0-bbdc-8e7dc9a01fa0 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042378 Oct 10 11:06:59.000039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2652/5182] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:06:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:06:59.013289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.029711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_groups [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Querying cell bed97504-010c-4a3b-9285-fc61eea1d980(cell1) for 1 instances {{(pid=128801) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 11:06:59.031477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:59.032170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:59.032785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:59.045614 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d73db40-8970-40d5-9e75-282ed9df632a tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99" status: 200 len: 184 microversion: 2.1 time: 0.036283 Oct 10 11:06:59.059692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.060212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:59.065388 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2531/5183] 10.222.0.16 () {58 vars in 1263 bytes} [Mon Oct 10 11:06:59 2022] GET /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99 => generated 184 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:06:59.067048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:59.068075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:59.068690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:59.069749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:59.070376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:59.070989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:59.094333 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 HTTP/1.1 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'a7faf21c-5778-458a-a4f8-e74063dfe262'} Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:59.100993 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.105516 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.107208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.108256 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-642426c0-4add-4c0e-a6dd-38a44fc963ca tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 404 len: 111 microversion: 2.1 time: 0.053640 Oct 10 11:06:59.109326 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2653/5184] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:59.118805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.119041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] [instance: a7faf21c-5778-458a-a4f8-e74063dfe262] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:06:59.134017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:59.134510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:59.134954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:59.135694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:06:59.144187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:06:59.144679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:06:59.183252 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 HTTP/1.1 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'a7faf21c-5778-458a-a4f8-e74063dfe262'} Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.185002 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance a7faf21c-5778-458a-a4f8-e74063dfe262 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c952be64-ad07-4943-89a8-ff80971f7e83 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262" status: 404 len: 111 microversion: 2.1 time: 0.073189 Oct 10 11:06:59.189742 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2532/5185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:06:59 2022] GET /compute/v2.1/servers/a7faf21c-5778-458a-a4f8-e74063dfe262 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:59.195339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9726f0bf-69a9-49ef-be3b-4636a2c2e697 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.205385 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9726f0bf-69a9-49ef-be3b-4636a2c2e697 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9726f0bf-69a9-49ef-be3b-4636a2c2e697 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-server-groups/b79167cf-6b66-46cc-9213-d55dd53aca82 HTTP/1.1 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b79167cf-6b66-46cc-9213-d55dd53aca82'} Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.206945 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9726f0bf-69a9-49ef-be3b-4636a2c2e697 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance group b79167cf-6b66-46cc-9213-d55dd53aca82 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.212186 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9726f0bf-69a9-49ef-be3b-4636a2c2e697 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/b79167cf-6b66-46cc-9213-d55dd53aca82" status: 404 len: 117 microversion: 2.1 time: 0.017056 Oct 10 11:06:59.218020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72e3bb88-5110-45e0-8ca9-bd7f6a34883f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.231799 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2654/5186] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/os-server-groups/b79167cf-6b66-46cc-9213-d55dd53aca82 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:59.233539 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-72e3bb88-5110-45e0-8ca9-bd7f6a34883f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72e3bb88-5110-45e0-8ca9-bd7f6a34883f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-server-groups/bd19ba99-cc71-4783-ab79-ec16443dd2a2 HTTP/1.1 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'bd19ba99-cc71-4783-ab79-ec16443dd2a2'} Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.235715 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72e3bb88-5110-45e0-8ca9-bd7f6a34883f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance group bd19ba99-cc71-4783-ab79-ec16443dd2a2 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.240771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72e3bb88-5110-45e0-8ca9-bd7f6a34883f tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/bd19ba99-cc71-4783-ab79-ec16443dd2a2" status: 404 len: 117 microversion: 2.1 time: 0.023501 Oct 10 11:06:59.243952 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2533/5187] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/os-server-groups/bd19ba99-cc71-4783-ab79-ec16443dd2a2 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:59.246285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2554c4ab-1472-4c3d-8e1e-d11e4bfd27bd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.253442 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2554c4ab-1472-4c3d-8e1e-d11e4bfd27bd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2554c4ab-1472-4c3d-8e1e-d11e4bfd27bd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/os-server-groups/30df068b-17e7-4c5d-a0bd-9ad349003037 HTTP/1.1 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '30df068b-17e7-4c5d-a0bd-9ad349003037'} Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.261946 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. Oct 10 11:06:59.266459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.267633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2554c4ab-1472-4c3d-8e1e-d11e4bfd27bd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance group 30df068b-17e7-4c5d-a0bd-9ad349003037 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.269906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2554c4ab-1472-4c3d-8e1e-d11e4bfd27bd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/30df068b-17e7-4c5d-a0bd-9ad349003037" status: 404 len: 117 microversion: 2.1 time: 0.027420 Oct 10 11:06:59.274165 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2655/5188] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/os-server-groups/30df068b-17e7-4c5d-a0bd-9ad349003037 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:06:59.288904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d2ae54-f773-44be-b91f-98b96a801e08 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.305142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-98d2ae54-f773-44be-b91f-98b96a801e08 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] HTTP exception thrown: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d2ae54-f773-44be-b91f-98b96a801e08 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Request method failure captured: Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-server-groups/07137297-7cb4-4625-9ac3-f1fd7925b738 HTTP/1.1 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_y5bgBtT3Q0_hOTSs_iTQSG-MBJW0-FGlR1j9rcW6H-JzTsnnCVhEK2CPM7ZXS_5BaQ8omCNbbI1C3Mit323sHEIoSXQ0ibInDKMArlXZBYInq6Ff8kUf5oG0zoO8F2iuW0kib7eUidwzSHoGQpD2p04QlqAVo6s57klQgcc62sUGE Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d9d48e8e4ed468e897e1fbc5f4eae5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d9d48e8e4ed468e897e1fbc5f4eae5d"}]}] Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 7d9d48e8e4ed468e897e1fbc5f4eae5d Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-544402604 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 10e6ae819436436fb32f6189e6da1d38 Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-544402604-project Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '07137297-7cb4-4625-9ac3-f1fd7925b738'} Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.307056 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. Oct 10 11:06:59.312498 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:06:59.326801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d2ae54-f773-44be-b91f-98b96a801e08 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Returning 404 to user: Instance group 07137297-7cb4-4625-9ac3-f1fd7925b738 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:06:59.328627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98d2ae54-f773-44be-b91f-98b96a801e08 tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/07137297-7cb4-4625-9ac3-f1fd7925b738" status: 404 len: 117 microversion: 2.1 time: 0.049494 Oct 10 11:06:59.333319 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2534/5189] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/os-server-groups/07137297-7cb4-4625-9ac3-f1fd7925b738 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:06:59.339097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-456960da-9a75-457e-ac34-be139a55e9dd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:06:59.412590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-456960da-9a75-457e-ac34-be139a55e9dd tempest-ServerGroupTestJSON-544402604 tempest-ServerGroupTestJSON-544402604-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99" status: 204 len: 0 microversion: 2.1 time: 0.078410 Oct 10 11:06:59.414574 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2656/5190] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:06:59 2022] DELETE /compute/v2.1/os-server-groups/5edecc78-f982-4fa4-a81f-ae72be3c8a99 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:07:06.215711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7e2eb02-1e1b-4bde-b937-7c09b921106d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: .version_select at 0x7f677cfb9af0>, body: {"keypair": {"name": "tempest-keypair-989596135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkPOfYky75U6hI02vx4pnf6u11WWYIkcdWKhpahVSGOKgTUEXMs1UqiUemhYNRLaOHaYWZJz36s8TWCxokI1U5gTJKk2WCDa8/u5UKLDLhNlzlqUxZE2tnQMs0wDvpkKw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:06.285805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:06.375967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f7e2eb02-1e1b-4bde-b937-7c09b921106d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:06.400954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f7e2eb02-1e1b-4bde-b937-7c09b921106d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:06.494936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7e2eb02-1e1b-4bde-b937-7c09b921106d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.613333 Oct 10 11:07:06.495600 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2535/5191] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:07:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:11.627420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:11.628910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:11.635798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1854895000", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c66f5f-64f9-415c-b2e7-430e78e4a9d5"}], "security_groups": [{"name": "tempest-securitygroup--32289848"}], "key_name": "tempest-keypair-989596135", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:12.077935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] validate_networks() for [('21c66f5f-64f9-415c-b2e7-430e78e4a9d5', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:07:15.116677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:07:15.117427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:07:15.121601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:07:15.123442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:07:15.123911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:07:15.166497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:15.179157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:15.183891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:15.188307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:15.189317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:15.196718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:15.258936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:15.276800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:15.306778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:07:15.332206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:07:15.461623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1b3f411b-cb3c-402a-a7b0-18beb6dbaf1b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.835913 Oct 10 11:07:15.464852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2657/5192] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:07:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 3840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:07:15.480564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-176481a3-0525-44cb-831b-f320ea816620 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:15.482045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-176481a3-0525-44cb-831b-f320ea816620 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:15.539442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=75 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:15.838491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-176481a3-0525-44cb-831b-f320ea816620 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:15.858199 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-176481a3-0525-44cb-831b-f320ea816620 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1241 microversion: 2.1 time: 0.385253 Oct 10 11:07:15.863299 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2536/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:15 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1241 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:16.884239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:16.884866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:16.907669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:16.908182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:16.908637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:16.909358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:16.909820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:16.911686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:17.304123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:17.315297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a640f0d-4d65-4030-b1c2-8b442328cc43 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1237 microversion: 2.1 time: 0.437134 Oct 10 11:07:17.320044 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2658/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:16 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1237 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:18.350636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:18.357905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:18.389064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:18.389977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:18.392576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:18.399054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:18.399864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:18.402170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:18.537528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:18.556805 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edc28c98-be4b-403b-a5c5-93fa4ce40fa7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1299 microversion: 2.1 time: 0.210525 Oct 10 11:07:18.560804 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2537/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:18 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:19.267313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-542858811", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "c08659d1-913f-4f17-a5e6-6aa66e732973"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:19.360106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] validate_networks() for [('c08659d1-913f-4f17-a5e6-6aa66e732973', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:07:19.583770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:19.584400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:19.596116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:19.596612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:19.599264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:19.600004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:19.600470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:19.600894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:19.732789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:19.753814 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fba3e04b-d234-4cd5-bd10-40e3a3cae14c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1299 microversion: 2.1 time: 0.173804 Oct 10 11:07:19.758240 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2538/5196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:19 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:19.923784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:07:19.924529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:07:19.925902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:07:19.926532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:07:19.928090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:07:19.946432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:19.947081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:19.947394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:19.948127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:19.954009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:19.954852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:19.996132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Getting quotas for project b123a032fb5744aca2662299816a4074. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:20.015890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Getting quotas for user e146b549505f46729177b3faa5d42800 and project b123a032fb5744aca2662299816a4074. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:20.042568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:07:20.044809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:07:20.128405 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa7227a5-1f8a-4782-bcea-f935dedabb52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865044 Oct 10 11:07:20.129842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2659/5197] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:07:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:07:20.142716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b79a0b7f-0b8f-47d6-8f9d-4b27540c17f7 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:20.143515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b79a0b7f-0b8f-47d6-8f9d-4b27540c17f7 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:20.283947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b79a0b7f-0b8f-47d6-8f9d-4b27540c17f7 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:20.292326 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b79a0b7f-0b8f-47d6-8f9d-4b27540c17f7 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1213 microversion: 2.1 time: 0.154502 Oct 10 11:07:20.296729 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2539/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:20 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:20.785078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:20.787234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:20.805039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:20.805842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:20.806459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:20.807426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:20.808348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:20.809268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:21.161449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:21.169682 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f382b122-ec37-4eaf-9116-9a52c5a08265 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.389995 Oct 10 11:07:21.178596 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2660/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:20 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:21.324498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:21.325116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:21.344580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:21.345081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:21.345524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:21.346247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:21.346707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:21.373200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:21.549366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:21.561168 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f22e837-1f85-4223-97d7-3a6a7586532b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1209 microversion: 2.1 time: 0.240455 Oct 10 11:07:21.587395 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2540/5200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:21 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1209 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:22.214411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:22.215792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:22.227904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:22.231384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:22.233364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:22.234262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:22.236283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:22.236897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:22.495415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:22.508234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-280f5416-5955-4f2b-9e9e-9a9a7f968c62 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.305786 Oct 10 11:07:22.512385 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2661/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:22 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:22.586459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:22.587704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:22.597024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:22.599289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:22.601147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:22.602143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:22.602814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:22.603289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:22.778905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:22.789296 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd5157de-0ac5-445e-84f1-19c2b8692ae0 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1271 microversion: 2.1 time: 0.207264 Oct 10 11:07:22.800068 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2541/5202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:22 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:23.536878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:23.537675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:23.550718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:23.553963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:23.554425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:23.561788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:23.562532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:23.563557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:23.830806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:23.831593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:23.844004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:23.850444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:23.851027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:23.853113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:23.854812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:23.855397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:23.955097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:23.964732 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f90ecac-d8aa-4e9f-bc95-461d41adb88d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.432501 Oct 10 11:07:23.989329 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2662/5203] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:23 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:24.029091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:24.039577 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efdd42c7-e4f5-4b8c-83ea-23088eb1be1e tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1271 microversion: 2.1 time: 0.214707 Oct 10 11:07:24.040698 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2542/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:23 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:24.682501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4120b66-c3a2-414b-908a-d1566b7d0613", "tag": "25242654-7dda-4386-b799-f112ff98eb69"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:24.698119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:24.698818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:24.699532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:24.713570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] Creating event network-changed:25242654-7dda-4386-b799-f112ff98eb69 for instance e4120b66-c3a2-414b-908a-d1566b7d0613 on n-h2-860687-2 Oct 10 11:07:24.720459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d73ec19d-decb-4244-8869-3cfc72ec5202 req-65e454a9-5112-44d0-8806-a8b0120fc82d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046417 Oct 10 11:07:24.721544 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2663/5205] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:07:24.993111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:24.996285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:25.019849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:25.024096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:25.024790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:25.025634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:25.026202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:25.035110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:25.066259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:25.067739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:25.087084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:25.087581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:25.088025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:25.088731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:25.089189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:25.089617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:25.193339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:25.208117 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e530b74-abf3-41de-8dd7-23f366868795 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1271 microversion: 2.1 time: 0.145967 Oct 10 11:07:25.212338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2664/5206] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:25 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:25.487796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:25.497882 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed8794ec-bc3d-4461-bd57-c159ef97e518 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.509272 Oct 10 11:07:25.498813 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2543/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:24 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:26.236665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:26.237639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:26.250796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:26.251577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:26.252241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:26.253259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:26.254022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:26.254960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:26.446217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:26.460783 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e5c5e7d-5c62-4726-87b2-1b5c7128d1a3 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 0.224797 Oct 10 11:07:26.461787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2665/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:26 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:26.522650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:26.523890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:26.532396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:26.533138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:26.533734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:26.535118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:26.536339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:26.536933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:26.713414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:26.722635 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7b7f26e-be6c-416d-b6d5-ce65c5bca6aa tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.204564 Oct 10 11:07:26.736067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2544/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:26 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:27.487042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:27.487831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:27.499446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:27.500354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:27.501091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:27.502312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:27.502985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:27.504673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:27.751886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:27.757639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:27.767766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:27.768835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:27.770510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:27.772772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:27.775156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:27.776495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:28.511487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:28.520990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe611bfa-319b-4cd7-a719-8b84604cc035 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 1.040235 Oct 10 11:07:28.528433 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2666/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:27 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:28.683843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1323773810", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:28.773027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:28.802418 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65b98966-741c-4cec-b7e3-347764b6119b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 1.051625 Oct 10 11:07:28.824373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2545/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:27 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:28.831517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c6e894-883b-4bcc-afc1-e19c3cd254a1", "tag": "ab35e587-c9e8-486b-b3c2-f4357f40fde4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:28.856346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] validate_networks() for [('4daba597-d3fa-481c-a528-4b8ec5827c7c', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:07:28.869072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:28.870320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:28.872225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:28.907384 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] Creating event network-changed:ab35e587-c9e8-486b-b3c2-f4357f40fde4 for instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 on n-h1-860687-2 Oct 10 11:07:28.934624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0e8b86f0-8444-4aa1-9873-f5c9a01efb3e req-91be0731-cc40-4103-9783-5c15a59dfb6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110002 Oct 10 11:07:28.935704 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2546/5212] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:29.556906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:29.558097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:29.574837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:29.575403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:29.576337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:29.581536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:29.586697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:29.587327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:29.937500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:29.955195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2319279d-c91f-4ded-b1ca-4fd50fe0d275 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 0.404469 Oct 10 11:07:29.955786 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2547/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:29 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:29.976314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:29.977677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:29.980905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:30.003540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:07:30.005260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:07:30.005962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:07:30.006537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:07:30.007155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:07:30.020819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.021179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.021739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:30.021868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:30.022334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:30.022637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:30.023078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.023806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.024431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:30.025185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:30.027768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:30.030613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:30.044992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Getting quotas for project 5f198ae6cb3c40caa38c8ebd33612353. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:30.054583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Getting quotas for user e260920cbbcd4cb8b6845ca898e396d6 and project 5f198ae6cb3c40caa38c8ebd33612353. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:30.102816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:07:30.112683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:07:30.231850 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32e486ec-8d73-491d-a3a3-9a93446dd98b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.702062 Oct 10 11:07:30.232900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2667/5214] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:07:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:07:30.252169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11491307-9717-46b0-bf6d-d9778ef6a39d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:30.254944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11491307-9717-46b0-bf6d-d9778ef6a39d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:30.265794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:30.278872 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28af5dfd-9a13-4dbe-82e3-68a862974728 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.316313 Oct 10 11:07:30.281531 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2548/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:29 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:30.388020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-11491307-9717-46b0-bf6d-d9778ef6a39d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:30.394242 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11491307-9717-46b0-bf6d-d9778ef6a39d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1214 microversion: 2.1 time: 0.151419 Oct 10 11:07:30.395595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2668/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:30 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:30.434479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4120b66-c3a2-414b-908a-d1566b7d0613", "name": "network-vif-plugged", "status": "completed", "tag": "25242654-7dda-4386-b799-f112ff98eb69"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:30.471888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:30.494396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.498609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:30.499071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:30.542397 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] Creating event network-vif-plugged:25242654-7dda-4386-b799-f112ff98eb69 for instance e4120b66-c3a2-414b-908a-d1566b7d0613 on n-h2-860687-2 Oct 10 11:07:30.557372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-15a76cb8-4624-4517-b2d3-de20a386994f req-14099ce8-ea0a-47fe-9e8f-bf6f8126c6c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128473 Oct 10 11:07:30.558054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2549/5217] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:30.980605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:30.981910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:30.994425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:30.995040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.004562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.005222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:31.005779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.006408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.308708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:31.310535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:31.322218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:31.337156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.337619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.338397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:31.338849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.339315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.345384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:31.358654 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-140308ae-27ba-4ef9-adef-6ee9d62ac0cb tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 0.382792 Oct 10 11:07:31.360886 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2669/5218] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:30 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:31.420456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:31.421785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:31.438658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:31.441303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.443240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.445135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:31.457577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:31.461702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:31.587688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:31.618163 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e188db5f-d3c7-4e17-b272-44922b432667 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1218 microversion: 2.1 time: 0.200291 Oct 10 11:07:31.618798 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2670/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:31 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:31.646540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:31.662345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03e4064b-37de-423d-bfc6-b19b3bf9754e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1365 microversion: 2.1 time: 0.358769 Oct 10 11:07:31.673869 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2550/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:31 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:32.390282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:32.390982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:32.403297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:32.403798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:32.404243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:32.408929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:32.409426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:32.409982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:32.650083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:32.651470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:32.674733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:32.676212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:32.680954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:32.681974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:32.688996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:32.691839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:32.999463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:33.001836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:33.019773 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85673d66-bd9e-4a1a-aa0d-5e7db19e8db9 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1266 microversion: 2.1 time: 0.380014 Oct 10 11:07:33.020774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bcc5b6c5-8364-439c-987e-25a13952c452 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 0.631444 Oct 10 11:07:33.023358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2671/5221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:32 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:33.025670 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2551/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:32 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:33.040748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:33.042423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:33.059199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:33.059977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:33.060582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:33.061990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:33.062636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:33.064001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:33.344677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:33.356222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4771bda6-7315-4664-8bd3-1a745cd58f09 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1555 microversion: 2.1 time: 0.330843 Oct 10 11:07:33.357553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2672/5223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:33 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:33.401915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:33.402604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:33.433221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:33.434616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:33.435217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:33.437289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:33.438293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:33.439937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:33.765261 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-355cb710-744b-4b34-99e7-2820c133f158 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.382256 Oct 10 11:07:33.768807 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2552/5224] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:07:33 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-interface => generated 284 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:34.060862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:34.071111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:34.072128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:34.075381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:34.087242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:34.087999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:34.089409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:34.090461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:34.092041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:34.092488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:34.102324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:34.103152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:34.105372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:34.107225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:34.110251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:34.110892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:34.303462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:34.320710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f1565e8-54fc-4de0-9018-fc1a8c0d3b8c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1272 microversion: 2.1 time: 0.265730 Oct 10 11:07:34.326135 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2673/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:34 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:34.403432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:34.422959 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67fc33f0-d341-43d8-8185-c3f3187f806f tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 0.366304 Oct 10 11:07:34.428131 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2553/5226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:34 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:34.842902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c6e894-883b-4bcc-afc1-e19c3cd254a1", "name": "network-vif-plugged", "status": "completed", "tag": "ab35e587-c9e8-486b-b3c2-f4357f40fde4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:34.862713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:34.863881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:34.864435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:34.891549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] Creating event network-vif-plugged:ab35e587-c9e8-486b-b3c2-f4357f40fde4 for instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 on n-h1-860687-2 Oct 10 11:07:34.903848 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bf2899f9-a221-49fd-8383-efd9bde8e36c req-0cf5d7a0-4784-4e2a-8364-7f75009627e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066275 Oct 10 11:07:34.907296 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2674/5227] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:35.359751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:35.360696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:35.391727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:35.396530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:35.398964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:35.403600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:35.404576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:35.406319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:35.456479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:35.458829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:35.490047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:35.490607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:35.491081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:35.491810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:35.510868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:35.512179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:36.685183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:36.715303 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5c17166-b553-4a71-8b3d-c03e0debf74e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 1.368203 Oct 10 11:07:36.716219 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2554/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:35 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:36.809154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:36.817582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c62b521e-e556-4efb-b410-fdba30beff12 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1313 microversion: 2.1 time: 1.367746 Oct 10 11:07:36.828229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2675/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:35 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1313 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:36.999418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4120b66-c3a2-414b-908a-d1566b7d0613", "tag": "25242654-7dda-4386-b799-f112ff98eb69"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:37.026048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:37.030692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:37.031497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:37.032705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:37.107116 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] Creating event network-changed:25242654-7dda-4386-b799-f112ff98eb69 for instance e4120b66-c3a2-414b-908a-d1566b7d0613 on n-h2-860687-2 Oct 10 11:07:37.137823 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f50251fa-ad0f-42d1-8c01-1081fb045495 req-a88e1426-2726-4b92-8d5a-9de4b8b0a3bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142258 Oct 10 11:07:37.150849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2555/5230] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:37.742021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:37.743909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:37.763954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:37.765515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:37.770265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:37.777067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:37.777820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:37.778484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:37.857476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:37.858446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:37.867051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:37.867985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:37.868622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:37.869568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:37.870747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:37.871421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:38.317956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:38.321784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:38.339981 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe0f61bd-ce41-4899-8006-4b442df93a52 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1496 microversion: 2.1 time: 0.496357 Oct 10 11:07:38.341173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2556/5231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:37 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1496 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:38.447351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:38.456177 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ad4cfe63-f6a8-4b03-9ea2-231727d66d5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 0.719399 Oct 10 11:07:38.456844 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2676/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:37 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:39.222450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345a62c0-d409-4ed5-8a3f-56fd06271dd4", "tag": "d2fd5d6e-02cb-47a1-933f-8577121a9c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:39.241997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.242483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.251805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.304521 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] Creating event network-changed:d2fd5d6e-02cb-47a1-933f-8577121a9c57 for instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 on n-h2-860687-2 Oct 10 11:07:39.317518 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-06a79ab0-a298-4396-ad8c-c07a9491504d req-2270827c-0289-482d-b253-7fb1a4f15cba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098845 Oct 10 11:07:39.319325 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2557/5233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:39.505109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:39.508302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:39.530211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.541073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.541415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.543087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.543889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.545043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.571301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:39.571926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:39.592456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.599537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.601660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.603748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.604517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.608145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.682006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:07:39.888395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eae11b0f-b30f-4454-a2c5-327519594412 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 204 len: 0 microversion: 2.1 time: 0.319222 Oct 10 11:07:39.890072 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2558/5234] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:07:39 2022] DELETE /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:07:39.913587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:39.915907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:39.928764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.929258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.934130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.935150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:39.935775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:39.936349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:39.961855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:39.969860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:39.978707 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db2fdcf0-3011-40c9-90ae-a1ab15a89b96 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 0.494067 Oct 10 11:07:39.998682 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2677/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:39 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:40.332896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:40.350216 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a4ae8f5-5331-40c8-b59e-fb6b05ed23fc tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1502 microversion: 2.1 time: 0.451396 Oct 10 11:07:40.368497 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2559/5236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:39 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1502 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:41.002200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:41.004761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=20 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:41.011151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:41.014479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:41.032765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:41.035143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:41.035143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:41.035143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:41.035681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:41.036552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:41.413111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:41.413783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:41.420493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:41.420982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:41.421419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:41.435191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:41.436929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:41.437426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:41.585817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:41.596558 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7436773e-761b-416e-873c-47ae054e87cc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 0.595356 Oct 10 11:07:41.615727 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2678/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:40 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:41.892132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:41.903731 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6daa76ac-8c7b-46a1-8405-8b5e6fdaff79 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 200 len: 1502 microversion: 2.1 time: 0.495377 Oct 10 11:07:41.906524 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2560/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:41 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 1502 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:42.079011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c6e894-883b-4bcc-afc1-e19c3cd254a1", "name": "network-vif-deleted", "tag": "ab35e587-c9e8-486b-b3c2-f4357f40fde4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:42.090188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:42.092337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:42.093037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:42.093653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:42.151924 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] Creating event network-vif-deleted:ab35e587-c9e8-486b-b3c2-f4357f40fde4 for instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 on n-h1-860687-2 Oct 10 11:07:42.159851 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-212d8843-a213-4295-b127-bd6f0ab87567 req-236c3f9a-5eb2-4d2e-a195-b57b5ee1ff4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084517 Oct 10 11:07:42.160789 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2679/5239] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:42.627860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:42.629154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:42.638708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:42.643937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:42.689234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:42.690182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:42.695626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:42.697344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:42.935893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:42.937139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: 95c6e894-883b-4bcc-afc1-e19c3cd254a1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:42.954293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:42.964716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:42.965580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:42.968269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:42.974426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:42.975211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:43.016104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] HTTP exception thrown: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Request method failure captured: Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 HTTP/1.1 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zj_9q3ClHakA7jUMvlm-z5EQM14G45-iRhiK2tbCoBep-y1wztsIxCEgUoSRJiocJ5K08P58E-TMOg_T5lbmMqvi1a_zQtTJCJ1FFoobqqi_vwupD2nzs90wo6tCBWIaP9Ay234_TAN2oY9QjEnnyW3FGijd7zyMSy_DNntRj8niI Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: b123a032fb5744aca2662299816a4074 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesActionsTest-1075582418 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b123a032fb5744aca2662299816a4074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b123a032fb5744aca2662299816a4074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b123a032fb5744aca2662299816a4074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b123a032fb5744aca2662299816a4074"}]}] Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesActionsTest-1075582418 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: b123a032fb5744aca2662299816a4074 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesActionsTest-1075582418 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesActionsTest-1075582418-project Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e146b549505f46729177b3faa5d42800 Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesActionsTest-1075582418-project Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '95c6e894-883b-4bcc-afc1-e19c3cd254a1'} Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:07:43.022689 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. Oct 10 11:07:43.027763 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:07:43.032030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Returning 404 to user: Instance 95c6e894-883b-4bcc-afc1-e19c3cd254a1 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:07:43.033246 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e236a7fe-7006-459e-bfa3-e98b915439be tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1" status: 404 len: 111 microversion: 2.1 time: 0.103053 Oct 10 11:07:43.038256 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2680/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:42 2022] GET /compute/v2.1/servers/95c6e894-883b-4bcc-afc1-e19c3cd254a1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:07:43.246960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-652668952", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "c08659d1-913f-4f17-a5e6-6aa66e732973"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:43.371153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] validate_networks() for [('c08659d1-913f-4f17-a5e6-6aa66e732973', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:07:43.778262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:43.792605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ddb34138-d0a5-4459-b182-81a6b76025cf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 1.168606 Oct 10 11:07:43.793787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2561/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:42 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:44.371210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345a62c0-d409-4ed5-8a3f-56fd06271dd4", "name": "network-vif-plugged", "status": "completed", "tag": "d2fd5d6e-02cb-47a1-933f-8577121a9c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:44.395034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:44.395034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:44.395490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:44.412822 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] Creating event network-vif-plugged:d2fd5d6e-02cb-47a1-933f-8577121a9c57 for instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 on n-h2-860687-2 Oct 10 11:07:44.427319 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-655f09df-95d1-4a35-8cb3-5d6be2a8a222 req-1abc72cc-a4cf-46bf-b733-46e808e0fce2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059732 Oct 10 11:07:44.428282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2562/5242] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:44.478788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:07:44.479887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:07:44.482096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:07:44.484432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:07:44.485056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:07:44.516629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:44.517127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:44.517566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:44.518306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:44.519384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:44.519816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:44.549542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Getting quotas for project b123a032fb5744aca2662299816a4074. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:44.557710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Getting quotas for user e146b549505f46729177b3faa5d42800 and project b123a032fb5744aca2662299816a4074. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:44.571897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:07:44.574213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:07:44.659286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1114d44-245a-44b2-8629-474243c91ba4 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417590 Oct 10 11:07:44.663996 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2681/5243] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:07:44.676550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2410cd4a-5c91-4cce-9b39-f0ebff644440 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:44.676550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2410cd4a-5c91-4cce-9b39-f0ebff644440 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:44.823657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:44.824406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:44.825450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2410cd4a-5c91-4cce-9b39-f0ebff644440 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:44.834981 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2410cd4a-5c91-4cce-9b39-f0ebff644440 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1213 microversion: 2.1 time: 0.164622 Oct 10 11:07:44.836562 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2563/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:44 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:44.843522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:44.845509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:44.845966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:44.846694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:44.847931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:44.849940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:45.416006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:45.425393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6ecd402-3c0e-477c-b0e3-91e6f9489163 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1314 microversion: 2.1 time: 0.607826 Oct 10 11:07:45.430446 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2682/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:44 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:45.863268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:45.864997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:45.877374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:45.879456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:45.880093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:45.882853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:45.883648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:45.886176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:46.079454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:46.101219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-064e2c21-8b45-4189-b8f6-ebdfd12eae00 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1265 microversion: 2.1 time: 0.241486 Oct 10 11:07:46.104669 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2683/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:45 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:46.127742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2133760870", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "5f17ff46-f511-4d2c-b5e6-5a0a46dd9d2a"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:46.215404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] validate_networks() for [('5f17ff46-f511-4d2c-b5e6-5a0a46dd9d2a', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:07:46.458579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:46.460596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:46.502494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:46.506467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:46.508277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:46.511016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:46.511824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:46.512517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:46.895064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:46.905780 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1512a52d-c8eb-4dca-9871-7bb36ea8694c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1500 microversion: 2.1 time: 0.452667 Oct 10 11:07:46.907573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2684/5247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:46 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1500 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:46.931878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:46.942419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:46.953918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:46.955034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:46.955705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:46.957188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:46.961252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:46.961894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.013550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lazy-loading 'flavor' on Instance uuid 345a62c0-d409-4ed5-8a3f-56fd06271dd4 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:07:47.103625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:07:47.104056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:07:47.104731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:07:47.106269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:07:47.106886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:07:47.133300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.135222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.138610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.139771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.140860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.142551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.185086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Getting quotas for project 1641831908044c3caa50bb82bd03d60d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:07:47.197992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Getting quotas for user 7cf7e55c1014473790e1a7d1683021bc and project 1641831908044c3caa50bb82bd03d60d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:07:47.205095 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc1de5a6-216f-477e-8e97-6273182618f5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "POST /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4/action" status: 200 len: 32 microversion: 2.1 time: 0.277876 Oct 10 11:07:47.206043 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2685/5248] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:07:46 2022] POST /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:07:47.222773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:47.223525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:47.231940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.231940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.232387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.235784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.236248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.236682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.239113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:07:47.242341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:07:47.366206 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-096e94f3-c007-4bfd-9d3b-b76a09ec46c0 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.519959 Oct 10 11:07:47.367559 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2564/5249] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 11:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 11:07:47.372903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:47.375999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:47.396425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.397257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.397870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.398773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:47.399564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:47.401114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:47.936147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:47.954633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8f249a4-35f9-403a-b482-7da08ed50284 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.585324 Oct 10 11:07:47.961845 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2565/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:47 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:47.983370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:47.984385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:48.117606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:48.129214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:48.130452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:48.135453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:48.139582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aef90c92-6b5e-4802-8033-759e51f8e369 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.931190 Oct 10 11:07:48.140202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2686/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:47 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:48.141041 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72d045aa-15ba-488f-8e5d-bc9c38dc34f1 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1259 microversion: 2.21 time: 0.176044 Oct 10 11:07:48.142294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2566/5252] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:47 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:48.988967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:48.989515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:49.010976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.011535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.011984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.012714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.013173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.013602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.169998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:49.170745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:49.191749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.195782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.197625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.198975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.202347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.209362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.535669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:49.537614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:49.552462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:49.555062 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb535f35-c148-44fa-ad65-bab4e1217735 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.570352 Oct 10 11:07:49.560974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:49.561518 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2687/5253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:48 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:49.565244 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33714698-0d0e-49e2-86b0-7b0c773a8bc8 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1319 microversion: 2.21 time: 0.400548 Oct 10 11:07:49.569315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2567/5254] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:49 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:49.574815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:49.576725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:49.602110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5201a51-0d07-44c9-a49a-3fd75f8f383f", "tag": "e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:49.603920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.609782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.610436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.611370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.612199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.616212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.642311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:49.642992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:49.643608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:49.666319 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] Creating event network-changed:e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77 for instance d5201a51-0d07-44c9-a49a-3fd75f8f383f on n-h1-860687-2 Oct 10 11:07:49.689056 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c140db79-14c6-4dc3-b2f7-3f891ad595ef req-b7453944-37d9-489e-9e7b-5c728bfe811f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086237 Oct 10 11:07:49.689817 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2568/5255] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:07:49.807643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:49.818153 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5d7f56c-a3c0-4ceb-895a-80d4a7142cdd tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.253250 Oct 10 11:07:49.830379 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2688/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:49 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:50.598672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:50.601915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:50.602639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:50.607885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:50.623473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.623973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.624410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:50.628568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.629235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.629688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:50.630440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.630902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.631372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:50.634289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.634782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.635246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:50.919749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:50.935635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:50.937468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:50.940642 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fa5dc54-cbc4-41c6-ae90-9b8c47b56a3d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1317 microversion: 2.21 time: 0.344630 Oct 10 11:07:50.943149 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2689/5257] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:50 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:50.960705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:50.961724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:50.982111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.982617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.983092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:50.988597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:50.988982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:50.991174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:51.060748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:51.069921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b98807a1-87ce-46d1-9d74-36eeaae4d475 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.485446 Oct 10 11:07:51.070501 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2569/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:50 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:51.317601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:51.329647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5671073c-dda7-4cde-837f-040e507577ef tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.385253 Oct 10 11:07:51.330243 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2690/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:50 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:51.968725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:51.969271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:51.977465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:51.978191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:51.978793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:51.980035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:51.980662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:51.981253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:52.095699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:52.097928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:52.106736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:52.108307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:52.108981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:52.109960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:52.110693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:52.111209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:52.250315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:52.266109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:52.272842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:52.278727 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc3abd8c-88a7-497c-b1ac-d6a70226874c tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.312365 Oct 10 11:07:52.280910 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2570/5260] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:51 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:52.353274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:52.354333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:52.361865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:52.362858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:52.363642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:52.364794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:52.365487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:52.366175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:52.394084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:52.410632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40b43e07-821a-404e-aadd-0a0d4e2ae3bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.319053 Oct 10 11:07:52.434303 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2691/5261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:52 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:52.595399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:52.608921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18c60f82-c702-4ecb-9433-1348211b8ae8 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.256072 Oct 10 11:07:52.610848 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2571/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:52 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:53.310232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:53.312322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:53.325692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.326191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.326636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.327379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.328027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.328639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.444553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:53.445243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:53.465403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.468107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.469239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.470469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.471357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.472777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.596129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:53.607140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:53.627524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:53.629236 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d357a113-fba6-43a5-bb09-a3d6c54e40b6 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.325214 Oct 10 11:07:53.631475 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2692/5263] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:53 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:53.647753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efdd5e3c-0416-412b-b005-3a2954f92e27", "tag": "31ca8088-8319-43b6-8e86-6423d29c51a4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:53.664911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.670671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.673569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.698800 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] Creating event network-changed:31ca8088-8319-43b6-8e86-6423d29c51a4 for instance efdd5e3c-0416-412b-b005-3a2954f92e27 on n-h1-860687-2 Oct 10 11:07:53.705364 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6ce33519-5c7c-492b-9652-858a106852d5 req-b6e2cf3a-d32c-4af2-8922-d2bdfabe2626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067313 Oct 10 11:07:53.709270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2693/5264] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:53.717213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:53.731809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:53.749139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.749431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:53.750070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.750752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.755876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:53.758888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42e52ca6-2d58-444c-91d0-e6defc11af57 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.321613 Oct 10 11:07:53.771294 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2572/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:53 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:53.771396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:53.771396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:53.966720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:53.980176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30a942c0-1a37-4cce-8d9d-b3c6c9dc813b tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.269144 Oct 10 11:07:53.981542 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2694/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:53 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:54.577852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5201a51-0d07-44c9-a49a-3fd75f8f383f", "name": "network-vif-plugged", "status": "completed", "tag": "e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:54.593056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:54.593862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:54.594504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:54.625921 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] Creating event network-vif-plugged:e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77 for instance d5201a51-0d07-44c9-a49a-3fd75f8f383f on n-h1-860687-2 Oct 10 11:07:54.634156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e83f77d0-7a4a-4fc6-a6ad-061b514745b1 req-ab5b57a5-f026-4b6e-b48d-8c6047478334 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060451 Oct 10 11:07:54.635679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2573/5267] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:54.660074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:54.660907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:54.663915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:54.664812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:54.670800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:54.671330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:54.671781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:54.672497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:54.672959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:54.673775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:54.680471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:54.792808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:54.793789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:54.802516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:54.803261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:54.803897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:54.805032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:54.805684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:54.806288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:54.879807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:54.888625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:54.890065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:54.891260 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fa1a24c0-5697-4b85-bd8b-de86f4f1390f tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.236731 Oct 10 11:07:54.909034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2695/5268] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:54 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:55.005779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:55.006410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:55.016472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:55.017593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:55.019091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:55.019477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:55.020296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:55.021129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:55.021809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:55.025149 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0620584-2185-4861-8640-1651efec9d51 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.236907 Oct 10 11:07:55.025736 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2574/5269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:54 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:55.188971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:55.198173 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c71e7754-8e18-4032-8752-a2fd24b3cb0a tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.197729 Oct 10 11:07:55.199161 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2696/5270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:54 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:55.917156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:55.917798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:55.951083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:55.951685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:55.952135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:55.952889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:55.953329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:55.953923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:56.048415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:56.049009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:56.069332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:56.069837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:56.070289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:56.079712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:56.080250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:56.080641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:56.264258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:56.278867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:56.280539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:56.281698 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb458cbc-2643-453a-9395-a9f9eff09228 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.368815 Oct 10 11:07:56.282273 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2575/5271] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:55 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:56.311884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:56.312700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:56.321278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:56.322060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:56.323408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:56.324319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:56.324942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:56.325525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:56.371292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:56.395912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1c41dd5-7725-4d7a-ba76-8a1de7651ecc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.351338 Oct 10 11:07:56.407192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2697/5272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:56 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:56.561196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:56.571345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-284f6036-cbf3-4111-a9f8-d313906a5533 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1313 microversion: 2.1 time: 0.273021 Oct 10 11:07:56.572488 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2576/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:56 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:57.315735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:57.317068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:57.325087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.325567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.326008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.326910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.327785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.328378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.422737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:57.424014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:57.435939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:57.441887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.442736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.443481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.444429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.445093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.445752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.463883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:57.498365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:57.507436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:57.509144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:57.511300 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bf999b0a-ff1c-40d2-a49f-d5430e1589cd tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.199840 Oct 10 11:07:57.522316 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2698/5274] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:57 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:07:57.597437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:57.598336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:57.605205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.605931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.606601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.607521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:57.608144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:57.608809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:57.641153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:57.650704 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06d6406c-e7f0-4fe3-9870-6f726c1df7be tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.232027 Oct 10 11:07:57.651315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2577/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:57 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:57.751969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:57.761668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d42c3384-58f8-4b91-80af-59b554cbcbb9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1496 microversion: 2.1 time: 0.168664 Oct 10 11:07:57.770602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2699/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:57 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1496 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:07:58.398496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:58.402611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:58.426064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:07:58.432427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.434441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.435808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.437632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.438720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.439911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.519424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:07:58.537114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:58.537887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:58.554646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.557036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.557509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.561766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.564201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.564712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.763975 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ac3ff2f-3971-43dd-a12e-7985864c88f9 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 204 len: 0 microversion: 2.1 time: 0.411998 Oct 10 11:07:58.765898 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2578/5277] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:07:58 2022] DELETE /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:07:58.792848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:58.795552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:58.812093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.813928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.814893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.817504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:58.819236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:58.819805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:58.968897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:58.985657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:58.995278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:58.996812 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87ccdf23-13a1-4b20-ac82-f671989ae47d tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.464078 Oct 10 11:07:58.997392 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2700/5278] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:07:58 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:07:59.011936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:07:59.012545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:07:59.028771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:59.029422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:59.029878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:59.032591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:59.033083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:59.033531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:59.057366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:59.069827 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3edb78bb-9007-4cd5-b336-cf79003a317c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.301476 Oct 10 11:07:59.070644 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2579/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:58 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:59.079873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdd5e3c-0416-412b-b005-3a2954f92e27", "name": "network-vif-plugged", "status": "completed", "tag": "31ca8088-8319-43b6-8e86-6423d29c51a4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:07:59.104771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:07:59.105585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:07:59.106036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:07:59.135676 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] Creating event network-vif-plugged:31ca8088-8319-43b6-8e86-6423d29c51a4 for instance efdd5e3c-0416-412b-b005-3a2954f92e27 on n-h1-860687-2 Oct 10 11:07:59.148604 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a6165be0-a317-4288-a311-51e0ed3d741d req-f332c4f6-afe4-4b73-9635-23aefe87fa42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074386 Oct 10 11:07:59.149429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2580/5280] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:07:59.214263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:07:59.223378 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-591fcded-9104-4105-ab5e-d4ebf487eb80 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1502 microversion: 2.1 time: 0.223106 Oct 10 11:07:59.224208 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2701/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:07:58 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:07:59.961642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1545448922", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:00.026451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:00.028068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:00.042562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:08:00.047159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.047283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.052220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.055114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.055114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.055114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.388734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:00.398467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:00.400374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:00.401721 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca630cd6-18e7-41a4-8a65-8baa8d757533 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1359 microversion: 2.21 time: 0.379976 Oct 10 11:08:00.402447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2702/5282] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:00 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:00.423917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:00.425082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:00.431367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.431879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.432339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.433039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.433509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.433942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.493176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:00.493870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:00.495263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:00.495915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:00.496605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:00.507861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.508782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.509418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.510490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.511190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.511941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.540942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Getting quotas for project e6fffcfe13c04329a9a2eaf78ed6a74c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:00.547812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Getting quotas for user 8ebbfeb66ed548d6afe557a9d5f3fe78 and project e6fffcfe13c04329a9a2eaf78ed6a74c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:00.563859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:08:00.568117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:08:00.634920 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff42b77b-0aa6-40cd-b52e-edde815d7e48 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683717 Oct 10 11:08:00.636144 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2581/5283] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:08:00.641128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:00.642130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:00.651222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.652028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.652848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:00.653919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:00.654588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:00.655486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.045536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.058364 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5da4220d-6f9e-46d5-83c6-8db846be9afa tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.638147 Oct 10 11:08:01.059276 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2703/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:00 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:01.065498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc5a0c35-2045-4409-b06d-b2a4a64c6ca0 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:01.066567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc5a0c35-2045-4409-b06d-b2a4a64c6ca0 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:01.095662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e146b549505f46729177b3faa5d42800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123a032fb5744aca2662299816a4074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.105808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45b46d11-4019-49bd-9abb-3a7c61e11fe1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 200 len: 1460 microversion: 2.1 time: 0.468302 Oct 10 11:08:01.106404 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2582/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:00 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 1460 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:01.116775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5201a51-0d07-44c9-a49a-3fd75f8f383f", "name": "network-vif-deleted", "tag": "e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:01.123314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:01.128712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.129459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.130070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.144131 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] Creating event network-vif-deleted:e812ab31-1667-4a6c-b4e6-3c3ea4f2dd77 for instance d5201a51-0d07-44c9-a49a-3fd75f8f383f on n-h1-860687-2 Oct 10 11:08:01.149198 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e56d84ad-f49e-42e8-b13d-91efde1f77e5 req-2bf7f839-7358-4126-a4e6-e709175c15d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036182 Oct 10 11:08:01.153336 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2583/5286] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:01.157828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fc5a0c35-2045-4409-b06d-b2a4a64c6ca0 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.165662 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc5a0c35-2045-4409-b06d-b2a4a64c6ca0 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1214 microversion: 2.1 time: 0.104993 Oct 10 11:08:01.182892 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2704/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:01 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:01.427459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:01.428188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:01.435613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.436313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.436935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.437941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.438777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.439381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.603707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.613072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.614638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.615858 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0797981e-819a-4eed-bb78-050802b5c298 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1552 microversion: 2.21 time: 0.193944 Oct 10 11:08:01.616738 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2584/5288] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:01 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:01.640794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:01.641907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:01.650554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.651107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.651765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.655257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.656735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.657794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.690170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:08:01.784622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc2838cc-35ae-4813-a57b-dbf9db499cb3 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 204 len: 0 microversion: 2.21 time: 0.147068 Oct 10 11:08:01.785509 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2705/5289] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:08:01 2022] DELETE /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 11:08:01.795429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:01.796066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:01.803269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.803769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.804213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.804926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:01.805395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:01.805825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:01.946277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.954323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.955859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:01.957111 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da9a507d-585b-4bf2-80f2-64c04af06c58 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1558 microversion: 2.21 time: 0.167174 Oct 10 11:08:01.957684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2585/5290] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:01 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:02.090150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:02.091562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:02.099372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.100120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.100569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.101297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.101755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.102422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.132362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:02.133131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] [instance: d5201a51-0d07-44c9-a49a-3fd75f8f383f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:02.140517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.141090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.141541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.142265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.142919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.144393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.163220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] HTTP exception thrown: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Request method failure captured: Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f HTTP/1.1 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zj_9q3ClHakA7jUMvlm-z5EQM14G45-iRhiK2tbCoBep-y1wztsIxCEgUoSRJiocJ5K08P58E-TMOg_T5lbmMqvi1a_zQtTJCJ1FFoobqqi_vwupD2nzs90wo6tCBWIaP9Ay234_TAN2oY9QjEnnyW3FGijd7zyMSy_DNntRj8niI Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: b123a032fb5744aca2662299816a4074 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesActionsTest-1075582418 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b123a032fb5744aca2662299816a4074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b123a032fb5744aca2662299816a4074", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b123a032fb5744aca2662299816a4074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b123a032fb5744aca2662299816a4074"}]}] Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesActionsTest-1075582418 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: b123a032fb5744aca2662299816a4074 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesActionsTest-1075582418 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesActionsTest-1075582418-project Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: e146b549505f46729177b3faa5d42800 Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesActionsTest-1075582418-project Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd5201a51-0d07-44c9-a49a-3fd75f8f383f'} Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:02.165030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] Returning 404 to user: Instance d5201a51-0d07-44c9-a49a-3fd75f8f383f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eaed8e75-a06b-4587-87b9-4bd83cc2ada1 tempest-VolumesActionsTest-1075582418 tempest-VolumesActionsTest-1075582418-project] 10.222.0.16 "GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f" status: 404 len: 111 microversion: 2.1 time: 0.038036 Oct 10 11:08:02.169624 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2586/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:02 2022] GET /compute/v2.1/servers/d5201a51-0d07-44c9-a49a-3fd75f8f383f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:08:02.189114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:02.190164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:02.196273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.196769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.197216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.197919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:02.198551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:02.199300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:02.289325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:02.298024 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ea9aab9-60b6-4ba1-9b53-b4d3caa471ee tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1272 microversion: 2.1 time: 0.112732 Oct 10 11:08:02.301061 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2587/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:02 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:02.359728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:02.370980 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-25a4a988-29b6-4414-9956-e7533c37cacc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.286183 Oct 10 11:08:02.371587 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2706/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:02 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:02.983615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:02.984304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:02.991570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.010308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.011112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.011884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.012361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.012787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.278807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:03.289726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:03.300111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:03.301371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44c66125-2e97-4532-85f6-6886477a03e2 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1558 microversion: 2.21 time: 0.322496 Oct 10 11:08:03.302019 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2588/5294] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:02 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1558 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:03.323502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:03.324697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:03.339559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.340268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.340863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.341733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.350575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.351056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.395683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:03.396554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:03.405545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.407196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.411274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.412232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.413001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.415775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.677734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:03.688083 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b1e3b2b-b8a7-4fc4-b6db-c39dc6c3ca6e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.297332 Oct 10 11:08:03.688682 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2589/5295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:03 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:03.802661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:03.810668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f30baef8-8d0c-427e-9cfd-2cc2c06db88a tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.490950 Oct 10 11:08:03.811286 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2707/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:03 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:03.858379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efdd5e3c-0416-412b-b005-3a2954f92e27", "name": "network-vif-deleted", "tag": "31ca8088-8319-43b6-8e86-6423d29c51a4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:03.879159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:03.879860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:03.880530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:03.911506 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] Creating event network-vif-deleted:31ca8088-8319-43b6-8e86-6423d29c51a4 for instance efdd5e3c-0416-412b-b005-3a2954f92e27 on n-h1-860687-2 Oct 10 11:08:03.931570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a9d5149f-c131-410a-8951-b37ea3d5c2b0 req-344deb56-a929-44e5-a78f-e22adbbe0c6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073792 Oct 10 11:08:03.944730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2590/5297] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:04.340743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:04.341449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:04.362814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.369112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.369855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.371708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.372782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.373304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.476160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.476721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.477170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.477644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lazy-loading 'fault' on Instance uuid efdd5e3c-0416-412b-b005-3a2954f92e27 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:08:04.547418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:04.569144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:04.575422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7cf7e55c1014473790e1a7d1683021bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1641831908044c3caa50bb82bd03d60d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:04.579222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28379b2e-b79a-432c-b5e7-bd994a20b265 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 200 len: 1349 microversion: 2.21 time: 0.246621 Oct 10 11:08:04.580231 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2708/5298] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:04 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 1349 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:04.721208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:04.723838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:04.734822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.735599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.736510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.738273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.739195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.740018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.745719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b742113-2e45-430a-93d7-25f4eb09f27e", "tag": "fd39165a-e78c-49d0-9fa3-56b153570da8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:04.776343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.778776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.780156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.805196 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] Creating event network-changed:fd39165a-e78c-49d0-9fa3-56b153570da8 for instance 6b742113-2e45-430a-93d7-25f4eb09f27e on n-h2-860687-2 Oct 10 11:08:04.812780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9267be35-f962-4ce2-bbd2-f1be8dcf5a81 req-19912b7d-00aa-479a-8669-dad26ee02e05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449605 Oct 10 11:08:04.814301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2591/5299] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:08:04.845889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:04.846457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:04.866670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.867228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.867679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:04.868409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:04.868878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:04.874982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.139101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:05.150069 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e95b2d9-bcaa-4146-8771-0e96266d9feb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.435220 Oct 10 11:08:05.152942 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2709/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:04 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:05.406609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:05.417405 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c6cf150-8232-4897-aab6-720c74f5b7a6 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.583147 Oct 10 11:08:05.418735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2592/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:04 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:05.616478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:05.624826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:05.636973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.638080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.638747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.639733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.640409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.641245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.663294 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] HTTP exception thrown: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Request method failure captured: Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 HTTP/1.1 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_0BC89gqtmHXh2GT4ChqZ_aPzgF5tGWFvkN9MvMzQRRwwS5ldCKQhhLLtRDOpNithK2qkGm8LaERyhgFLXlnzLpnKiVGcFuPpZMvUyNhF0wwuw-5HEJUNuSwjTTB1MyxjTywtdM8hKaChd8rm5AttB-95b-S8BvV_MINs68YR6vFfE Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1641831908044c3caa50bb82bd03d60d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1641831908044c3caa50bb82bd03d60d"}]}] Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7cf7e55c1014473790e1a7d1683021bc Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'efdd5e3c-0416-412b-b005-3a2954f92e27'} Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.665337 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Returning 404 to user: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed89d335-a48d-4638-a755-a8ea96298b21 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 404 len: 111 microversion: 2.21 time: 0.058553 Oct 10 11:08:05.669393 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2710/5302] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:05 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:08:05.677007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '.version_select at 0x7f6780cea040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:05.677931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:05.684923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.685495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.686214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.686976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.687525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.688013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.774363 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3a96581-dafa-49c5-966d-914501b8ca57 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.102678 Oct 10 11:08:05.775364 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2593/5303] 10.222.0.16 () {60 vars in 1337 bytes} [Mon Oct 10 11:08:05 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27/os-instance-actions => generated 611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:08:05.796211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:05.797007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:05.809729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.810235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.810676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.811414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.811871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.812297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.836652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] HTTP exception thrown: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Request method failure captured: Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 HTTP/1.1 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_0BC89gqtmHXh2GT4ChqZ_aPzgF5tGWFvkN9MvMzQRRwwS5ldCKQhhLLtRDOpNithK2qkGm8LaERyhgFLXlnzLpnKiVGcFuPpZMvUyNhF0wwuw-5HEJUNuSwjTTB1MyxjTywtdM8hKaChd8rm5AttB-95b-S8BvV_MINs68YR6vFfE Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1641831908044c3caa50bb82bd03d60d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1641831908044c3caa50bb82bd03d60d"}]}] Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7cf7e55c1014473790e1a7d1683021bc Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'efdd5e3c-0416-412b-b005-3a2954f92e27'} Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:08:05.839879 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.844730 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.847526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Returning 404 to user: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:08:05.848734 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c45595f8-e598-4f04-80ee-8692125e1204 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "DELETE /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 404 len: 111 microversion: 2.21 time: 0.056328 Oct 10 11:08:05.849639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2711/5304] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:08:05 2022] DELETE /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:08:05.857869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:05.858810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] [instance: efdd5e3c-0416-412b-b005-3a2954f92e27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:05.870582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.871101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.871486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.872204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:05.872668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:05.873099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:05.900810 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] HTTP exception thrown: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Request method failure captured: Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 HTTP/1.1 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_0BC89gqtmHXh2GT4ChqZ_aPzgF5tGWFvkN9MvMzQRRwwS5ldCKQhhLLtRDOpNithK2qkGm8LaERyhgFLXlnzLpnKiVGcFuPpZMvUyNhF0wwuw-5HEJUNuSwjTTB1MyxjTywtdM8hKaChd8rm5AttB-95b-S8BvV_MINs68YR6vFfE Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1641831908044c3caa50bb82bd03d60d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1641831908044c3caa50bb82bd03d60d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1641831908044c3caa50bb82bd03d60d"}]}] Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 1641831908044c3caa50bb82bd03d60d Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-790371165 Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7cf7e55c1014473790e1a7d1683021bc Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsV221TestJSON-790371165-project Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'efdd5e3c-0416-412b-b005-3a2954f92e27'} Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.905246 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. Oct 10 11:08:05.909909 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:05.915809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] Returning 404 to user: Instance efdd5e3c-0416-412b-b005-3a2954f92e27 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:08:05.916976 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb47e088-1b44-40c8-93ce-dbafc1d3d041 tempest-InstanceActionsV221TestJSON-790371165 tempest-InstanceActionsV221TestJSON-790371165-project] 10.222.0.16 "GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27" status: 404 len: 111 microversion: 2.21 time: 0.062888 Oct 10 11:08:05.917867 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2594/5305] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:05 2022] GET /compute/v2.1/servers/efdd5e3c-0416-412b-b005-3a2954f92e27 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:08:06.176985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:06.177867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:06.187096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:06.188199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:06.191597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:06.193791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:06.194809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:06.196638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:06.205987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:06.453544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:06.455420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:06.497130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:06.500472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:06.505469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:06.507449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:06.509383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:06.510366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:06.673139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:06.684429 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e884d1f8-4e00-4add-bb1b-e3173eca12f0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.512442 Oct 10 11:08:06.686270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2712/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:06 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:07.032142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:07.043323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50fc586b-4617-46c8-a1aa-759d806012bd tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.605920 Oct 10 11:08:07.047454 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2595/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:06 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:07.712755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:07.713371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:07.725803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:07.728276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:07.728923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:07.730700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:07.732303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:07.732970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:08.072779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:08.073407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:08.099701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:08.100216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:08.100667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:08.101397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:08.101862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:08.102298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:08.645746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:08.660793 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ce19d8fa-0409-4715-9832-116fb0cb9fcb tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.952116 Oct 10 11:08:08.666546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2713/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:07 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:08.754462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:08.777482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:08.787980 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b9f5ba9-eab6-43f5-b14b-c25c8b8c595b tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.718766 Oct 10 11:08:08.804969 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2596/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:08 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:09.204616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:09.205005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:09.216247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.216744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.217183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:09.217894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.218353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.227287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:09.258470 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2c320ca-341a-44ae-9b5f-65541ea0f329 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/ips" status: 200 len: 149 microversion: 2.1 time: 0.058862 Oct 10 11:08:09.259450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2714/5310] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:08:09 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:08:09.703549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:09.704684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:09.746910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.749737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.750497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:09.760190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.760918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.764762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:09.829597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:09.830355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:09.839370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.839876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.840325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:09.841046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:09.841513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:09.841950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:10.301488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:10.310629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05b76aa4-4708-4081-abbd-f056ae907bf0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.621623 Oct 10 11:08:10.322259 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2597/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:09 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:10.382150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:10.392487 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ba32119-c9ce-4c94-b08a-f8302155ee10 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.566619 Oct 10 11:08:10.397763 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2715/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:09 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:11.131412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b742113-2e45-430a-93d7-25f4eb09f27e", "name": "network-vif-plugged", "status": "completed", "tag": "fd39165a-e78c-49d0-9fa3-56b153570da8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:11.157712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:11.161894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:11.171062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:11.172121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:11.174527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:11.216884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] Creating event network-vif-plugged:fd39165a-e78c-49d0-9fa3-56b153570da8 for instance 6b742113-2e45-430a-93d7-25f4eb09f27e on n-h2-860687-2 Oct 10 11:08:11.228164 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2ceccd43-5abe-4649-a058-1102ae7186d5 req-c6d1d8cc-6873-4689-a682-d1fa644eb2cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102013 Oct 10 11:08:11.259796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2598/5313] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:11.344562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:11.345350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:11.357423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:11.362855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:11.382801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:11.388082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:11.391354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:11.398154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:11.411772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:11.438336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:11.448039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:11.459141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:11.460270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:11.460935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:11.464987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:11.465873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:11.466531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:12.140341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:12.149107 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80fe64df-d680-4f9a-8726-dea6c7a0ee73 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.808508 Oct 10 11:08:12.159165 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2716/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:11 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:12.162161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:12.166406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a50aeb-8f81-4bcc-a682-99f5dd55c98b"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:12.176337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:12.182647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:12.185652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:12.186326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:12.186923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:12.187884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:12.188527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:12.189110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:12.199831 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-986fbd63-fccc-43c8-a84a-8790230075a5 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1314 microversion: 2.1 time: 0.776852 Oct 10 11:08:12.201075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2599/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:11 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:13.074773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1d8599c0-e436-4c10-9309-b220ab687f27 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914037 Oct 10 11:08:13.075497 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2717/5316] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:08:12 2022] POST /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:13.181478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:13.183913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:13.195772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.197560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.198379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:13.199390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.202665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.202665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:13.230043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:13.230916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:13.241161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.241794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.242979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:13.244017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.244955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.245581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:13.651563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:13.670635 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52212bac-1f2a-4ab6-8737-c5a10dbe5f91 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.493452 Oct 10 11:08:13.671729 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2600/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:13 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:13.719937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:13.734519 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f53d7582-8433-44bb-968a-38ae6169c8d4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1463 microversion: 2.1 time: 0.510294 Oct 10 11:08:13.738541 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2718/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:13 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1463 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:13.770905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45dbebdd-66c0-456b-a3dc-7de88e09cbfb", "device": "/dev/sdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:13.782020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:13.802677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.803492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.804100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:13.804965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:13.805847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:13.806431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:14.434974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1789c75-9f1d-4915-ba1f-282a22e459c8 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "POST /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672632 Oct 10 11:08:14.436907 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2601/5319] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:08:13 2022] POST /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:14.703861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:14.704479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:14.735610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:14.736701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:14.738135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:14.739188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:14.739917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:14.740613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:15.058482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:15.067560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04fedd33-69e6-4f0f-9483-9c05b2e11b79 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.371116 Oct 10 11:08:15.068127 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2719/5320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:14 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:15.583316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1123238977", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:15.678216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:15.678963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:15.681506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:15.683978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:15.686479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:15.721174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:15.722117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:15.722781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:15.723940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:15.724873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:15.725527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:15.776108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Getting quotas for project f5d6fead85e34f61a001234a0e850289. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:15.782302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Getting quotas for user 668cafbf8b274fa796f2591544ccf80a and project f5d6fead85e34f61a001234a0e850289. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:15.798936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:08:15.801797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:08:15.869149 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a8f0027-2708-42b4-9f55-41e0d678b8af tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.452110 Oct 10 11:08:15.870851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2602/5321] 10.222.0.16 () {62 vars in 1188 bytes} [Mon Oct 10 11:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 11:08:15.882444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:15.883446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:15.994526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:16.007340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:16.015342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:16.017245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cf32372b-f706-4dff-97c5-db8ce8590de9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1278 microversion: 2.57 time: 0.138865 Oct 10 11:08:16.022257 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2720/5322] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:15 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:16.097488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:16.098209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:16.113179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:16.113786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:16.114332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:16.115186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:16.115723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:16.116258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:16.467464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:16.482410 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68eb75b3-5d6a-4ad0-8edf-ee3e74a9b776 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1506 microversion: 2.1 time: 0.390379 Oct 10 11:08:16.483790 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2603/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:16 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:17.062630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:17.064279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:17.080253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:17.081513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:17.083511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:17.087745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:17.088563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:17.089335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:17.199532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:17.213799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:17.215688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:17.218020 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7f019a1-3bdb-448c-a7e5-cd7b6fccb570 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1274 microversion: 2.57 time: 0.170711 Oct 10 11:08:17.232595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2721/5324] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:17 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:17.513149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:17.520023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:17.538778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:17.541829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:17.543469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:17.546389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:17.547648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:17.548331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:17.860587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:17.872894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b5d91c4-bbc4-4fb9-ab8f-d9c68c453db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1486 microversion: 2.1 time: 0.365039 Oct 10 11:08:17.873807 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2604/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:17 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1486 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:18.071508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-96192906", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:18.149862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] validate_networks() for [('4daba597-d3fa-481c-a528-4b8ec5827c7c', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:08:18.260863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:18.261492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:18.268564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:18.269349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:18.269957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:18.270867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:18.271359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:18.271985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:18.381416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:18.391250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:18.396804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:18.398006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a410e59f-662f-4fb2-af4b-5efb791ccac9 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1336 microversion: 2.57 time: 0.141129 Oct 10 11:08:18.398579 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2605/5326] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:18 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:18.937268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:18.937765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:18.938419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:18.939895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:18.940497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:18.952479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:18.953210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:18.953811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:18.954713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:18.955941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:18.956729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:19.005377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Getting quotas for project 5f198ae6cb3c40caa38c8ebd33612353. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:19.013454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Getting quotas for user e260920cbbcd4cb8b6845ca898e396d6 and project 5f198ae6cb3c40caa38c8ebd33612353. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:19.043174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:08:19.045962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:08:19.105213 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b329cf42-e65b-4443-935f-a759d9e941ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.039171 Oct 10 11:08:19.106190 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2722/5327] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:08:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:08:19.117764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af6ee123-0cc0-4f61-82ff-bc0cb4d02c42 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:19.118589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af6ee123-0cc0-4f61-82ff-bc0cb4d02c42 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:19.215798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af6ee123-0cc0-4f61-82ff-bc0cb4d02c42 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:19.225425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af6ee123-0cc0-4f61-82ff-bc0cb4d02c42 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1212 microversion: 2.1 time: 0.110037 Oct 10 11:08:19.226382 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2606/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:19 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:19.431061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:19.431624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:19.441188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:19.441695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:19.442144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:19.442864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:19.443373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:19.443809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:19.574637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:19.592273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:19.593744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:19.594912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f60d285-a70e-402c-b432-a262b9d42a89 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1336 microversion: 2.57 time: 0.170467 Oct 10 11:08:19.596221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2723/5329] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:19 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1336 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:20.252031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:20.253042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:20.260714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.261600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.262294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:20.263331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.264046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.264707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:20.333255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:20.342348 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-151905ba-cff6-45a6-8a55-872a199022a3 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1264 microversion: 2.1 time: 0.094259 Oct 10 11:08:20.342950 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2607/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:20 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1264 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:20.628304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:20.629553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:20.662822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.663717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.664466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:20.665381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.666859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.667680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:20.918333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:20.939749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:20.941404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:20.942626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ba9a608-37d1-4933-b443-5449a408aadc tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1357 microversion: 2.57 time: 0.320469 Oct 10 11:08:20.946499 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2724/5331] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:20 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:20.978866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:20.983107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:20.991279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.992070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.992911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:20.993835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:20.994473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:20.995093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.225245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:21.227571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:21.228138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:21.228568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:21.228999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:21.367704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:21.368615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:21.379219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.385781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.387792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.390026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.392005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.393261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.399298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:21.422052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.422740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.423246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.424943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.425419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.425857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.494140 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50befa56-d1e7-48e2-8e93-328f8d2f653d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "POST /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8/action" status: 202 len: 1138 microversion: 2.57 time: 0.520977 Oct 10 11:08:21.507644 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2608/5332] 10.222.0.16 () {62 vars in 1320 bytes} [Mon Oct 10 11:08:20 2022] POST /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8/action => generated 1138 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 11:08:21.526854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:21.529656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:21.555714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:21.559818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.560340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.563671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.564540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:21.567103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:21.567879 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-753a3ee9-9b4b-480a-9314-30905a9c93bf tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1270 microversion: 2.1 time: 0.204156 Oct 10 11:08:21.569234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:21.569980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2725/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:21 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:21.763950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:21.772596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:21.774060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:21.775324 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98679463-a086-4273-bcac-3e32a1692da2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.252355 Oct 10 11:08:21.784965 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2609/5334] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:21 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:22.592866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:22.593601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:22.608057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:22.613948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:22.614741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:22.616076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:22.616770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:22.617696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:22.806328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:22.808276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:22.811808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:22.815774 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-309e068e-85bf-4855-a3d8-432e17f71e54 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.226475 Oct 10 11:08:22.830738 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2726/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:22 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:22.835047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:22.835627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:22.836897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:22.838230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:22.838758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:22.839461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:22.917010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:22.927458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:22.929217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:22.930776 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a092016c-9409-49a7-bafd-f60d9e5dbbc3 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.132800 Oct 10 11:08:22.931980 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2610/5336] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:22 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:23.536143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaeb5082-290e-4dca-b08a-5ea432fa6930", "tag": "c923f80a-c578-4347-8d29-bcc006e65729"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:23.563058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:23.566074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:23.567346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:23.602993 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] Creating event network-changed:c923f80a-c578-4347-8d29-bcc006e65729 for instance aaeb5082-290e-4dca-b08a-5ea432fa6930 on n-h1-860687-2 Oct 10 11:08:23.609606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-78aeaeba-cc91-429b-8f8c-f3b3bfd86f45 req-5e9a6560-7277-440c-b1b1-ed9d1ffeff3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085218 Oct 10 11:08:23.613102 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2727/5337] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:23.845009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:23.846495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:23.864524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:23.866308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:23.867060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:23.868102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:23.868840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:23.869536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:23.959430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:23.961583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:23.972944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:23.975097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:23.977006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:23.979707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:23.981255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:23.983334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:24.184221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:24.199133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:24.200872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:24.206589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1732a3f-f4b9-4640-ab8b-f4d15fe8d4e1 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.250680 Oct 10 11:08:24.210284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2728/5338] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:23 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:24.280759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:24.295704 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6130c213-2bdb-4efa-b7c7-96f1fa4a0db0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.455509 Oct 10 11:08:24.311044 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2611/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:23 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:25.236446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:25.237060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:25.255272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:25.255772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:25.256218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:25.256937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:25.257399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:25.257824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:25.320064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:25.320678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:25.342077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:25.345703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:25.347908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:25.355860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:25.359510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:25.360208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:25.392916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:25.405188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:25.409896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:25.412568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:25.413814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bafabffd-1763-4bee-91d9-89868cfe786a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.181353 Oct 10 11:08:25.414467 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2729/5340] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:25 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:25.661185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:25.669150 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6745eb2-cd74-4599-a072-b4786f24028a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.353142 Oct 10 11:08:25.673156 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2612/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:25 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:26.444424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:26.444836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:26.451538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:26.452036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:26.452478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:26.453156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:26.453616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:26.454042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:26.459557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:26.530547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:26.540070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:26.541771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:26.543165 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-792d1f65-5faf-446e-8f45-248bb160d93f tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.102918 Oct 10 11:08:26.544039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2730/5342] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:26 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:26.696432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:26.705234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:26.705941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:26.729640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:26.732115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:26.733690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:26.734818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:26.736576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:26.739462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:27.094189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:27.115633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a703c18b-b9c2-43c4-b24b-768182d3663e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.419959 Oct 10 11:08:27.127032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2613/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:26 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:27.570107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:27.570734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:27.583920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:27.584911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:27.585366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:27.586095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:27.586567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:27.587079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:27.666740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:27.677058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:27.678852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:27.680300 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c496bd3a-c76a-41e5-bd09-9ff7f97eed93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.114283 Oct 10 11:08:27.681413 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2731/5344] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:27 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:28.143434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:28.145858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:28.157302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:28.160603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:28.161995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:28.164127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:28.164971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:28.165697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:28.353334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:28.363156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cdf05cd-33e6-4c87-ba5d-b06699631660 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.225364 Oct 10 11:08:28.379486 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2614/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:28 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:28.708156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:28.709847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:28.725249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:28.736396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:28.737416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:28.738439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:28.739151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:28.739840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:28.885714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:28.900182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:28.902067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:28.910407 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0c6c867c-a388-4fe8-9530-47c577367846 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.206503 Oct 10 11:08:28.911573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2732/5346] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:28 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:29.211577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaeb5082-290e-4dca-b08a-5ea432fa6930", "name": "network-vif-plugged", "status": "completed", "tag": "c923f80a-c578-4347-8d29-bcc006e65729"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:29.223854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:29.226793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:29.228172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:29.228918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:29.243040 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] Creating event network-vif-plugged:c923f80a-c578-4347-8d29-bcc006e65729 for instance aaeb5082-290e-4dca-b08a-5ea432fa6930 on n-h1-860687-2 Oct 10 11:08:29.249310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cbec76e2-f164-4834-be8f-404ff2713803 req-a8fab5f8-e580-4921-a362-5e738c0f3e31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117864 Oct 10 11:08:29.250978 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2615/5347] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:29.400203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:29.401385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:29.404495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:29.405521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:29.412905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:29.413957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:29.414716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:29.415616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:29.416228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:29.416813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:29.688942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:29.707701 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69287190-7c1a-4cac-8837-6a6a24e65608 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1312 microversion: 2.1 time: 0.312255 Oct 10 11:08:29.710697 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2733/5348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:29 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:29.943613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:29.945025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:29.963145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:29.964874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:29.966006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:29.967613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:29.971239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:29.971879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:30.097802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:30.109050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:30.111123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:30.112682 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12f7dae0-dd8e-4b45-ac6f-f69aa946d84d tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.178479 Oct 10 11:08:30.115132 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2616/5349] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:29 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:30.245141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85466601-fd96-4f41-825c-caabe1a16f3c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: .version_select at 0x7f67776d9940>, body: {"keypair": {"name": "tempest-keypair-48177295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+VHyVoWKyIehPTd6oic9Rqo/DFbpiWCbZmcZQW6imW6DkPiLx7UBXO7U4vBQUA0zCj7dBF7Zmr08pX28iMQEU64l8BQ+UsaZc2nxbumw2gmZbiH3/VZKzjZZhb6tOWw=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:30.287574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-85466601-fd96-4f41-825c-caabe1a16f3c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:30.299726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-85466601-fd96-4f41-825c-caabe1a16f3c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:30.379702 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85466601-fd96-4f41-825c-caabe1a16f3c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.143759 Oct 10 11:08:30.402991 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2734/5350] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:08:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:08:30.824894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:30.826832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:30.843324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:30.844127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:30.845861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:30.846778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:30.847755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:30.848851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.082513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:31.093985 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f11c7d85-2964-4f5d-bda6-ccc4ec93c06d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1499 microversion: 2.1 time: 0.273313 Oct 10 11:08:31.094924 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2617/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:30 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1499 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:31.123976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:31.128957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:31.135781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.136713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.137553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.138609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.139378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.140034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.144058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:31.144767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:31.163198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.163719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.164166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.168680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.170277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.173153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.175137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lazy-loading 'flavor' on Instance uuid aaeb5082-290e-4dca-b08a-5ea432fa6930 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:08:31.342158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:31.360842 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-669b42bc-209f-4c2c-bc97-b05064fda3ae tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "POST /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930/action" status: 200 len: 32 microversion: 2.1 time: 0.241745 Oct 10 11:08:31.362239 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2735/5352] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:08:31 2022] POST /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 11:08:31.373424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:31.377297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:31.378294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:31.384186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:31.385876 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43d626c5-554f-44e8-8950-55a5ae0268ab tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.249882 Oct 10 11:08:31.397991 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2618/5353] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:31 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:31.398732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.400447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.400907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.402385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:31.403369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:31.403809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:31.615237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:31.625427 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ff8ab13-2af5-4b8a-9a61-94ccb647d583 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.257377 Oct 10 11:08:31.628653 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2736/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:31 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:32.416628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:32.418501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:32.423450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:32.453042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:32.456012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:32.456794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:32.461903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:32.462408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:32.466165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:32.594716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:32.609180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:32.612792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:32.618083 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d97de7c-0475-4b08-815d-af6a70ee2079 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.206810 Oct 10 11:08:32.620976 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2619/5355] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:32 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:32.659369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:32.660901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:32.684795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:32.685760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:32.686659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:32.688041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:32.689984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:32.690564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:32.904672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:32.918238 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1d2c2ea-c590-458c-8e61-0d7798b3b9f7 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.263596 Oct 10 11:08:32.919789 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2737/5356] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:32 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:33.394583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-612029761", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c66f5f-64f9-415c-b2e7-430e78e4a9d5"}], "security_groups": [{"name": "tempest-securitygroup--2050872389"}], "key_name": "tempest-keypair-48177295", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:33.529219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] validate_networks() for [('21c66f5f-64f9-415c-b2e7-430e78e4a9d5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:08:33.649227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:33.649984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:33.660866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:33.661580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:33.662479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:33.664079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:33.668759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:33.669341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:33.758403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:33.768096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:33.769512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:33.770788 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43adb516-55d5-4ec4-ac86-4accdfd8db4a tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.126190 Oct 10 11:08:33.784314 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2738/5357] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:33 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:33.946107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:33.947075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:33.954167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:33.955944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:33.956860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:33.958108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:33.959029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:33.960483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:34.047297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:34.047987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:34.049393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:34.050000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:34.051035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:34.066799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:34.067322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:34.067948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:34.068866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:34.069489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:34.070094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:34.095800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:34.101767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:34.124394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:34.125496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:08:34.129106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:08:34.134381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d4f4940-35ab-4a93-bd4b-230a1d1b5bd0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.191857 Oct 10 11:08:34.154281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2739/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:33 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:34.218185 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43661e01-325b-49ea-beea-6ff02162fb6c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.828557 Oct 10 11:08:34.226969 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2620/5359] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:08:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:08:34.231790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cdc78df4-574f-4b9e-9d6f-d5026597c55d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:34.232651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cdc78df4-574f-4b9e-9d6f-d5026597c55d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:34.320644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cdc78df4-574f-4b9e-9d6f-d5026597c55d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:34.328973 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cdc78df4-574f-4b9e-9d6f-d5026597c55d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1239 microversion: 2.1 time: 0.101141 Oct 10 11:08:34.338854 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2740/5360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:34 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:34.804369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:34.804991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:34.835141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:34.835694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:34.836144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:34.836998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:34.837797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:34.838232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:34.937577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:34.949030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:34.950697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:34.952087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30ba406d-f781-4d2c-a8f1-996d260d5669 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.158225 Oct 10 11:08:34.953366 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2621/5361] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:34 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:35.170150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:35.170781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:35.183778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:35.184358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:35.184784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:35.185565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:35.185978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:35.186416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:35.353889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:35.354518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:35.374726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:35.375281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:35.375721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:35.384301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:35.384980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:35.385649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:35.396919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:35.408349 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c56b646-3872-44a4-af0a-67c37aacb966 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.242985 Oct 10 11:08:35.411801 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2741/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:35 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:35.526078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:35.533662 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de5406a0-9264-4d2f-b451-0e6705bbc763 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1291 microversion: 2.1 time: 0.184309 Oct 10 11:08:35.534663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2622/5363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:35 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1291 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:35.980333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:35.980970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:36.005050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.005563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.006028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.006728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.007440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.008036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.138465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:36.148380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:36.153967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:36.161723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fac28685-17b5-4cdb-92f3-25cee7f461c2 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.185245 Oct 10 11:08:36.162901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2742/5364] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:35 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:36.437566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:36.438212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:36.446637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.448057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.448716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.449664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.450282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.451042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.565856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:36.567507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:36.597239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.601880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.602659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.603588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:36.614944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:36.616309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:36.777164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:36.789784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92207e42-3e05-4d92-9524-f169e36538bd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1297 microversion: 2.1 time: 0.235071 Oct 10 11:08:36.790295 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2743/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:36 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1297 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:36.804905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:36.816869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d29e6f9e-809f-4bc0-b0ff-001169e668d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.385650 Oct 10 11:08:36.828032 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2623/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:36 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:37.195622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:37.196716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:37.210126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.213511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.214283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:37.215432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.216161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.217754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:37.356182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:37.368356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:37.370962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:37.384083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b1dc9e0-484a-41df-848c-6f91d40f2a52 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.184372 Oct 10 11:08:37.384990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2744/5367] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:37 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:37.821164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:37.821964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:37.831883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.832848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.833524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:37.834896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.835617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.836388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:37.858420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:37.859540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:37.874394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.875147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.875686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:37.877592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:37.880127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:37.880693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:38.113960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:38.122273 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f8704b2-80a3-4b3d-8656-9baf959a55d0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.268178 Oct 10 11:08:38.127559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2745/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:37 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:38.177065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:38.191949 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2b8c694-d32e-443c-b25b-e42529e7127e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1365 microversion: 2.1 time: 0.374691 Oct 10 11:08:38.194264 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2624/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:37 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:38.298269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4b87f5-f7c0-4181-a618-61476e6fd2f8", "tag": "69c5999e-fb68-4403-94d2-71b0ead087ae"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:38.327810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:38.328321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:38.330880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:38.352323 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] Creating event network-changed:69c5999e-fb68-4403-94d2-71b0ead087ae for instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 on n-h1-860687-2 Oct 10 11:08:38.365687 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f705dffd-cf23-4283-87ac-b2bed4af47f5 req-6a0b3633-3f9d-44d3-b408-cafdab70bc6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073256 Oct 10 11:08:38.366575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2746/5370] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:38.423459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:38.424132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:38.438143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:38.441901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:38.442433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:38.448804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:38.450502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:38.451548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:38.546489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:38.557863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:38.559358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:38.560559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3771591b-582b-41fe-a12b-a599e8be5f96 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.142572 Oct 10 11:08:38.572301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2625/5371] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:38 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:39.154104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:39.155961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:39.164801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.165546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.166310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.167237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.167852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.168434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.196023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:39.226567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:39.227957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:39.243194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.247761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.249214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.252960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.253690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.255285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.515647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:39.525811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f4cae52a-4abd-4261-a6f3-d758175a2aed tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.376303 Oct 10 11:08:39.529636 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2747/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:39 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:39.591508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:39.592389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:39.603791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.604532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.606800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.607739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:39.610003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:39.610847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:39.615483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:39.645034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dff9164-3c00-4c77-85e6-036370a8e4f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1365 microversion: 2.1 time: 0.430777 Oct 10 11:08:39.660847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2626/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:39 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:39.741692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:39.754267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:39.756464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:39.768531 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f556cf95-129c-4bad-8d0a-fca130c9ca20 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.181251 Oct 10 11:08:39.793621 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2748/5374] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:39 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:40.553302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:40.553924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:40.561389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.562192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.562815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:40.564827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.565463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.566273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:40.672172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:40.673902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:40.691152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.691974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.692647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:40.693612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.694294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.694948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:40.868158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:40.877450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99cb645a-caab-4144-9666-13439b1c080c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.327857 Oct 10 11:08:40.882836 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2627/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:40 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:40.904435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:40.905304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:40.921642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.923692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.924343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:40.927532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:40.928562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:40.929179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:41.074176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:41.092826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:41.098982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ad482bd-02df-4016-b914-3dffeca5a14a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1365 microversion: 2.1 time: 0.430565 Oct 10 11:08:41.100516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2749/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:40 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:41.105485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:41.106665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:41.107878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f73e068b-5eae-4ef3-9440-ee9773aecd93 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.210987 Oct 10 11:08:41.108611 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2628/5377] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:40 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:41.919712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:41.920878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:41.937238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:41.938170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:41.939783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:41.940844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:41.941587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:41.942648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.106118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:42.114512 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be96be90-a1fe-4adb-b105-5477e5e8e7a1 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.208048 Oct 10 11:08:42.120052 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2750/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:41 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:42.143937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:42.148281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:42.154811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:42.155702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:42.164699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:42.165477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:42.166231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.167165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:42.169167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:42.169685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:42.171220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.172454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:42.175921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.176970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:42.177697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:42.178453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.340957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:42.350523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:42.357939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:42.357939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13927f9e-f460-48cd-ae19-680580eeb596 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.226298 Oct 10 11:08:42.359402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2629/5379] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:42 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:42.485707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:42.500328 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea5349cb-bd93-4d5a-87eb-4c73f53744dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1365 microversion: 2.1 time: 0.356194 Oct 10 11:08:42.500600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2751/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:42 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:42.902146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4b87f5-f7c0-4181-a618-61476e6fd2f8", "name": "network-vif-plugged", "status": "completed", "tag": "69c5999e-fb68-4403-94d2-71b0ead087ae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:42.914579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:42.914893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:42.917501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:42.929731 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] Creating event network-vif-plugged:69c5999e-fb68-4403-94d2-71b0ead087ae for instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 on n-h1-860687-2 Oct 10 11:08:42.938447 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c891edb0-4373-4707-a586-aac7c0ca8c8e req-d0660252-f330-4740-9877-b17a1e207e26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039779 Oct 10 11:08:42.942480 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2630/5381] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:43.146218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:43.146725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:43.153776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:43.155417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.156156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.156770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.158182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.158804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.161284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.363910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:43.386898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:43.387939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-549add1d-9252-48f0-be29-0c8fb88e8fcc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.245103 Oct 10 11:08:43.390235 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2752/5382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:43 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:43.409018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:43.425570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.428174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.428174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.428174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.428174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.430248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.439451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:43.525333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:43.526065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:43.538472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.538973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.539442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.540154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:43.540615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:43.541042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:43.577750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:43.596988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:43.619848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:43.621581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f18f8a52-b876-44cf-94d2-f18b5a48ea08 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.239802 Oct 10 11:08:43.623304 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2631/5383] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:43 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 11:08:43.865966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:43.879626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8430be24-6988-4b82-967d-9f0a1ccfa949 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1365 microversion: 2.1 time: 0.357698 Oct 10 11:08:43.891522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2753/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:43 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:44.415123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:44.415758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:44.417558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:44.418232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:44.435422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.437715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.441164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:44.442167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.442860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.443658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:44.650080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:44.650698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:44.663310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:44.665338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.667218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.667840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:44.668742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.672064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.672764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:44.730846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:44.747554 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1771792-bbae-4c5d-a9d3-fe7abcd330ab tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.337999 Oct 10 11:08:44.751805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2632/5385] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:44 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:44.916944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:44.924689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:44.935564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.937135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.937874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:44.939579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:44.941670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:44.942353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:45.326451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:45.341027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:45.346274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:45.347532 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b3361da-fa4e-4416-a674-d4b472a9a544 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.701553 Oct 10 11:08:45.348107 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2754/5386] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:44 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:45.422433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:45.431620 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e76a6f2-3ad0-4c76-bd38-1fa50365b15b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1555 microversion: 2.1 time: 0.518775 Oct 10 11:08:45.432706 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2633/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:44 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1555 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:45.465330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:45.466159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:45.474060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:45.474943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:45.475839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:45.476502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:45.477181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:45.477824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:45.621137 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9baad3ad-2ef6-469d-b7e3-c23da58f17f8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159645 Oct 10 11:08:45.622126 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2755/5388] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:08:45 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:45.790882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:45.791534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:45.802693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:45.803995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:45.803995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:45.808305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:45.809035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:45.809748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:46.175400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:46.184714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0843c0a0-0625-4ccc-b6c0-0730d10e9863 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.398489 Oct 10 11:08:46.188672 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2634/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:45 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:46.396973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:46.398112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:46.410582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:46.411551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:46.412181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:46.412844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:46.413428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:46.414474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:46.534331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:46.549940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:46.556507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:46.558174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-77998e19-2324-49b6-89be-de07bac38798 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.175555 Oct 10 11:08:46.570300 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2756/5390] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:46 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:47.213171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:47.213779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:47.228503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:47.228503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:47.228503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:47.228503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:47.228503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:47.229018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:47.242576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4b87f5-f7c0-4181-a618-61476e6fd2f8", "tag": "69c5999e-fb68-4403-94d2-71b0ead087ae"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:47.268110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:47.271316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:47.271866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:47.306757 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] Creating event network-changed:69c5999e-fb68-4403-94d2-71b0ead087ae for instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 on n-h1-860687-2 Oct 10 11:08:47.315786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-defd56b0-f86f-4fec-9c06-a7eb775ae53b req-472771c2-76cc-4590-9c40-511f41aad736 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076812 Oct 10 11:08:47.316836 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2757/5391] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:47.549299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:47.560991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7794737-4b5f-4607-b55e-1e18a3371202 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.352550 Oct 10 11:08:47.569539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2635/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:47 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:47.600415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:47.601719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:47.622990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:47.623516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:47.623977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:47.624686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:47.627218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:47.631889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:47.793120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:47.807484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:47.810681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:47.811942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3932804c-8912-4e98-9d81-3eac2dd7f376 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1366 microversion: 2.57 time: 0.216155 Oct 10 11:08:47.820298 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2758/5393] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:47 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:48.591653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:48.592275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:48.603304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:48.604037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:48.604667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:48.605536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:48.606327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:48.606898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:48.843628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:48.845411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:48.855457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:48.858119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:48.858808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:48.861508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:48.862279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:48.863166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:49.145806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:49.161420 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5289a783-b53a-47d5-86d6-16a4c5cf9b5f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.573158 Oct 10 11:08:49.164787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2636/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:48 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:49.174482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:49.201211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:49.202681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:49.213601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab9cc9fe-7234-446c-9889-fe5b5904c9f6 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1372 microversion: 2.57 time: 0.373990 Oct 10 11:08:49.215152 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2759/5395] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:48 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1372 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:50.191937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:50.192567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:50.221788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:50.225886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:50.228620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:50.229563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:50.233510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:50.234231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:50.246551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:50.247454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:50.278750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:50.281758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:50.282366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:50.285345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:50.287972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:50.288435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:50.551029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:50.572991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:50.579801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:50.581150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac1bdc35-d84c-41d6-b476-459769cf7c10 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1372 microversion: 2.57 time: 0.339402 Oct 10 11:08:50.581769 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2760/5396] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:50 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:50.786564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:50.831930 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc6951fd-a59e-4c69-9f7b-d24c4daed98a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.644261 Oct 10 11:08:50.835338 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2637/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:50 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:51.621556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:51.622202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:51.652632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.653147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.653603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:51.654339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.654806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.655267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:51.757194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:51.775556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:51.779719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:51.783860 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4da1f0c4-75c4-44ee-8836-15b4ad88be17 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1357 microversion: 2.57 time: 0.170601 Oct 10 11:08:51.788082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2761/5398] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:51 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:51.820406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:51.821585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:51.834948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.835799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.838517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:51.839528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.840210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.840864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:51.857079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:51.857948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:51.872585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:08:51.875634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.876366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.876988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:51.877995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:51.878652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:51.879413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:52.016546 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-121d7c92-3538-45f9-af8b-f0ff295cdb63 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "DELETE /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 204 len: 0 microversion: 2.57 time: 0.199558 Oct 10 11:08:52.021282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2638/5399] 10.222.0.16 () {60 vars in 1280 bytes} [Mon Oct 10 11:08:51 2022] DELETE /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 11:08:52.037584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:52.038487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:52.049640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:52.050491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:52.051217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:52.053622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:52.054523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:52.055525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:52.184966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:52.202556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:52.204705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:52.209221 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6b139d2-011e-440e-b3f0-566f49d2fe47 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1363 microversion: 2.57 time: 0.179750 Oct 10 11:08:52.212239 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2639/5400] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:52 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:52.248317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:52.269717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27b6d53e-1429-407d-a446-26b08fb83f00 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.416516 Oct 10 11:08:52.270744 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2762/5401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:51 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:53.240626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:53.241851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:53.253359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:53.258608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:53.261392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:53.262365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:53.264340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:53.264979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:53.294775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:53.295631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:53.310838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:53.312937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:53.315247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:53.318283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:53.319054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:53.322567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:53.412605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:53.421455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:53.423744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:53.424977 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c35f7bd3-718b-49fd-83c4-77ab5e7d5e04 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1363 microversion: 2.57 time: 0.188898 Oct 10 11:08:53.443893 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2640/5402] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:53 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:53.583957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:53.593506 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6222e32-5168-4724-8982-ac5e99abec5e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.304419 Oct 10 11:08:53.595372 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2763/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:53 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:08:53.953017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fd6aa96-fba3-493f-aac6-2ffc484d2de1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: .version_select at 0x7f6777808040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2143178125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/jZVZ5DV7yf6/zj/EMZrzWl3nTv3+90RoPEL8ropn2qhX6rwtDlGodZGFxmsZzkDe/p73M2OrDwGxyJZC1DMj1u68KpxPqdPlVxY/55vV7hN9KHOkIDGnfaucw4xOEHw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:53.994881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2fd6aa96-fba3-493f-aac6-2ffc484d2de1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:54.010316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2fd6aa96-fba3-493f-aac6-2ffc484d2de1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:54.061088 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fd6aa96-fba3-493f-aac6-2ffc484d2de1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.111961 Oct 10 11:08:54.062635 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2641/5404] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:08:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:54.459681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:54.461030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:54.471264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:54.472106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:54.472743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:54.474378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:54.475075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:54.475704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:54.552912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:54.553369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:54.554353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:54.555066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lazy-loading 'fault' on Instance uuid 977922e3-ce41-4320-b8c8-a57c74c2d3d8 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:08:54.625122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:54.628156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:54.637762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:54.638343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:54.638985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:54.639753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:54.640271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:54.640712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:54.660150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:54.665940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:08:54.674196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:54.676246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '668cafbf8b274fa796f2591544ccf80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d6fead85e34f61a001234a0e850289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:54.677704 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e9ce3bb-8b39-474e-bb4f-aea41cf38222 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 200 len: 1368 microversion: 2.57 time: 0.223101 Oct 10 11:08:54.678770 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2764/5405] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:54 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 11:08:54.967051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:54.976786 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fad93a6-ebee-4602-86af-efb8119ace52 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.361292 Oct 10 11:08:54.978094 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2642/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:54 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:55.614824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1016447516", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "a75fe50b-7122-43ea-8e1b-9003b62afa70"}], "key_name": "tempest-TestNetworkBasicOps-2143178125", "security_groups": [{"name": "tempest-secgroup-smoke-1049087756"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:08:55.709644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:55.710409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] [instance: 977922e3-ce41-4320-b8c8-a57c74c2d3d8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:55.723673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:55.724496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:55.725151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:55.726164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:55.726712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:55.727243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:55.744193 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] HTTP exception thrown: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. Oct 10 11:08:55.750915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] validate_networks() for [('a75fe50b-7122-43ea-8e1b-9003b62afa70', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Request method failure captured: Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 HTTP/1.1 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_0fu0q_nx2d38CgVEaAOisKSUZAgzB9Qf0Z40TZx2qaZtKPFvmtIfDmUmI4Q2ZmNVXfI-Ma34vXV-uwsJbCoFB3IT83FomFQoK25DHWNwS-9VEFcryapq6tq14ZFOVuuOEXP-9ck-nbFkNb34xaVUmZ3aq1iM5jV-bSxg3jSbQ7PFg Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.57 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: f5d6fead85e34f61a001234a0e850289 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerShowV257Test-2074515532 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5d6fead85e34f61a001234a0e850289"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5d6fead85e34f61a001234a0e850289", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5d6fead85e34f61a001234a0e850289"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5d6fead85e34f61a001234a0e850289"}]}] Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerShowV257Test-2074515532 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: f5d6fead85e34f61a001234a0e850289 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerShowV257Test-2074515532 Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerShowV257Test-2074515532-project Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 668cafbf8b274fa796f2591544ccf80a Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerShowV257Test-2074515532-project Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '977922e3-ce41-4320-b8c8-a57c74c2d3d8'} Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:08:55.755349 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] Returning 404 to user: Instance 977922e3-ce41-4320-b8c8-a57c74c2d3d8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d4ce198-24be-48e2-affd-9ec34ea51524 tempest-ServerShowV257Test-2074515532 tempest-ServerShowV257Test-2074515532-project] 10.222.0.16 "GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8" status: 404 len: 111 microversion: 2.57 time: 0.055338 Oct 10 11:08:55.760391 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2643/5407] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Oct 10 11:08:55 2022] GET /compute/v2.1/servers/977922e3-ce41-4320-b8c8-a57c74c2d3d8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 11:08:56.004489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:56.005419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:56.022247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:56.023347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:56.024788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:56.026441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:56.028655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:56.030978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:56.303167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:56.311033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c745ff36-df65-45ba-b476-ad61379292ec tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.313483 Oct 10 11:08:56.323416 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2644/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:55 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:56.508888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:08:56.509588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:08:56.510227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:08:56.510803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:08:56.511418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:08:56.532385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:56.533193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:56.533793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:56.534912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:56.535582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:56.536289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:56.565793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:08:56.572721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:08:56.589632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:08:56.592146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:08:56.674222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4afe16c9-44b2-4e3c-a05f-4586ded93122 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065086 Oct 10 11:08:56.682954 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2765/5409] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:08:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:08:56.689455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcec81e2-59bd-4a0b-b727-497ad65b2b4c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:56.690133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcec81e2-59bd-4a0b-b727-497ad65b2b4c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:56.852490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dcec81e2-59bd-4a0b-b727-497ad65b2b4c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:56.864640 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcec81e2-59bd-4a0b-b727-497ad65b2b4c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1249 microversion: 2.1 time: 0.176805 Oct 10 11:08:56.870566 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2645/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:56 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1249 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:57.341782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:57.345851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:57.379829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:57.386025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:57.392143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:57.396882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:57.429099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:57.433922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:57.681572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:57.696528 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.359185 Oct 10 11:08:57.697705 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2766/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:57 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:57.896592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:57.897633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:57.912110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:57.916766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:57.917429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:57.918649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:57.919507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:57.920147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:58.057104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:58.072038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1245 microversion: 2.1 time: 0.181500 Oct 10 11:08:58.073341 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2646/5412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:57 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1245 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:58.445261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:58.445261 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001330 Oct 10 11:08:58.445261 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2767/5413] 10.222.0.16 () {56 vars in 886 bytes} [Mon Oct 10 11:08:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 11:08:58.449565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:58.450677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d86dab50-933b-44f3-ad81-50d2719b7341 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001715 Oct 10 11:08:58.451093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2647/5414] 10.222.0.16 () {54 vars in 1035 bytes} [Mon Oct 10 11:08:58 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 10 11:08:58.458841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:58.460155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001681 Oct 10 11:08:58.460555 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2768/5415] 10.222.0.16 () {54 vars in 1041 bytes} [Mon Oct 10 11:08:58 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:08:58.468911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:58.469906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d3b30d89-84e6-4dde-8939-07e150345239 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001230 Oct 10 11:08:58.470462 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2769/5416] 10.222.0.16 () {56 vars in 886 bytes} [Mon Oct 10 11:08:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 11:08:58.724022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:58.724925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:58.732781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:58.733277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:58.733713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:58.734968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:58.735551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:58.735978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:59.081897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:59.096402 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-021d3e27-5688-4a5e-bb19-fba3795c9e1a tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.375981 Oct 10 11:08:59.097293 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2648/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:58 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:08:59.106753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:08:59.107513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:08:59.120165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:59.120736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:59.121286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:59.122237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:08:59.122910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:08:59.123451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:08:59.349292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:08:59.366283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-544a3d04-7275-403a-b4f8-5007803d92ec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1307 microversion: 2.1 time: 0.272105 Oct 10 11:08:59.366898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2770/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:08:59 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:00.121701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:00.122382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:00.137995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:00.142036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:00.142982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:00.144247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:00.147464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:00.148078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:00.396802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:00.398604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:00.418764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:00.421455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:00.423421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:00.426269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:00.427265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:00.430208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:00.868827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:00.889191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:00.894293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:00.895809 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a67e9714-d43b-4dcc-964a-32d548ed3dec tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.504618 Oct 10 11:09:00.898903 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2771/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:00 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:00.907340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ffd694c-e433-499a-ab85-fca65ac3ad63 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.788448 Oct 10 11:09:00.908303 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2649/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:00 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:01.155332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72c7eac5-7b67-4666-814a-4f632c062906 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Action: 'create', calling method: .version_select at 0x7f677766fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1602773264", "metadata": {"Type": "work"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:01.649764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72c7eac5-7b67-4666-814a-4f632c062906 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.657933 Oct 10 11:09:01.655063 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2772/5421] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 10 11:09:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 660 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 11:09:01.665158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-489d16b7-626d-448d-9111-db4a0fe03701 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6777870280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:01.737332 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-489d16b7-626d-448d-9111-db4a0fe03701 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 353 microversion: 2.1 time: 0.076781 Oct 10 11:09:01.738574 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2650/5422] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:01 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:01.849059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda8e305-1a7e-4f4c-8315-2f3f54809a3c", "tag": "966dfee5-31ca-4c5f-ab6c-9ca366e28f5e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:01.859808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:01.860682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:01.861320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:01.873112 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] Creating event network-changed:966dfee5-31ca-4c5f-ab6c-9ca366e28f5e for instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c on n-h2-860687-2 Oct 10 11:09:01.878417 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4f7f90a7-7126-4b4d-a734-a1fbff000515 req-9212e408-2436-4782-8cca-dd93f1087801 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Oct 10 11:09:01.879464 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2773/5423] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:01.945075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:01.946001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:01.946763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:01.947795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:01.972588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:01.973169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:01.973701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:01.974535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:01.975262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:01.975912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:01.976833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:01.977628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:01.981654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:01.982680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:01.983595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:01.984330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:02.449616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:02.457816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:02.469337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2656258-e6af-4c34-865c-d604f976ae8c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.551638 Oct 10 11:09:02.470569 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2651/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:01 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:02.479687 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30fd1a0e-91c4-470c-b839-701d16d1ea9f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1485 microversion: 2.1 time: 0.531203 Oct 10 11:09:02.481893 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2774/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:01 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1485 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:02.511086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:02.511747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:02.517897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:02.519797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:02.520384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:02.521186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:02.521992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:02.522527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:02.523114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:02.648733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92c89d64-428f-45e9-bb7f-0aa11e522272 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "POST /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930/action" status: 202 len: 0 microversion: 2.1 time: 0.143493 Oct 10 11:09:02.649465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2652/5426] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:09:02 2022] POST /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:09:02.659269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:02.660046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:02.673880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:02.675417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:02.676050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:02.677682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:02.680436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:02.681563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:02.754165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e87ef6b3-ca2d-46d2-bea9-695e36c4ce98 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6777870e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:02.846869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e87ef6b3-ca2d-46d2-bea9-695e36c4ce98 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 353 microversion: 2.1 time: 0.098346 Oct 10 11:09:02.847550 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2653/5427] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:02 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:02.957910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:02.969234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-356106bd-9fbd-4e64-8c01-2a0da672550f tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1493 microversion: 2.1 time: 0.314699 Oct 10 11:09:02.972093 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2775/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:02 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:03.496343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:03.497147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:03.505547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:03.506241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:03.506689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:03.507403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:03.511949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:03.512512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:03.762662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:03.773308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54bfaa93-0e14-4638-8d5f-927cf4e9feaf tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.280842 Oct 10 11:09:03.774150 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2654/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:03 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:03.863043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03d739d5-d0c6-4699-94f8-fcc96c69415e tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6777603b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:03.938063 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03d739d5-d0c6-4699-94f8-fcc96c69415e tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 354 microversion: 2.1 time: 0.080576 Oct 10 11:09:03.938748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2776/5430] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:03 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:03.951416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe16f866-7ac0-4497-a6c0-fb57cf5d9aa2 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f67779e8b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:03.994140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:03.994778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:04.002237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:04.002757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:04.003896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:04.004872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:04.005512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:04.013074 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe16f866-7ac0-4497-a6c0-fb57cf5d9aa2 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 354 microversion: 2.1 time: 0.065373 Oct 10 11:09:04.014335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2655/5431] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:03 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:04.021054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:04.028291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ff5313f-cf8c-4e23-b643-08464f043b4b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6780d8b5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:04.133813 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ff5313f-cf8c-4e23-b643-08464f043b4b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 202 len: 0 microversion: 2.1 time: 0.109520 Oct 10 11:09:04.134812 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2656/5432] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:09:04 2022] DELETE /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:09:04.144104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c43fd7d-4281-4d4a-8324-c120d1e77071 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6780d56f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:04.216371 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c43fd7d-4281-4d4a-8324-c120d1e77071 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 353 microversion: 2.1 time: 0.077213 Oct 10 11:09:04.217164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2657/5433] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:04 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:04.328725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:04.336960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e47f45e4-6f15-4914-baf3-28335198c978 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1493 microversion: 2.1 time: 0.347116 Oct 10 11:09:04.338074 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2777/5434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:03 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1493 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:04.803660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:04.804338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:04.816150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:04.819362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:04.819805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:04.820518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:04.820975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:04.821400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.030114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:05.038435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3874f50-e2dd-4c2b-8c70-7910dacac509 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.244615 Oct 10 11:09:05.039215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2658/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:04 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:05.231816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72499d7d-8bac-45e0-8baf-4f8729f6ee92 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f6777603e50>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:05.309772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72499d7d-8bac-45e0-8baf-4f8729f6ee92 tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 353 microversion: 2.1 time: 0.081991 Oct 10 11:09:05.310361 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2778/5436] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:05 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:05.361705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:05.362333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:05.370515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.371046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.371507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.372219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.372682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.373111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.545762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:05.554606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbb3aa1a-37ce-4bc3-afff-41436bc9ce9b tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1499 microversion: 2.1 time: 0.197191 Oct 10 11:09:05.576112 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2659/5437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:05 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:05.589289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:05.590060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:05.597389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.598071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.598702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.599611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.600224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.600807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.654954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:09:05.746747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a19f37b8-2930-4daf-b798-2e26a1d80ca5 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 204 len: 0 microversion: 2.1 time: 0.161343 Oct 10 11:09:05.751811 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2779/5438] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:09:05 2022] DELETE /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:09:05.757611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:05.758367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:05.766504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.767154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.767666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.768446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:05.768982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:05.771489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:05.935277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:05.950648 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c5f6d84-eb8f-4db2-b95d-c97bdbed5aba tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.197906 Oct 10 11:09:05.951379 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2660/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:05 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:06.064033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:06.065316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:06.072301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:06.072935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:06.073555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:06.074374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:06.075081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:06.075721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:06.243449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:06.262482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f306167-044d-429f-b3e0-1bb6f662d87c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.203306 Oct 10 11:09:06.267532 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2780/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:06 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:06.324776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d41d332-6f1f-478c-bcb0-32a360b16b6f tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f677ca29700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:06.396752 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d41d332-6f1f-478c-bcb0-32a360b16b6f tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 200 len: 353 microversion: 2.1 time: 0.075752 Oct 10 11:09:06.399077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2661/5441] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:06 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:06.744398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda8e305-1a7e-4f4c-8315-2f3f54809a3c", "name": "network-vif-plugged", "status": "completed", "tag": "966dfee5-31ca-4c5f-ab6c-9ca366e28f5e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:06.752459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:06.754646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:06.766795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:06.767613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:06.768414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:06.782150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] Creating event network-vif-plugged:966dfee5-31ca-4c5f-ab6c-9ca366e28f5e for instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c on n-h2-860687-2 Oct 10 11:09:06.787474 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-11c9ecd3-e309-4b53-b06f-b9984a402c14 req-97139958-5512-4417-a279-8d8cdb7235b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046941 Oct 10 11:09:06.788741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2781/5442] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:06.974322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:06.982289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:06.983372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:07.009324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:07.009930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:07.010561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:07.011687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:07.012898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:07.013751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:07.193103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:07.201883 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-556d5a2d-40dd-4527-87b6-be218a75b30e tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.229246 Oct 10 11:09:07.202461 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2662/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:06 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:07.288678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:07.289488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:07.296861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:07.297662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:07.298280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:07.299247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:07.300005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:07.300885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:07.416202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4cee9b6-4f87-44d8-b90e-b318dba5c13b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Calling method '.version_select at 0x7f67779b71f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:07.451330 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a4cee9b6-4f87-44d8-b90e-b318dba5c13b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] HTTP exception thrown: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4cee9b6-4f87-44d8-b90e-b318dba5c13b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Request method failure captured: Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 HTTP/1.1 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_1MuqJRcDxefOvWxHHOVK4EGtLHyBSxinnOLdj0IxFdvvvf7iykTO_QZ-64WE2E2usJfSD3Rnk93a_ODUywejQXTMwOVZpzMllqeoUAYRLavq3AMAu4ue3clRdMEKgoW5t1208fwextpAibej8hQAbJEwlggqi-gRTbWYJQJbgSKOw Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: a20d7423343e47d584afc554f9774051 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesGetTestJSON-1497407069 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a20d7423343e47d584afc554f9774051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a20d7423343e47d584afc554f9774051", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a20d7423343e47d584afc554f9774051"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a20d7423343e47d584afc554f9774051"}]}] Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesGetTestJSON-1497407069 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: a20d7423343e47d584afc554f9774051 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesGetTestJSON-1497407069 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesGetTestJSON-1497407069-project Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3560c984510e4b30819b42d53881e075 Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesGetTestJSON-1497407069-project Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: exception: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '315af256-38b5-4039-842b-0c7e0ddc9829'} Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. (HTTP 404) (Request-ID: req-50f279f2-3d02-4bd4-8fc9-b755adc0ebf3) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 11:09:07.455024 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. Oct 10 11:09:07.460091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:07.464163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4cee9b6-4f87-44d8-b90e-b318dba5c13b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] Returning 404 to user: Volume 315af256-38b5-4039-842b-0c7e0ddc9829 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:07.465310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4cee9b6-4f87-44d8-b90e-b318dba5c13b tempest-VolumesGetTestJSON-1497407069 tempest-VolumesGetTestJSON-1497407069-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829" status: 404 len: 109 microversion: 2.1 time: 0.053529 Oct 10 11:09:07.466323 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2663/5444] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:07 2022] GET /compute/v2.1/os-volumes/315af256-38b5-4039-842b-0c7e0ddc9829 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:09:07.510810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:07.520412 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5be753d5-3662-4016-8017-8f2d8e16bc55 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1375 microversion: 2.1 time: 0.236936 Oct 10 11:09:07.536061 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2782/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:07 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:08.254160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:08.255807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:08.277899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.278387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.279221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:08.280454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.281335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.281936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:08.492832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:08.504295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3aec71da-afc1-40bc-84eb-0c7eec32c479 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1505 microversion: 2.1 time: 0.279497 Oct 10 11:09:08.505171 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2664/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:08 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:08.545245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:08.545877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:08.560158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.560853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.561296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:08.562131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.563228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.563671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:08.787865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:08.803643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8bd7e1f-90be-490b-bf2d-f62c9438df00 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1546 microversion: 2.1 time: 0.261878 Oct 10 11:09:08.805100 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2783/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:08 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:08.829874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:08.830497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:08.852052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.852557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.852994 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:08.853699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:08.854155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:08.854579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:09.059047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:09.068839 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-219018d6-7060-4f88-b721-8e256ef86ff3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1546 microversion: 2.1 time: 0.242516 Oct 10 11:09:09.068839 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2665/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:08 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:09.529062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:09.529928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:09.541151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:09.542978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:09.544857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:09.545800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:09.546440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:09.548262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:09.761361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:09.782967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaeb5082-290e-4dca-b08a-5ea432fa6930", "name": "network-vif-deleted", "tag": "c923f80a-c578-4347-8d29-bcc006e65729"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:09.784068 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8cfe0893-d2fb-4b3d-9cb2-294d6a494062 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 200 len: 1463 microversion: 2.1 time: 0.259062 Oct 10 11:09:09.792192 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2784/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:09 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:09.808926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:09.810710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:09.815343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:09.846781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] Creating event network-vif-deleted:c923f80a-c578-4347-8d29-bcc006e65729 for instance aaeb5082-290e-4dca-b08a-5ea432fa6930 on n-h1-860687-2 Oct 10 11:09:09.862285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6eb83c10-c403-4edf-9946-9db7aa22713c req-c9fe7c06-66fe-4077-a150-a59f81030199 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079842 Oct 10 11:09:09.863360 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2666/5450] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:10.813808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:10.820198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: aaeb5082-290e-4dca-b08a-5ea432fa6930] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:10.831616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:10.832575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:10.833258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:10.835231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:10.836006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:10.839238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:10.859918 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] HTTP exception thrown: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Request method failure captured: Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 HTTP/1.1 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zvth3gLTGMmQQXwRW7DKlLYy8mqWy11BBHUu729wqHqem1B1C6eBQiRObTZATT9otZvXlKG8e1Oq-UNxGUoKcIZBhUga-AFXDamHH8vlymjqcrWnOWESwm3hkb1tSVJd3uvD7PAVbXppxQK6z7QyWnWyWTX06GawO2ktKUCwwt9mU Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5f198ae6cb3c40caa38c8ebd33612353 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f198ae6cb3c40caa38c8ebd33612353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f198ae6cb3c40caa38c8ebd33612353", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f198ae6cb3c40caa38c8ebd33612353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f198ae6cb3c40caa38c8ebd33612353"}]}] Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5f198ae6cb3c40caa38c8ebd33612353 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueTestJSON-264614186-project Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e260920cbbcd4cb8b6845ca898e396d6 Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueTestJSON-264614186-project Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'aaeb5082-290e-4dca-b08a-5ea432fa6930'} Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:10.862817 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. Oct 10 11:09:10.867117 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:10.868826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Returning 404 to user: Instance aaeb5082-290e-4dca-b08a-5ea432fa6930 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:10.870725 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80e2ca12-0d00-4ee2-8a61-43ecdc79059c tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930" status: 404 len: 111 microversion: 2.1 time: 0.062504 Oct 10 11:09:10.871331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2785/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:10 2022] GET /compute/v2.1/servers/aaeb5082-290e-4dca-b08a-5ea432fa6930 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:09:10.885953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:10.886554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:10.893539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:10.894283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:10.894910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:10.895825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:10.896446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:10.897339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:10.930873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:09:11.069486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3f25c2b-d55c-4f06-8c70-bdb4013e7011 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "DELETE /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 204 len: 0 microversion: 2.1 time: 0.191754 Oct 10 11:09:11.070589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2667/5452] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:09:10 2022] DELETE /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:09:11.078725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:11.079884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:11.088725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:11.094619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:11.095284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:11.096135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:11.096684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:11.097184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:11.570202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:11.582303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1a32b8a-187d-418f-a6c2-8b6ce36af1b0 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1492 microversion: 2.1 time: 0.507130 Oct 10 11:09:11.584765 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2786/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:11 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1492 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:12.075074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda8e305-1a7e-4f4c-8315-2f3f54809a3c", "tag": "966dfee5-31ca-4c5f-ab6c-9ca366e28f5e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:12.103157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:12.103653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:12.110960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:12.141972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] Creating event network-changed:966dfee5-31ca-4c5f-ab6c-9ca366e28f5e for instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c on n-h2-860687-2 Oct 10 11:09:12.154317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-18b3149f-c1c2-4c5e-bc09-8c0c39eaac8f req-2e8d0276-d5dc-4c1b-9456-907840c4184b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081656 Oct 10 11:09:12.160369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2668/5454] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:12.606881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:12.607713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:12.618408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:12.619820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:12.622392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:12.625995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:12.627345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:12.629900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:12.967923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:12.992435 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12cd2b9a-0b49-4674-b5c4-a74e03002526 tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1492 microversion: 2.1 time: 0.390059 Oct 10 11:09:12.994187 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2787/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:12 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1492 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:14.022865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:14.025587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:14.056131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345a62c0-d409-4ed5-8a3f-56fd06271dd4", "name": "network-vif-deleted", "tag": "d2fd5d6e-02cb-47a1-933f-8577121a9c57"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:14.064919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:14.065501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:14.065953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:14.066752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:14.069355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:14.072821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:14.082756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:14.090093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:14.091514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:14.094638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:14.135316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] Creating event network-vif-deleted:d2fd5d6e-02cb-47a1-933f-8577121a9c57 for instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 on n-h2-860687-2 Oct 10 11:09:14.151781 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-13a0f2e9-c573-4b0f-b575-21644bb12a93 req-8529b031-caae-4abf-8b2c-2167158149a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100409 Oct 10 11:09:14.154250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2788/5456] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:14.253517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e260920cbbcd4cb8b6845ca898e396d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f198ae6cb3c40caa38c8ebd33612353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:14.271814 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3625bd4-cd56-418b-a390-4540625c5e3d tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 200 len: 1285 microversion: 2.1 time: 0.257693 Oct 10 11:09:14.291403 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2669/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:14 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:15.300666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:15.301500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] [instance: 345a62c0-d409-4ed5-8a3f-56fd06271dd4] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:15.309247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:15.310683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:15.315625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:15.316462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:15.316960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:15.317404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:15.322273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:15.333332 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] HTTP exception thrown: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Request method failure captured: Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 HTTP/1.1 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zvth3gLTGMmQQXwRW7DKlLYy8mqWy11BBHUu729wqHqem1B1C6eBQiRObTZATT9otZvXlKG8e1Oq-UNxGUoKcIZBhUga-AFXDamHH8vlymjqcrWnOWESwm3hkb1tSVJd3uvD7PAVbXppxQK6z7QyWnWyWTX06GawO2ktKUCwwt9mU Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 5f198ae6cb3c40caa38c8ebd33612353 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f198ae6cb3c40caa38c8ebd33612353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f198ae6cb3c40caa38c8ebd33612353", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f198ae6cb3c40caa38c8ebd33612353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f198ae6cb3c40caa38c8ebd33612353"}]}] Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 5f198ae6cb3c40caa38c8ebd33612353 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerRescueTestJSON-264614186 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerRescueTestJSON-264614186-project Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e260920cbbcd4cb8b6845ca898e396d6 Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerRescueTestJSON-264614186-project Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '345a62c0-d409-4ed5-8a3f-56fd06271dd4'} Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:15.335551 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] Returning 404 to user: Instance 345a62c0-d409-4ed5-8a3f-56fd06271dd4 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19f8bf6f-fbef-4ad6-b9bb-d62a4e1f5adc tempest-ServerRescueTestJSON-264614186 tempest-ServerRescueTestJSON-264614186-project] 10.222.0.16 "GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4" status: 404 len: 111 microversion: 2.1 time: 0.042024 Oct 10 11:09:15.340585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2789/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:15 2022] GET /compute/v2.1/servers/345a62c0-d409-4ed5-8a3f-56fd06271dd4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:09:22.355529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:22.356588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:22.366835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.367493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.368026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.368833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.369408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.372573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.429563 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e62b149-4583-4ac5-8cf9-de6c8160a7df tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/ips" status: 200 len: 150 microversion: 2.1 time: 0.077502 Oct 10 11:09:22.431572 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2670/5459] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:09:22 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:22.451304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a50aeb-8f81-4bcc-a682-99f5dd55c98b"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:22.454062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:22.473664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.478970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.479814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.482266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.483059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.484473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.669802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/os-volume_attachments HTTP/1.1 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 74 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: {"volumeAttachment": {"volumeId": "52a50aeb-8f81-4bcc-a682-99f5dd55c98b"}} Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'ee4b87f5-f7c0-4181-a618-61476e6fd2f8', 'body': {'volumeAttachment': {'volumeId': '52a50aeb-8f81-4bcc-a682-99f5dd55c98b'}}} Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:09:22.678360 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 400 to user: Invalid volume: volume 52a50aeb-8f81-4bcc-a682-99f5dd55c98b is already attached to instances: e4120b66-c3a2-414b-908a-d1566b7d0613 {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4953364-6a13-4538-b80e-be2077bffb51 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.241198 Oct 10 11:09:22.683331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2790/5460] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:09:22 2022] POST /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8/os-volume_attachments => generated 174 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:09:22.699929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:22.700593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:22.710531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.713566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.715999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.717891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.719327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.721917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.774114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:09:22.808700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:22.934668 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db317650-dc97-4186-b9bc-a293e2999171 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 204 len: 0 microversion: 2.1 time: 0.245968 Oct 10 11:09:22.935831 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2671/5461] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:09:22 2022] DELETE /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:09:22.947111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:22.948045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:22.956415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.957797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.959661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:22.960789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:22.961663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:22.962301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:23.243741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:23.253499 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6b65175-ef90-45dc-9fa1-5e35d6ac18d7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1680 microversion: 2.1 time: 0.312951 Oct 10 11:09:23.254745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2791/5462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:22 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1680 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:24.122508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce58cddb-3d5c-4b8f-9ce2-62e8abc436e5 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f67778709d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:24.195605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce58cddb-3d5c-4b8f-9ce2-62e8abc436e5 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da4fb07e-e016-4890-a89f-7c8995495613" status: 200 len: 350 microversion: 2.1 time: 0.079607 Oct 10 11:09:24.196181 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2672/5463] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:24 2022] GET /compute/v2.1/os-volumes/da4fb07e-e016-4890-a89f-7c8995495613 => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:24.281985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:24.283687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:24.299930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:24.301599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:24.302069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:24.304850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:24.306465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:24.306907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:24.569772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:24.593761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-faf1d11e-042c-4c09-a230-7f9b22a9d3c2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1680 microversion: 2.1 time: 0.315530 Oct 10 11:09:24.596347 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2792/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:24 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:25.621972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:25.628483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:25.646808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:25.655985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:25.656821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:25.657754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:25.659216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:25.659216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:25.807617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:25.816967 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff3f6259-dad1-4e8f-bb09-e37cf21acad0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 200 len: 1612 microversion: 2.1 time: 0.200410 Oct 10 11:09:25.819429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2673/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:25 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 1612 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:25.832263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4b87f5-f7c0-4181-a618-61476e6fd2f8", "name": "network-vif-deleted", "tag": "69c5999e-fb68-4403-94d2-71b0ead087ae"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:25.872154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:25.873818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:25.874518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:25.933522 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] Creating event network-vif-deleted:69c5999e-fb68-4403-94d2-71b0ead087ae for instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 on n-h1-860687-2 Oct 10 11:09:25.958283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3bb5b816-3af6-4fef-86ad-3aa94ee53079 req-33ee6268-9330-4a12-aaf8-768bd848c7fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134658 Oct 10 11:09:25.960024 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2793/5466] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:26.842644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:26.844438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:26.857824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:26.860351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:26.862964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:26.866573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:26.867546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:26.868450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:26.905033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 HTTP/1.1 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ee4b87f5-f7c0-4181-a618-61476e6fd2f8'} Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:26.915869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:26.920621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecf33e89-262d-4284-abac-31efd2613979 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 404 len: 111 microversion: 2.1 time: 0.079294 Oct 10 11:09:26.923842 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2674/5467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:26 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:09:26.939266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-66adf714-70e0-4ca9-ab43-f0bf82906373 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '.version_select at 0x7f677773c550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:26.960430 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-66adf714-70e0-4ca9-ab43-f0bf82906373 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48177295" status: 202 len: 0 microversion: 2.1 time: 0.036298 Oct 10 11:09:26.965229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2794/5468] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 10 11:09:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48177295 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:09:27.096515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c543044-cc2a-4c9b-b021-ee9dc29efd3e tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f6777814310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:27.233042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c543044-cc2a-4c9b-b021-ee9dc29efd3e tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/747d32c6-5171-4f2f-85ee-f40d3577f241" status: 200 len: 350 microversion: 2.1 time: 0.140735 Oct 10 11:09:27.235081 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2675/5469] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:27 2022] GET /compute/v2.1/os-volumes/747d32c6-5171-4f2f-85ee-f40d3577f241 => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:28.181338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:28.181991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:28.194523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:28.195227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:28.195876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:28.196675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:28.197040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:28.197476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:28.355780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lazy-loading 'services' on Instance uuid e4120b66-c3a2-414b-908a-d1566b7d0613 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:09:28.489957 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-034b559f-3601-4492-bca6-2a50ff115339 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments/52a50aeb-8f81-4bcc-a682-99f5dd55c98b" status: 202 len: 0 microversion: 2.1 time: 0.313245 Oct 10 11:09:28.491301 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2795/5470] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:09:28 2022] DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments/52a50aeb-8f81-4bcc-a682-99f5dd55c98b => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:09:28.501653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:28.510987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:28.539668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:28.541223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:28.542123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:28.544194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:28.545985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:28.547082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:28.656005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3cc50b4a-2052-4623-aa47-ee02017404cd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159672 Oct 10 11:09:28.658550 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2676/5471] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:28 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:29.670962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:29.673727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:29.702375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:29.703024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:29.704774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:29.705679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:29.706491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:29.707103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:29.742842 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9476dcd7-44fe-4667-9adf-d299bdf48916 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076151 Oct 10 11:09:29.743724 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2796/5472] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:29 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:30.040216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a46b9e60-9843-49f9-b048-b050b14a4f1c tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f6777814af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.115888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a46b9e60-9843-49f9-b048-b050b14a4f1c tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/55303ec7-392a-4ec4-82f5-4894ecab1df6" status: 200 len: 351 microversion: 2.1 time: 0.079940 Oct 10 11:09:30.116655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2677/5473] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes/55303ec7-392a-4ec4-82f5-4894ecab1df6 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:30.130497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e28d95d-c521-4932-bad7-2355b1b48218 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677771ddc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.286447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e28d95d-c521-4932-bad7-2355b1b48218 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.160029 Oct 10 11:09:30.287749 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2797/5474] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:30.302288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a0e51a4-f1ca-4ca1-9c1b-3c592aa01af7 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677c82f940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.448247 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a0e51a4-f1ca-4ca1-9c1b-3c592aa01af7 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.149645 Oct 10 11:09:30.449287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2678/5475] 10.222.0.16 () {58 vars in 1149 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:30.465496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-169474bc-f51b-4391-b4e2-a6c8ee550fea tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f6777591310>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.582133 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-169474bc-f51b-4391-b4e2-a6c8ee550fea tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.120706 Oct 10 11:09:30.582704 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2798/5476] 10.222.0.16 () {58 vars in 1134 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:30.597897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9def5986-00e6-4ca8-89de-53a73ebb5246 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677c82fca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.752286 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9def5986-00e6-4ca8-89de-53a73ebb5246 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.159138 Oct 10 11:09:30.753988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2679/5477] 10.222.0.16 () {58 vars in 1167 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:30.757538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.766322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:30.772306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43a52f2c-173a-4a68-9c2d-3d3a70e4f37b tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677781c3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:30.778107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:30.779160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:30.781231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:30.782375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:30.803039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:30.816432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:30.876507 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f138c54c-44c5-4846-8791-4d7a43e45f81 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120782 Oct 10 11:09:30.880431 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2799/5478] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:30.955896 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43a52f2c-173a-4a68-9c2d-3d3a70e4f37b tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.191818 Oct 10 11:09:30.956468 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2680/5479] 10.222.0.16 () {58 vars in 1170 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:30.972010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c0a6208-70c5-4dad-9832-29b7259c6d72 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677767c5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:31.154501 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c0a6208-70c5-4dad-9832-29b7259c6d72 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187245 Oct 10 11:09:31.156572 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2800/5480] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 11:09:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:31.170443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd096d9e-409c-48b0-856e-2f8abbec3b79 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677792f3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:31.325356 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd096d9e-409c-48b0-856e-2f8abbec3b79 tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.158668 Oct 10 11:09:31.326737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2681/5481] 10.222.0.16 () {58 vars in 1188 bytes} [Mon Oct 10 11:09:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:31.342357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c5d22b3-8cd1-4b64-9e94-1f06abd249ee tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] Calling method '.version_select at 0x7f677770b9d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:31.464409 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c5d22b3-8cd1-4b64-9e94-1f06abd249ee tempest-VolumesTestJSON-1739471224 tempest-VolumesTestJSON-1739471224-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.126473 Oct 10 11:09:31.465591 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2801/5482] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 11:09:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:31.889054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:31.891428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:31.898681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:31.899584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:31.900711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:31.901915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:31.902737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:31.903536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:31.942517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45b3aa29-4aa6-4700-a10c-3b4ff1989946 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057410 Oct 10 11:09:31.943780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2682/5483] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:31 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:32.653098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:32.657386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:32.678278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:32.679685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:32.681402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:32.683639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:32.687253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:32.688251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:32.808601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ea7256a-cd71-4749-a826-4695b913ad44 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c/action" status: 200 len: 24560 microversion: 2.1 time: 0.160306 Oct 10 11:09:32.810944 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2802/5484] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:09:32 2022] POST /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c/action => generated 24560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:09:32.956206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:32.958360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:32.961612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:32.987117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:32.990025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:33.000167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:33.000939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:33.001416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:33.001856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:33.064210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63280f95-6874-4383-b258-ff1b38e6d4f7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112715 Oct 10 11:09:33.065109 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2683/5485] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:32 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:34.079875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:34.085343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:34.140902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:34.142778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:34.143510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:34.144497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:34.148057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:34.148770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:34.247866 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a07110c-3d5b-4afb-be64-a2500f8e23b3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174476 Oct 10 11:09:34.250493 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2803/5486] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:34 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:35.264470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:35.268106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:35.286643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:35.287194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:35.287650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:35.288386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:35.288852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:35.293975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:35.391741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c196daab-a43f-41a6-b422-6485bb19ce41 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133739 Oct 10 11:09:35.394153 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2684/5487] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:35 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:36.407634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:36.410047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:36.424808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.427312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.427914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:36.429789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.430261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.430696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:36.553514 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-27584fbe-e127-4514-8c6b-8c412ef535f9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151279 Oct 10 11:09:36.567384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2804/5488] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:09:36 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:09:36.674608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:36.675364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:36.687835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.688339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.688793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:36.691687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.692203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.694234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:36.747887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:09:36.899935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab79c5d2-a89c-485f-adab-d52cf573d133 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 204 len: 0 microversion: 2.1 time: 0.229811 Oct 10 11:09:36.902088 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2685/5489] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:09:36 2022] DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:09:36.911337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:36.912008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:36.930054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.931873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.933647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:36.937701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:36.940183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:36.942100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:37.218447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:37.236021 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-62862186-2f09-4f70-9d9a-c9d828262145 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1679 microversion: 2.1 time: 0.329032 Oct 10 11:09:37.236620 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2805/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:36 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:38.264028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:38.266626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:38.275284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:38.277009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:38.279275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:38.280735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:38.284519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:38.285233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:38.828752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:38.870210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8c1d5b8-82f1-4eb5-94cb-c38bd8c76510 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1679 microversion: 2.1 time: 0.595681 Oct 10 11:09:38.870934 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2686/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:38 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1679 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:39.901696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:39.902367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:39.919234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:39.920722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:39.921441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:39.922377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:39.923034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:39.924372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:40.612908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:40.626509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22b106cf-daab-4255-915a-dd3f204a1475 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1613 microversion: 2.1 time: 0.728437 Oct 10 11:09:40.627397 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2806/5492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:39 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1613 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:40.868985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4120b66-c3a2-414b-908a-d1566b7d0613", "name": "network-vif-deleted", "tag": "25242654-7dda-4386-b799-f112ff98eb69"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:40.932206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:40.934980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:40.935479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:40.988681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] Creating event network-vif-deleted:25242654-7dda-4386-b799-f112ff98eb69 for instance e4120b66-c3a2-414b-908a-d1566b7d0613 on n-h2-860687-2 Oct 10 11:09:41.001923 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f5049f78-6eea-4da6-904b-860df004752d req-ddf186ee-2bd4-4d94-b848-522883e1f3a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137298 Oct 10 11:09:41.005626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2687/5493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:41.650195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:41.651020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:41.663268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:41.664558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:41.671295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:41.672657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:41.673391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:41.674531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:41.742259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:41.743153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:41.743843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:41.744535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lazy-loading 'fault' on Instance uuid e4120b66-c3a2-414b-908a-d1566b7d0613 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:09:41.839489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:41.849430 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4e7b16e-bd29-4d28-ac26-057a70d92c5a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 200 len: 1331 microversion: 2.1 time: 0.203061 Oct 10 11:09:41.852640 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2807/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:41 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 1331 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:42.879676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:42.880390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:42.902224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:42.902792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:42.903904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:42.904864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:42.905418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:42.905881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:42.922673 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 HTTP/1.1 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e4120b66-c3a2-414b-908a-d1566b7d0613'} Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:09:42.940672 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:09:42.945723 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b583350d-53a2-4671-83cf-a64e21f6dabd tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 404 len: 111 microversion: 2.1 time: 0.066976 Oct 10 11:09:42.952134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2688/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:42 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:09:42.955098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b6b90be-37c2-4d89-9862-926504eb8899 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '.version_select at 0x7f67776c3b80>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:42.993515 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b6b90be-37c2-4d89-9862-926504eb8899 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989596135" status: 202 len: 0 microversion: 2.1 time: 0.042564 Oct 10 11:09:42.997677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2808/5496] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 11:09:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989596135 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:09:44.985977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d23437cb-4010-4ed8-ae7a-44fd2d6349da tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: .version_select at 0x7f6780cea790>, body: {"keypair": {"name": "tempest-keypair-397386366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMUWGiVfZqUehghkoKtuEIg8OSISzM34o4q7+99E7ihVwA7bqLIzYKhRqrp8i1QU4/gwQLjnoM+qWc1j1CR5UNGg8SeMGluI+enJec8JFd4Zm8whxv6061eb1dI3AurSw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:45.018984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d23437cb-4010-4ed8-ae7a-44fd2d6349da tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:09:45.035540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d23437cb-4010-4ed8-ae7a-44fd2d6349da tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:09:45.066681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d23437cb-4010-4ed8-ae7a-44fd2d6349da tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085763 Oct 10 11:09:45.067927 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2689/5497] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:09:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:48.279917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1335804002", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:48.318620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:48.388227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:09:49.487874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:09:49.488939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:09:49.489585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:09:49.490173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:09:49.490753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:09:49.506033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:49.506560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:49.506956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:49.507735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:49.508196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:49.508643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:49.556016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Getting quotas for project 93ec9fc1ec5c4fa38cd47116292c08cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:09:49.574260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Getting quotas for user c0c14218cb8043a48d197fcd50c10bc5 and project 93ec9fc1ec5c4fa38cd47116292c08cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:09:49.590972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:09:49.594937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:09:49.698840 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f0b16f5d-5474-43ef-8ff5-f05191ecce9f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.424783 Oct 10 11:09:49.706384 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2809/5498] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:09:49.714775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e28287fa-1339-4d74-977d-0281e67d2d18 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:49.715332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e28287fa-1339-4d74-977d-0281e67d2d18 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:49.774093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-571ff31f-ee65-4bfe-9451-f8c70fa5455b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: .version_select at 0x7f6777603940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2118064003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ9X5l525gzF6eRFcOKr5sU/mx/9S2p6Vn7Yb18liCwGD78NpiyYtPBeM3viXtM6QwRkwDGLvHrXAHNkwaTlej5KmG2hrXPpx9dj/Yb/+68ghDMtssZEY1oBCvShUgRQg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:49.863120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-571ff31f-ee65-4bfe-9451-f8c70fa5455b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:09:49.881959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e28287fa-1339-4d74-977d-0281e67d2d18 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:49.884808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-571ff31f-ee65-4bfe-9451-f8c70fa5455b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:09:49.895195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e28287fa-1339-4d74-977d-0281e67d2d18 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1215 microversion: 2.1 time: 0.186313 Oct 10 11:09:49.897735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2690/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:49 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:49.972522 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-571ff31f-ee65-4bfe-9451-f8c70fa5455b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.201806 Oct 10 11:09:49.978516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2810/5500] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:09:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:09:50.798073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:50.798623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:50.825301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:50.825863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:50.826878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:50.827841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:50.845865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:50.846433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:50.919061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:50.919719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:50.941010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:50.947407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:50.948071 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:50.949143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:50.949779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:50.952490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:51.177371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lazy-loading 'services' on Instance uuid 6b742113-2e45-430a-93d7-25f4eb09f27e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:09:51.265599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:51.281108 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f31aaffe-955b-445e-aaf8-97f3f1acf244 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1219 microversion: 2.1 time: 0.365237 Oct 10 11:09:51.284383 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2811/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:50 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:51.305888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1269722867", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c66f5f-64f9-415c-b2e7-430e78e4a9d5"}], "security_groups": [{"name": "tempest-securitygroup--1560553867"}], "key_name": "tempest-keypair-397386366", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:51.344714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-017e9954-6b92-49aa-baf3-82877f16bb70 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e/os-volume_attachments/45dbebdd-66c0-456b-a3dc-7de88e09cbfb" status: 202 len: 0 microversion: 2.1 time: 0.552243 Oct 10 11:09:51.349311 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2691/5502] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:09:50 2022] DELETE /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e/os-volume_attachments/45dbebdd-66c0-456b-a3dc-7de88e09cbfb => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:09:51.607498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] validate_networks() for [('21c66f5f-64f9-415c-b2e7-430e78e4a9d5', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:09:52.314020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:52.314773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:52.332600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:52.336103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:52.336803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:52.338852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:52.340374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:52.342146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:53.029682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:53.045460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=74,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:53.068630 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9c96a90-734c-406f-a981-27d95356d8dc tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1273 microversion: 2.1 time: 0.765463 Oct 10 11:09:53.069814 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2692/5503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:52 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1273 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:53.580628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:09:53.581864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:09:53.582599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:09:53.583467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:09:53.584589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:09:53.606536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:53.607276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:53.607931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:53.608739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:53.617543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:53.618398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:53.629667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:09:53.642467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:09:53.650222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:09:53.666008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:09:53.671670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:09:53.760852 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-42c4eff3-bea1-4bf9-9750-35f6371857be tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.475298 Oct 10 11:09:53.765176 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2812/5504] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:09:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:09:53.774282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b33e922-c7e5-40ba-8061-64204dad287e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:53.774850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b33e922-c7e5-40ba-8061-64204dad287e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:54.057469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1501834472", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "c27add31-3940-42a1-b417-8a4228d9d1e1"}], "key_name": "tempest-TestNetworkBasicOps-2118064003", "security_groups": [{"name": "tempest-secgroup-smoke-2107104552"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:54.074782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b33e922-c7e5-40ba-8061-64204dad287e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:54.092243 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b33e922-c7e5-40ba-8061-64204dad287e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1241 microversion: 2.1 time: 0.321085 Oct 10 11:09:54.093678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2693/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:53 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1241 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:54.101260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:54.102187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:54.115308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:54.116097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:54.116805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:54.117765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:54.119128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:54.119859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:54.298297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] validate_networks() for [('c27add31-3940-42a1-b417-8a4228d9d1e1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:09:54.893012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:54.907934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbbc1a17-f5c2-42b7-946f-bbf2fd4d3f98 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 0.810254 Oct 10 11:09:54.910587 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2694/5506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:54 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:55.119632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:55.120418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:55.129845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.135843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.141993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.143263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.144074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.144685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.429390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:55.447272 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c498feb-2918-49d0-b388-98aa195cc1ac tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1237 microversion: 2.1 time: 0.328704 Oct 10 11:09:55.471655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2695/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:55 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1237 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:55.471655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4385d1-cc6b-4acc-bae0-50ff59194528", "tag": "f957ff45-c2ba-4dbf-a46d-4074e85c8605"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:09:55.480522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.481060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.481497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.497376 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] Creating event network-changed:f957ff45-c2ba-4dbf-a46d-4074e85c8605 for instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 on n-h1-860687-2 Oct 10 11:09:55.505945 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-178a0f53-fbd5-4a63-83e0-06795025e052 req-e6c24a99-9b29-4861-8a2b-602004c46406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044940 Oct 10 11:09:55.508428 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2696/5508] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:09:55.776141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:09:55.776633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:09:55.777021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:09:55.777432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:09:55.777842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:09:55.793882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.794549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.795053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.804725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.805525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.806133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.844191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:09:55.866703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:09:55.898569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:09:55.906782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:09:55.944537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:55.944537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:55.956684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.961123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.962559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:55.964449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:55.966419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:55.967544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:56.056225 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6609a103-11ed-45f9-bc8b-5a840cad52c7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.002959 Oct 10 11:09:56.056897 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2813/5509] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:09:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:09:56.069091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b6b7f9f5-1b01-44f2-ae5b-2ac6f8c418b8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:56.070012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b6b7f9f5-1b01-44f2-ae5b-2ac6f8c418b8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:56.260024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b6b7f9f5-1b01-44f2-ae5b-2ac6f8c418b8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:56.270035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b6b7f9f5-1b01-44f2-ae5b-2ac6f8c418b8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1249 microversion: 2.1 time: 0.204805 Oct 10 11:09:56.279407 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2814/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:56 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1249 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:56.485048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:56.485680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:56.493073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:56.493586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:56.494035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:56.494774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:56.495261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:56.495699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:56.942767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:56.952547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dbdedccd-7785-43d1-b299-e9072c520637 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1299 microversion: 2.1 time: 0.471962 Oct 10 11:09:56.953865 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2815/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:56 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1299 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:57.008287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:57.021519 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e301c9a-9101-41d5-8718-77509b15f36f tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 1.084758 Oct 10 11:09:57.035041 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2697/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:55 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:57.304264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:57.305228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:57.313037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:57.315181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:57.316060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:57.319049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:57.320586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:57.321433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:57.458167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:57.472225 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74d3c768-d11e-45e0-a90f-613736e74a13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1253 microversion: 2.1 time: 0.171842 Oct 10 11:09:57.473602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2816/5513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:57 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1253 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:57.977741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:57.984562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:57.998433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:57.999048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:57.999570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.000405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:58.000925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:58.001991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.045897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:58.046627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:58.054255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:58.059374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:58.060736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.061677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:58.062164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:58.062733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.162439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:58.173765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd51269c-9abf-4428-987c-c4bf50db1d3f tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1299 microversion: 2.1 time: 0.200160 Oct 10 11:09:58.181104 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2698/5514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:57 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:58.499890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:58.500863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:58.512231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:58.513589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:58.514201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.515352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:58.516199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:58.517000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:58.539444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:58.551379 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5592f9eb-baab-4e76-9d17-85a5eb443a71 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 0.509939 Oct 10 11:09:58.552491 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2817/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:58 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:58.676219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:58.706550 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfd268d7-26f7-43c4-b6b2-6b779b8dbdfa tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1307 microversion: 2.1 time: 0.213538 Oct 10 11:09:58.710781 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2699/5516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:58 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:59.209214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:59.210561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:59.219747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.220687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.221452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.222471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.224128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.224859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.438643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:59.439369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:59.446044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.446601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.447339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.448612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.449150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.449655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.484505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:09:59.489862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:59.508302 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cf26ceb3-66f9-45c5-9221-e310959b06f3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.305887 Oct 10 11:09:59.514838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2818/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:59 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:09:59.598220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:59.598944 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdeea8c2-241e-468f-8ec7-b245fa1908ae tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 204 len: 0 microversion: 2.1 time: 0.165265 Oct 10 11:09:59.600402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2700/5518] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:09:59 2022] DELETE /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:09:59.601545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:59.613048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:09:59.614920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:09:59.622662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.623401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.624892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.625563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.626551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.627593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.627886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.628515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.629280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.629527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:09:59.633047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:09:59.633706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:09:59.959537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:59.975267 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14c26adc-3b0b-43b8-86fe-571a775faa72 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1469 microversion: 2.1 time: 0.368322 Oct 10 11:09:59.979301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2701/5519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:59 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:09:59.989819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:09:59.992874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d208fd3e-5f71-4d0f-967c-5da5ec1253a0", "tag": "e7de66c1-e529-43f6-ae12-952e1ff81b12"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:00.002199 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03612197-4de6-419e-8b3f-ccb03f41f023 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 0.426113 Oct 10 11:10:00.004045 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2819/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:09:59 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:00.007789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:00.008479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:00.009100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:00.009220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:00.010474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:00.018445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:00.019414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:00.020556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:00.021659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:00.022334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:00.023153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:00.035273 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] Creating event network-changed:e7de66c1-e529-43f6-ae12-952e1ff81b12 for instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 on n-h2-860687-2 Oct 10 11:10:00.042291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c81f4d0c-2e1b-47ed-a883-0ffb94efcbdf req-f57dd7ea-7cf7-4ac3-abd8-f987847d9453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058692 Oct 10 11:10:00.043376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2702/5521] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:00.108157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:00.116877 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b57b6a9b-d397-494d-a770-b3f2caa9edd3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1307 microversion: 2.1 time: 0.111362 Oct 10 11:10:00.118164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2820/5522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:00 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:00.537077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:00.537788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:00.555080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:00.555487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:00.555930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:00.556650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:00.557115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:00.557545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:00.818720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:00.829792 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84ce77c6-46fe-4575-803c-87fcf6f02a58 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.297653 Oct 10 11:10:00.831106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2703/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:00 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:10:01.006682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:01.007970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:01.016496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.017381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.018051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.019130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.020640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.023031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.030158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:01.031187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:01.043143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.043732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.044194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.046221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.046708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.047198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.677963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:01.687603 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c64cd1d0-0425-43e6-a50c-cccde7a62722 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 0.663151 Oct 10 11:10:01.688405 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2704/5524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:01 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:01.693065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:01.693891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:01.699740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.700444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.701820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.702781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.703438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.704205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.740750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:01.748804 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f58d2ef3-db33-443c-9c6e-04a30ba34916 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1469 microversion: 2.1 time: 0.750744 Oct 10 11:10:01.750154 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2821/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:00 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1469 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:01.755222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4385d1-cc6b-4acc-bae0-50ff59194528", "name": "network-vif-plugged", "status": "completed", "tag": "f957ff45-c2ba-4dbf-a46d-4074e85c8605"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:01.767269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.768128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.769462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.799525 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] Creating event network-vif-plugged:f957ff45-c2ba-4dbf-a46d-4074e85c8605 for instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 on n-h1-860687-2 Oct 10 11:10:01.815508 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a13259aa-e92b-4068-a70a-e1bb42f6ebe7 req-3b04a41a-fe90-4e10-9b56-7dd20ba2e8cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062109 Oct 10 11:10:01.817187 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2822/5526] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:01.853639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74ab6cf-4999-4363-87a8-04dea297361b", "tag": "ad8e8c29-1fa3-425e-b29b-ac39e85f49ca"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:01.882162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.882785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.883363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.899778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] Creating event network-changed:ad8e8c29-1fa3-425e-b29b-ac39e85f49ca for instance d74ab6cf-4999-4363-87a8-04dea297361b on n-h1-860687-2 Oct 10 11:10:01.906516 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-47a2f39d-d7de-4907-a79b-e654cfedc10e req-f671740d-d5f6-401b-b837-8ca6cd327123 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061922 Oct 10 11:10:01.907844 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2823/5527] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:01.915941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:01.917034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:01.929764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.930828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.931776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:01.933913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:01.934613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:01.936021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.176269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:02.186483 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c965a87f-ba45-497f-89e8-6b529c0f954f tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.496865 Oct 10 11:10:02.199030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2705/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:01 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:02.282972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:02.294390 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75478b7d-e6dd-49e3-a1f2-1dbd6e4f4cef tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.384789 Oct 10 11:10:02.296792 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2824/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:01 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:02.718823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:02.722830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:02.736462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:02.737531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:02.738165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.739589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:02.740998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:02.741695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.776658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:02.777707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:02.788141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:02.789584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:02.790261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.791487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:02.792325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:02.793017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.845149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:02.846169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:02.846982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:02.848784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lazy-loading 'fault' on Instance uuid 6b742113-2e45-430a-93d7-25f4eb09f27e {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:10:02.928189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebbfeb66ed548d6afe557a9d5f3fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fffcfe13c04329a9a2eaf78ed6a74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:02.938103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7b4e1ddf-645b-43ea-a36b-79c6d4cd2722 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 200 len: 1304 microversion: 2.1 time: 0.167545 Oct 10 11:10:02.940077 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2825/5530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:02 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:03.112775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:03.121835 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f3ff4fb-25f5-4d61-870b-5b3fb40f4d4a tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1315 microversion: 2.1 time: 0.410240 Oct 10 11:10:03.123163 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2706/5531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:02 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:03.213531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:03.214162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:03.224226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.224871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.225322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.226045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.226511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.226946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.319169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:03.319782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:03.326262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.326464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.326775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.327684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.328138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.328558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.780175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:03.790689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8353a165-3759-49a7-9d31-68f36ff5cdf5 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.581373 Oct 10 11:10:03.791395 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2826/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:03 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:03.840735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:03.848946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5063e25e-8f09-4306-9352-c06c5988f88c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.533583 Oct 10 11:10:03.849527 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2707/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:03 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:10:03.957335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b742113-2e45-430a-93d7-25f4eb09f27e", "name": "network-vif-deleted", "tag": "fd39165a-e78c-49d0-9fa3-56b153570da8"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:03.963311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:03.964086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] [instance: 6b742113-2e45-430a-93d7-25f4eb09f27e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:03.973559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.974065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.974666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.975178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.975409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:03.975720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.975870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:03.976075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.976302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:03.992426 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] HTTP exception thrown: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Request method failure captured: Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e HTTP/1.1 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_0NiTV8oI3YAFGpkU8zyZt9Bw_B-8JAgcMwuXA-kj2AyJDJ9OdICzxJihMFXYA9XEg-79lYMgM6k70fZwYQ9pg8KBhff2U36d1fsuUuF9-4xYeaEwZRkkwDyEjzJ6eGf2EbLz5u0U-TuXsfShwH9IZp2h6BGHNLorsfBfHZrRYtZG0 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e6fffcfe13c04329a9a2eaf78ed6a74c Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesBackupsTest-804295340 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6fffcfe13c04329a9a2eaf78ed6a74c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6fffcfe13c04329a9a2eaf78ed6a74c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6fffcfe13c04329a9a2eaf78ed6a74c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6fffcfe13c04329a9a2eaf78ed6a74c"}]}] Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesBackupsTest-804295340 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e6fffcfe13c04329a9a2eaf78ed6a74c Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesBackupsTest-804295340 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesBackupsTest-804295340-project Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8ebbfeb66ed548d6afe557a9d5f3fe78 Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesBackupsTest-804295340-project Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '6b742113-2e45-430a-93d7-25f4eb09f27e'} Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:03.997743 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. Oct 10 11:10:04.003360 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:04.005408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] Returning 404 to user: Instance 6b742113-2e45-430a-93d7-25f4eb09f27e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:10:04.006462 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cb99034-1230-4e79-bc5b-dc52d2bf96f4 tempest-VolumesBackupsTest-804295340 tempest-VolumesBackupsTest-804295340-project] 10.222.0.16 "GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e" status: 404 len: 111 microversion: 2.1 time: 0.047869 Oct 10 11:10:04.010739 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2708/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:03 2022] GET /compute/v2.1/servers/6b742113-2e45-430a-93d7-25f4eb09f27e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:10:04.028350 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] Creating event network-vif-deleted:fd39165a-e78c-49d0-9fa3-56b153570da8 for instance 6b742113-2e45-430a-93d7-25f4eb09f27e on n-h2-860687-2 Oct 10 11:10:04.034134 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-77c25389-b87f-4470-a08d-ad8db8da9488 req-fc120ff4-ca59-479f-ba5a-003f20fbd92a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080660 Oct 10 11:10:04.035280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2827/5535] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:04.145785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:04.146410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:04.148423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:04.163167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.163678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.164124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.164841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.165306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.165739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.458026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:04.468171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1c4b7f6-6cee-4e7a-b859-5ce18ccd2348 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1464 microversion: 2.1 time: 0.326453 Oct 10 11:10:04.469124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2709/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:04 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:04.526759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:04.527369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:04.540887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.541385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.541831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.542534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.543022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.543449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.574147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:10:04.666639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:04.684099 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa5a52ba-07df-4571-8cb4-93bc74885106 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 204 len: 0 microversion: 2.1 time: 0.161331 Oct 10 11:10:04.684947 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2828/5537] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:10:04 2022] DELETE /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:10:04.693986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:04.695027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:04.701957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.702544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.703122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.703906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.704794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.705303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.817168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:04.817966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:04.828822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.829479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.831233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:04.833126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:04.834746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:04.836093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:05.084199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:05.086695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:05.099832 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd21c4b5-f78d-45bd-98f4-d9e2f593ff05 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1470 microversion: 2.1 time: 0.409655 Oct 10 11:10:05.100440 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2710/5538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:04 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1470 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:05.111864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:05.111864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:05.129442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:05.129442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:05.129887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:05.131041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:05.131847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:05.132470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:05.186851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:05.201269 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cf55e007-812b-4db3-ac55-b456ae79c679 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.389032 Oct 10 11:10:05.201998 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2829/5539] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:04 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:05.437668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:05.452586 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9bc8808-6ba6-4164-a2a1-1c69977fa8f1 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.347447 Oct 10 11:10:05.454412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2711/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:05 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:06.124363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:06.125000 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:06.128501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:06.148105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.148941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.149822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.150760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.152307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.152922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.228771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:06.229321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:06.238136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:06.240208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.241089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.241808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.242781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.244691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.245358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.269843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:06.578154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:06.585181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:06.587735 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec050ffb-875e-4237-a5d4-07e7fe47384d tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1470 microversion: 2.1 time: 0.467221 Oct 10 11:10:06.599630 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2830/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:06 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:06.599630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:06.599630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:06.606930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.606930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.606930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.606930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:06.607381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:06.607760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:06.610762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:06.616665 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52186d93-2de4-4c7c-b911-82c83a418381 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.394612 Oct 10 11:10:06.617973 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2712/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:06 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:10:06.860439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:06.868537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd9fd8cc-aee8-4e72-8642-dc10943fdeb3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.278774 Oct 10 11:10:06.869124 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2831/5543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:06 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:07.052931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4385d1-cc6b-4acc-bae0-50ff59194528", "name": "network-vif-deleted", "tag": "f957ff45-c2ba-4dbf-a46d-4074e85c8605"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:07.119459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.119957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.120402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.162145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] Creating event network-vif-deleted:f957ff45-c2ba-4dbf-a46d-4074e85c8605 for instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 on n-h1-860687-2 Oct 10 11:10:07.175239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-83062b93-1c32-431d-ba70-a8d1ead8096a req-001ce395-f2da-4d61-ab38-e9f0e5974dc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126971 Oct 10 11:10:07.176182 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2713/5544] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:07.616167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:07.617891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:07.627600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.628389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.629008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.630265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.636142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.637426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.648287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:07.650391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:07.660247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.661368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.662019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.662942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.664380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.665100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.745482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.745979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.746425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.746881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lazy-loading 'fault' on Instance uuid 4d4385d1-cc6b-4acc-bae0-50ff59194528 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:10:07.878005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c14218cb8043a48d197fcd50c10bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec9fc1ec5c4fa38cd47116292c08cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:07.885727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6009734f-2956-4737-97ab-d0876c1bbc6b tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 200 len: 1305 microversion: 2.1 time: 0.275246 Oct 10 11:10:07.890520 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2832/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:07 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 1305 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:07.897129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d208fd3e-5f71-4d0f-967c-5da5ec1253a0", "name": "network-vif-plugged", "status": "completed", "tag": "e7de66c1-e529-43f6-ae12-952e1ff81b12"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:07.925458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:07.926031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:07.926883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:07.970130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] Creating event network-vif-plugged:e7de66c1-e529-43f6-ae12-952e1ff81b12 for instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 on n-h2-860687-2 Oct 10 11:10:07.985717 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5577da72-31f1-4844-87a1-095f3c04bb1b req-573c7b94-09c3-42bc-9b87-1b54aa2f1137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091577 Oct 10 11:10:07.986054 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2833/5546] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:07.993573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:08.002518 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6046cef-e0d8-41d4-81aa-a2aa0818f064 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.360466 Oct 10 11:10:08.003134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2714/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:07 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:08.007771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:08.008466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:08.016611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:08.017352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:08.017951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:08.019064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:08.019722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:08.020405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:08.246372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:08.257115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3dfbea0f-bdb2-4eb5-837e-d74319da9d80 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.268741 Oct 10 11:10:08.260061 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2834/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:07 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:08.914364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:08.915338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] [instance: 4d4385d1-cc6b-4acc-bae0-50ff59194528] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:08.927279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:08.930036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:08.931435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:08.933823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:08.935793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:08.936313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:08.970283 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] HTTP exception thrown: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Request method failure captured: Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 HTTP/1.1 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_14g6VHkUlGiaUvF74qgY9um97A_F-pzQi1OwibyGkI6dSEvGTLoVbdHmyfZll7xI6s9RUwxToo16V-wFjroyQ68oYGjfH9QSQTlDt9DHTrzjHN5mpV9P7zmP2E_KRxhOxQYRFCfDEo7cEuDWZSU96XDDsx-gU6Nh48lJBZWdiLESg Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 93ec9fc1ec5c4fa38cd47116292c08cc Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesNegativeTest-2014748865 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93ec9fc1ec5c4fa38cd47116292c08cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93ec9fc1ec5c4fa38cd47116292c08cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93ec9fc1ec5c4fa38cd47116292c08cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93ec9fc1ec5c4fa38cd47116292c08cc"}]}] Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesNegativeTest-2014748865 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 93ec9fc1ec5c4fa38cd47116292c08cc Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesNegativeTest-2014748865 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesNegativeTest-2014748865-project Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: c0c14218cb8043a48d197fcd50c10bc5 Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesNegativeTest-2014748865-project Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '4d4385d1-cc6b-4acc-bae0-50ff59194528'} Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:08.978039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] Returning 404 to user: Instance 4d4385d1-cc6b-4acc-bae0-50ff59194528 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-558f4522-c0a0-4346-a5d2-b5201f476a75 tempest-VolumesNegativeTest-2014748865 tempest-VolumesNegativeTest-2014748865-project] 10.222.0.16 "GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528" status: 404 len: 111 microversion: 2.1 time: 0.069847 Oct 10 11:10:08.983600 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2715/5549] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:08 2022] GET /compute/v2.1/servers/4d4385d1-cc6b-4acc-bae0-50ff59194528 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:10:09.030032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:09.031256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:09.044105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:09.048412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:09.049149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:09.050084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:09.051886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:09.052337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:09.282783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:09.284040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:09.300980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:09.313848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:09.314432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:09.315238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:09.323961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:09.326775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:09.484427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:09.492329 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8303c9c-98be-48b6-9a55-012cb5efcd48 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.468424 Oct 10 11:10:09.492918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2835/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:09 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:09.628322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:09.636953 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9071c16-bd81-4ae6-b354-28e06e4428a6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1367 microversion: 2.1 time: 0.358924 Oct 10 11:10:09.637526 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2716/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:09 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:10.009718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74ab6cf-4999-4363-87a8-04dea297361b", "name": "network-vif-plugged", "status": "completed", "tag": "ad8e8c29-1fa3-425e-b29b-ac39e85f49ca"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:10.024783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:10.026018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:10.026835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:10.045284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] Creating event network-vif-plugged:ad8e8c29-1fa3-425e-b29b-ac39e85f49ca for instance d74ab6cf-4999-4363-87a8-04dea297361b on n-h1-860687-2 Oct 10 11:10:10.052919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0acf79b2-fe24-4cd8-a529-79bd37ff2220 req-ecc46b69-d8f5-4b23-be9c-e67063fc3505 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053053 Oct 10 11:10:10.056221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2836/5552] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:10.521687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:10.522782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:10.534964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:10.535763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:10.536211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:10.537502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:10.537969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:10.538400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:10.661414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:10.662505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:10.671139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:10.671937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:10.672858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:10.673761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:10.674574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:10.675387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:10.963025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:10.973369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f750f78-7213-417f-b0d3-cf85a3473217 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1375 microversion: 2.1 time: 0.456128 Oct 10 11:10:10.987779 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2717/5553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:10 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1375 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:11.103613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:11.114173 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b5d4414-8d8d-4925-87d4-5df10b8d2fa6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1557 microversion: 2.1 time: 0.457615 Oct 10 11:10:11.115020 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2837/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:10 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1557 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:10:11.139206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:11.139804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:11.150244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:11.151477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:11.152789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:11.154909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:11.156214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:11.158575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:11.337285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-588f6793-8590-47b1-a387-3ddc25885ed0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202760 Oct 10 11:10:11.338152 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2718/5555] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:10:11 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:11.998041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:11.999179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:12.010210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:12.010705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:12.011186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:12.011887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:12.012333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:12.017511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:12.274077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:12.287839 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69a055b5-226a-4874-81a1-3436079e4f84 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1547 microversion: 2.1 time: 0.292163 Oct 10 11:10:12.290371 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2838/5556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:11 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1547 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:12.314034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:12.314638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:12.328550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:12.329077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:12.329524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:12.330255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:12.330712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:12.334108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:12.610518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:12.620158 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5fa4a7ed-1687-43c0-b85b-876864786e0c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1547 microversion: 2.1 time: 0.311399 Oct 10 11:10:12.622684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2719/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:12 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1547 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:13.530203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d208fd3e-5f71-4d0f-967c-5da5ec1253a0", "tag": "e7de66c1-e529-43f6-ae12-952e1ff81b12"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:13.571267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:13.575521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:13.577377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:13.609107 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] Creating event network-changed:e7de66c1-e529-43f6-ae12-952e1ff81b12 for instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 on n-h2-860687-2 Oct 10 11:10:13.623634 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ba97f04f-c202-4bba-af1c-070fa6c0ee66 req-63dec779-a1c0-4a36-896f-e95143c7d94e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100119 Oct 10 11:10:13.624664 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2839/5558] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:41.478431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:41.479624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:41.507959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=15 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:41.508720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=45 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:41.510268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:41.510826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:41.511321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:41.512160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:41.512704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:41.513136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:41.587695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:10:41.815586 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68bd16cd-c81e-4a38-b233-ffa9ed8d3be7 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 204 len: 0 microversion: 2.1 time: 0.341030 Oct 10 11:10:41.819484 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2720/5559] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:10:41 2022] DELETE /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:10:41.828941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:41.829864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:41.865619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:41.871836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=43 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:10:41.880318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:41.880907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:41.881367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:41.884160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:41.887809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:41.888663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:42.313205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:42.323598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b98eea6e-b41a-4748-9602-4e31a1f84436 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1553 microversion: 2.1 time: 0.502350 Oct 10 11:10:42.329349 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2840/5560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:41 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1553 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:43.360354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:43.361692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:43.373017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:43.373866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:43.375283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:43.377154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:43.377916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:43.378694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:43.763900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:43.779065 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f99ac92-8c6d-4d8d-b2fd-a60f3ef1003b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1553 microversion: 2.1 time: 0.429879 Oct 10 11:10:43.780643 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2721/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:43 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:44.807739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:44.809423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:44.816579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:44.817321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:44.817925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:44.819036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:44.819655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:44.820260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:45.294374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:45.326038 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b5556282-d423-4f70-a4b8-657eadfabe9e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1553 microversion: 2.1 time: 0.524459 Oct 10 11:10:45.327686 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2841/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:44 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1553 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:45.550237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74ab6cf-4999-4363-87a8-04dea297361b", "name": "network-vif-deleted", "tag": "ad8e8c29-1fa3-425e-b29b-ac39e85f49ca"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:45.571303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:45.575667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:45.576351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:45.594084 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] Creating event network-vif-deleted:ad8e8c29-1fa3-425e-b29b-ac39e85f49ca for instance d74ab6cf-4999-4363-87a8-04dea297361b on n-h1-860687-2 Oct 10 11:10:45.600914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ad3ac51d-ee67-4066-bf2e-dd480f56a63d req-534e35af-cdf6-4f6b-a01f-2f79dc68edb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054461 Oct 10 11:10:45.602493 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2722/5563] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:46.352945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:46.356784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:46.376897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:46.379849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:46.381400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:46.382265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:46.385199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:46.385753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:46.484790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:46.485605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:46.486281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:46.487654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lazy-loading 'fault' on Instance uuid d74ab6cf-4999-4363-87a8-04dea297361b {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:10:46.641336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:46.650938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c3e03203-44ba-4537-a28c-631a6eb058de tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 200 len: 1339 microversion: 2.1 time: 0.303862 Oct 10 11:10:46.668277 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2842/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:46 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:47.542990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:47.543946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:47.555604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:47.556220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:47.556952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:47.559450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:47.560748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:47.562188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:47.628040 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d02f7d77-884f-4260-95c7-f551b1fc531e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/ips" status: 200 len: 150 microversion: 2.1 time: 0.090613 Oct 10 11:10:47.629796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2723/5565] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:10:47 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:47.679711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:47.680339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: d74ab6cf-4999-4363-87a8-04dea297361b] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:47.702890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:47.704737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:47.705577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:47.709073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:47.709800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:47.714174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:47.767100 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] HTTP exception thrown: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Request method failure captured: Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b HTTP/1.1 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_06qJFpkTuefK7cxJKtNwMV7c_PBkuvrgOTiuL1t0SjX3JNNIjtiH4TSaC5EgfTQyOFcAlLl9HxxaeuPMW3VdLB8EH-42ZjwrobvwiThrTh5c0QitSklpp7k0N3-nS0CtXbnQDMvJUz8Ew0C6MkcEgx9WVtDVVGERXZwwrQw4N_olk Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_691ebac218dd472ca7245a35f055ad66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/691ebac218dd472ca7245a35f055ad66"}]}] Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkBasicOps-886656240 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3e5c5e21b1444df2b472f16c7cdf7523 Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd74ab6cf-4999-4363-87a8-04dea297361b'} Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:10:47.768291 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. Oct 10 11:10:47.773720 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:10:47.790094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Returning 404 to user: Instance d74ab6cf-4999-4363-87a8-04dea297361b could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:10:47.792954 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f70a629f-66cd-43a5-8a84-903a1f529bb2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b" status: 404 len: 111 microversion: 2.1 time: 0.120271 Oct 10 11:10:47.795358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2843/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:47 2022] GET /compute/v2.1/servers/d74ab6cf-4999-4363-87a8-04dea297361b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:10:48.227321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41627527-2a48-4704-a5c4-b7199500cb06 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '.version_select at 0x7f6777870940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:48.306344 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41627527-2a48-4704-a5c4-b7199500cb06 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2118064003" status: 202 len: 0 microversion: 2.1 time: 0.083190 Oct 10 11:10:48.311054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2724/5567] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 11:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2118064003 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:10:50.766616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24d66632-7c3c-440c-87ab-a4f64eac8611"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:50.774871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:50.810630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:50.814247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:50.816591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:50.817496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:50.820006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:50.820642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:51.285243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b78a2936-0176-4fd5-af9b-eeb6c3fb8e08 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530842 Oct 10 11:10:51.295266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2844/5568] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:10:50 2022] POST /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:54.600555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda8e305-1a7e-4f4c-8315-2f3f54809a3c", "tag": "966dfee5-31ca-4c5f-ab6c-9ca366e28f5e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:54.608122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:54.610846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:54.642193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:54.644632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:54.645484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:54.645967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:54.648145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:54.648293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:54.648721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:54.649159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:54.649421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:54.688703 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] Creating event network-changed:966dfee5-31ca-4c5f-ab6c-9ca366e28f5e for instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c on n-h2-860687-2 Oct 10 11:10:54.708684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-695b95a5-50d3-411a-9318-1fd6bbe0c504 req-42f28359-da15-422a-ae78-4b64aaed18fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110859 Oct 10 11:10:54.711181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2845/5569] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:54.740618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:10:54.920977 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34b4aa2e-1ae3-4a58-a594-19ba7d2891c9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 204 len: 0 microversion: 2.1 time: 0.342698 Oct 10 11:10:54.922526 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2725/5570] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:10:54 2022] DELETE /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:10:54.935246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:54.936603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:54.965063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:54.966291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:54.969359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:54.971577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:54.973452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:54.977492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:55.575387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:55.594904 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec9348eb-14dc-4413-8e5d-2e5fa737a4ac tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1670 microversion: 2.1 time: 0.666458 Oct 10 11:10:55.603530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2846/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:54 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1670 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:56.622818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:56.623563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:56.642688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:56.643227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:56.643666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:56.644389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:56.644850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:56.645592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:57.556777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:57.567530 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42dbb527-46a6-49e7-a5d3-2ae1f45d1d7e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1670 microversion: 2.1 time: 0.950013 Oct 10 11:10:57.568745 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2726/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:56 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1670 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:58.064237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda8e305-1a7e-4f4c-8315-2f3f54809a3c", "name": "network-vif-deleted", "tag": "966dfee5-31ca-4c5f-ab6c-9ca366e28f5e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:10:58.084605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:58.085092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:58.085532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:58.109326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] Creating event network-vif-deleted:966dfee5-31ca-4c5f-ab6c-9ca366e28f5e for instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c on n-h2-860687-2 Oct 10 11:10:58.128758 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-62ffa6e8-ab45-4231-88a7-8cb571e3a85b req-eb323fbf-8117-4556-9d04-5f4de874ecf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Oct 10 11:10:58.152898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2847/5573] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:10:58.596263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:58.597544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:58.627836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:58.628682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:58.629656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:58.630601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:58.631375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:58.631822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:58.716100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:58.716100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:58.716100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:58.716100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lazy-loading 'fault' on Instance uuid cda8e305-1a7e-4f4c-8315-2f3f54809a3c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:10:58.893105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:10:58.902743 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79476201-eb2f-4276-b904-16925b09af47 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 200 len: 1489 microversion: 2.1 time: 0.312648 Oct 10 11:10:58.917758 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2727/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:58 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 1489 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:10:59.930300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:10:59.931041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: cda8e305-1a7e-4f4c-8315-2f3f54809a3c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:10:59.954403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:59.957879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:59.958825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:10:59.959798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:10:59.962890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:10:59.963574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:00.000901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] HTTP exception thrown: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Request method failure captured: Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c HTTP/1.1 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_06qJFpkTuefK7cxJKtNwMV7c_PBkuvrgOTiuL1t0SjX3JNNIjtiH4TSaC5EgfTQyOFcAlLl9HxxaeuPMW3VdLB8EH-42ZjwrobvwiThrTh5c0QitSklpp7k0N3-nS0CtXbnQDMvJUz8Ew0C6MkcEgx9WVtDVVGERXZwwrQw4N_olk Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_691ebac218dd472ca7245a35f055ad66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/691ebac218dd472ca7245a35f055ad66"}]}] Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkBasicOps-886656240 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3e5c5e21b1444df2b472f16c7cdf7523 Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'cda8e305-1a7e-4f4c-8315-2f3f54809a3c'} Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:00.003034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. Oct 10 11:11:00.007827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:00.009843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Returning 404 to user: Instance cda8e305-1a7e-4f4c-8315-2f3f54809a3c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:11:00.011573 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-948f440d-0c45-4b15-af80-7f7eda096f34 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c" status: 404 len: 111 microversion: 2.1 time: 0.084976 Oct 10 11:11:00.019476 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2848/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:10:59 2022] GET /compute/v2.1/servers/cda8e305-1a7e-4f4c-8315-2f3f54809a3c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:11:00.713724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f2ac4f9-f8af-4afd-bf3e-2a3aac9c8f0b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '.version_select at 0x7f677783edc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:00.792285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f2ac4f9-f8af-4afd-bf3e-2a3aac9c8f0b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2143178125" status: 202 len: 0 microversion: 2.1 time: 0.082889 Oct 10 11:11:00.796669 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2728/5576] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 11:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2143178125 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:11:07.258578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24d66632-7c3c-440c-87ab-a4f64eac8611"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:07.262190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:07.272272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:07.273217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:07.273832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:07.274738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:07.275405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:07.276757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:07.420720 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments HTTP/1.1 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 74 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: {"volumeAttachment": {"volumeId": "24d66632-7c3c-440c-87ab-a4f64eac8611"}} Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'd208fd3e-5f71-4d0f-967c-5da5ec1253a0', 'body': {'volumeAttachment': {'volumeId': '24d66632-7c3c-440c-87ab-a4f64eac8611'}}} Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:11:07.424831 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 Oct 10 11:11:07.430226 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:07.446044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 400 to user: Invalid volume: volume 24d66632-7c3c-440c-87ab-a4f64eac8611 is already attached to instances: d208fd3e-5f71-4d0f-967c-5da5ec1253a0 {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:11:07.448937 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b65a7b3-9f7d-4c63-8797-82d22a1b4cd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200150 Oct 10 11:11:07.456422 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2849/5577] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:11:07 2022] POST /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:11:07.609864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:07.610423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:07.628725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:07.629232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:07.629695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:07.632585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:07.638424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:07.638896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:07.823417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lazy-loading 'services' on Instance uuid d208fd3e-5f71-4d0f-967c-5da5ec1253a0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:11:07.984271 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cab3e6b7-d77e-4b5a-a64d-b17a8570772d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments/24d66632-7c3c-440c-87ab-a4f64eac8611" status: 202 len: 0 microversion: 2.1 time: 0.379772 Oct 10 11:11:07.988515 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2729/5578] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:11:07 2022] DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments/24d66632-7c3c-440c-87ab-a4f64eac8611 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:11:07.998263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:08.000550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:08.022567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:08.024615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:08.025702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:08.028290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:08.031368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:08.032033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:08.194530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de6e0072-4119-4fdf-88f7-f78d4a791b2a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201777 Oct 10 11:11:08.199532 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2850/5579] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:07 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:09.221097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:09.224585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:09.239339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:09.240337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:09.240975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:09.241883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:09.243344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:09.243958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:09.285076 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6586d97c-3f7d-4f50-b7df-64b0386aa662 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072685 Oct 10 11:11:09.286372 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2730/5580] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:09 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:10.299342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:10.302669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:10.324697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:10.330291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:10.331344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:10.335822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:10.337249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:10.339122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:10.459656 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6bf93fc1-e172-45c4-bf2a-77fa8eef2547 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161661 Oct 10 11:11:10.466448 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2851/5581] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:10 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:11.488475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:11.512521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:11.531764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:11.550587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:11.554042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:11.554772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:11.556318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:11.559876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:11.560467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:11.633539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:11.679404 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e565e887-3c82-4a12-9827-7fb75d763210 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201931 Oct 10 11:11:11.684954 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2731/5582] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:11 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:12.693141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:12.700546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:12.716438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=27 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:12.729655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:12.730171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:12.731785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:12.732545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:12.733019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:12.733458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:12.743684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:12.814924 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3019fb0b-a0bd-4a1b-a35c-31f0258c49fb tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127046 Oct 10 11:11:12.816214 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2852/5583] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:12 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:13.829252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:13.831943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:13.846892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:13.849888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:13.850842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:13.851802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:13.860177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:13.861301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:13.938722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5780af6f-3298-4b4d-bf4c-70dfc0e9093b tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114329 Oct 10 11:11:13.946257 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2732/5584] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:13 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:14.953367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:14.955837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:14.972987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:14.973649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:14.974221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:14.975080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:14.975646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:14.976851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:15.049044 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dcc33808-8dbf-44e3-a27b-cac0b1ae7250 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099310 Oct 10 11:11:15.056399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2853/5585] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:14 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:11:16.064121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:16.067540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:16.090028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:16.090829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:16.092530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:16.096792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:16.097679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:16.098305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:16.196445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e420a455-e6fa-4786-92e3-5bd782e0b526 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137408 Oct 10 11:11:16.197202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2733/5586] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:16 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:17.211108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:17.216159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:17.229760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:17.231035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:17.231625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:17.233164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:17.234011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:17.234609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:17.288336 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d5544e9-9829-4852-a69a-81d45aec0064 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082126 Oct 10 11:11:17.295199 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2854/5587] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:17 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:18.303916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:18.306102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:18.338502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.339047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.339504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:18.340461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.341104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.341716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:18.421399 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f1f651f-301e-4f54-86b9-90984b2bdd07 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121719 Oct 10 11:11:18.425962 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2734/5588] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:11:18 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:11:18.538099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:18.539248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:18.553477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.554234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.554841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:18.555838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.556460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.557167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:18.649498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:11:18.898096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89db277e-420a-4c8a-ac07-707458cf1790 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 204 len: 0 microversion: 2.1 time: 0.375797 Oct 10 11:11:18.899202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2855/5589] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:11:18 2022] DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:11:18.907751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:18.908637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:18.920837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.921963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.922607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:18.923563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:18.924193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:18.927049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:19.113467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:19.123059 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-403620ad-42c7-4369-8e37-fd48005d1bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1682 microversion: 2.1 time: 0.219069 Oct 10 11:11:19.124202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2735/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:18 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:19.683125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-558342490", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "552e2d56-3451-4d47-b52a-5f72353e3857", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:19.882992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:11:20.154779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:20.155458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:20.172384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:20.172873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:20.173327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:20.174048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:20.174509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:20.174940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:21.784734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:21.812593 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4ec5e11-72d9-45af-9581-487d316015dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1682 microversion: 2.1 time: 1.666272 Oct 10 11:11:21.815453 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2736/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:20 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1682 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:22.412038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:11:22.412587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:11:22.413775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:11:22.414319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:11:22.414975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:11:22.435916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:22.436572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:22.437316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:22.440248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:22.440888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:22.441449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:22.490175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:11:22.508057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:11:22.675897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:11:22.678080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='552e2d56-3451-4d47-b52a-5f72353e3857',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:11:22.843190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:22.845368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:22.872287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:22.872799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:22.873243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:22.882380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:22.882801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:22.883479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:22.970784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89fd93b1-b5ac-4a93-a281-ac0bdad41ad2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.292959 Oct 10 11:11:22.977207 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2856/5592] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:11:22.998225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5477b9ee-2a37-4506-9791-52295d5c6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:22.998516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5477b9ee-2a37-4506-9791-52295d5c6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:23.344183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5477b9ee-2a37-4506-9791-52295d5c6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:23.360951 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5477b9ee-2a37-4506-9791-52295d5c6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1056 microversion: 2.1 time: 0.376729 Oct 10 11:11:23.363335 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2857/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:22 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1056 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:23.725928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:23.740293 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f9a89e1-8c21-40b1-8ec5-5c851cf9e6dc tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1682 microversion: 2.1 time: 0.901723 Oct 10 11:11:23.742587 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2737/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:22 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1682 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:24.386989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:24.387646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:24.429500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:24.438335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:24.442646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:24.446863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:24.447795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:24.448471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:24.725046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:24.739376 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72b67bc8-b809-4d56-a20b-41ca1f123055 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1106 microversion: 2.1 time: 0.356964 Oct 10 11:11:24.755044 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2858/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:24 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1106 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:24.770815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:24.772277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:24.797514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:24.801620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:24.804575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:24.805775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:24.810374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:24.814960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:25.155852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d208fd3e-5f71-4d0f-967c-5da5ec1253a0", "name": "network-vif-deleted", "tag": "e7de66c1-e529-43f6-ae12-952e1ff81b12"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:25.178134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:25.193463 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06a531e5-abfd-4960-bd82-0db7ba342464 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 200 len: 1614 microversion: 2.1 time: 0.426806 Oct 10 11:11:25.194394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:25.195846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:25.200697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:25.201023 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2738/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:24 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 1614 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:25.236426 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] Creating event network-vif-deleted:e7de66c1-e529-43f6-ae12-952e1ff81b12 for instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 on n-h2-860687-2 Oct 10 11:11:25.258248 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1fdca5c1-94e4-465a-96ef-f71168e9ac87 req-fbcc7f1b-59f5-42e1-b455-de25c20c83fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105957 Oct 10 11:11:25.261638 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2859/5597] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:11:25.767040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:25.768083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:25.784525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:25.785849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:25.786529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:25.794429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:25.802866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:25.803621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:26.136805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:26.165229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d17040b9-5a13-4669-9ffc-f4730369b72e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1162 microversion: 2.1 time: 0.386354 Oct 10 11:11:26.195061 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2739/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:25 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1162 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:26.224632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:26.225538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:26.255260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:26.256036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:26.256650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:26.257833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:26.264855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:26.269638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:26.319932 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 HTTP/1.1 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd208fd3e-5f71-4d0f-967c-5da5ec1253a0'} Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:11:26.321628 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-88ef175a-6831-4821-a18d-a24ee9c038ba tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 404 len: 111 microversion: 2.1 time: 0.103308 Oct 10 11:11:26.327513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2860/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:26 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:11:26.336524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c3c610c-8ddb-46e8-9558-e26336ecf3e0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '.version_select at 0x7f67777d4790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:26.387427 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c3c610c-8ddb-46e8-9558-e26336ecf3e0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397386366" status: 202 len: 0 microversion: 2.1 time: 0.054847 Oct 10 11:11:26.388031 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2740/5600] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 11:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397386366 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:11:27.206857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:27.210303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:27.220136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:27.231571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:27.232837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:27.238919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:27.240193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:27.243112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:27.438746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:27.459941 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-678fdd1a-73e1-4b78-8324-2b1f1e5d9874 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1172 microversion: 2.1 time: 0.260060 Oct 10 11:11:27.460790 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2861/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:27 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1172 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:28.489870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:28.490496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:28.510617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:28.511445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:28.515693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:28.516783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:28.519199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:28.519811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:28.633051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5e151b2e-073b-4ef4-b5bf-0c094492740a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: .version_select at 0x7f677766bdc0>, body: {"keypair": {"name": "tempest-keypair-1107134135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnePwQVmZzNrpJLQoVA5wyFgBBGK/QkHAwdAwJaQWBWqY5WpNP+IxmQW9cLbE1iKNaS8sA0vyFUsbRzkiYqYitdlZYFAdaiefohtwZZ5O74wQKH6kdkQ4UVXkdb1R7d1Q=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:28.703295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5e151b2e-073b-4ef4-b5bf-0c094492740a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:11:28.730481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-5e151b2e-073b-4ef4-b5bf-0c094492740a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:11:28.746219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:28.763946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04c15a3e-e411-4ccb-bc5a-f0156de95934 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1172 microversion: 2.1 time: 0.280348 Oct 10 11:11:28.767491 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2741/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:28 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1172 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:28.802640 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5e151b2e-073b-4ef4-b5bf-0c094492740a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173187 Oct 10 11:11:28.803731 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2862/5603] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:11:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:11:29.792345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:29.793283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:29.803904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:29.809518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:29.810587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:29.811486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:29.814587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:29.815207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:30.100419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:30.116666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee3a34cb-8a8c-4839-aa1c-7643b08f89d4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1172 microversion: 2.1 time: 0.322466 Oct 10 11:11:30.122140 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2742/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:29 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1172 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:31.145408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:31.146033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:31.155679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:31.159555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:31.160225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:31.165105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:31.166205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:31.166664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:31.777673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:31.795359 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b0ccb9f-4a2c-43d6-b6d0-a2a551236378 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1214 microversion: 2.1 time: 0.654982 Oct 10 11:11:31.802604 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2863/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:31 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1214 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:31.892517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b35da58-9bfd-4ab8-be23-71cc35c1a24b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: .version_select at 0x7f677781ff70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-863496444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1XwwMifn9IYK3+DHHKw71UAitExoh9hPW2JpnxPynCwWWlFFkg3eIqTote2wQ7rSbcQDm68mx3C5+oTvnNvKvcY6Y3J5WXpAv6uoBCq5EX/hm8IlqQDibAUF2uBiVgfA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:31.927952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7b35da58-9bfd-4ab8-be23-71cc35c1a24b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:11:31.944410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7b35da58-9bfd-4ab8-be23-71cc35c1a24b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:11:31.990605 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b35da58-9bfd-4ab8-be23-71cc35c1a24b tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.101804 Oct 10 11:11:31.991261 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2743/5606] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:11:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:32.832415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:32.834267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:32.844924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:32.863461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:32.864452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:32.865149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:32.866048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:32.866865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:32.867867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:33.304115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:33.315766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-611dee11-0871-4157-8274-42977d61b751 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1214 microversion: 2.1 time: 0.491299 Oct 10 11:11:33.316364 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2864/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:32 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1214 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:33.871830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57f0ca0-e56a-448f-81ef-84d456af0509", "tag": "4c2100de-3eee-436f-b693-8a68ec8a68e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:33.890629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:33.891171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:33.892799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:33.923146 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] Creating event network-changed:4c2100de-3eee-436f-b693-8a68ec8a68e4 for instance f57f0ca0-e56a-448f-81ef-84d456af0509 on n-h1-860687-2 Oct 10 11:11:33.937018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bb5923c1-f961-49f0-9a87-f95d5718d266 req-26e952f5-9190-43c7-a720-a1f45b6494be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067858 Oct 10 11:11:33.938337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2744/5608] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:34.345210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:34.345900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:34.364659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:34.365168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:34.365827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:34.366733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:34.367398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:34.368332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:35.279038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:35.292279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07f54af1-1c09-4a3a-a81d-b1987f7e8f54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1214 microversion: 2.1 time: 0.952017 Oct 10 11:11:35.293191 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2865/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:34 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1214 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:36.323562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:36.324429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:36.340048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:36.342865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:36.343911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:36.345422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:36.348476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:36.351727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:36.447592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-265332607", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "d8856318-4a88-4d60-8135-8a36016cbf67"}], "key_name": "tempest-TestNetworkBasicOps-863496444", "security_groups": [{"name": "tempest-secgroup-smoke-1161057487"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:36.552301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:36.564257 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c2cb658-bb16-45f5-9e7a-45f8d78c8133 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.247333 Oct 10 11:11:36.567148 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2745/5610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:36 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:36.642838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-783729075", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c66f5f-64f9-415c-b2e7-430e78e4a9d5"}], "security_groups": [{"name": "tempest-securitygroup--6130011"}], "key_name": "tempest-keypair-1107134135", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:36.656418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] validate_networks() for [('d8856318-4a88-4d60-8135-8a36016cbf67', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:11:36.858235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] validate_networks() for [('21c66f5f-64f9-415c-b2e7-430e78e4a9d5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:11:37.371157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:11:37.372418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:11:37.383369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:11:37.388959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:11:37.389734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:11:37.403753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:37.404558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:37.405259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:37.406413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:37.407422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:37.408242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:37.447805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:11:37.453801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Getting quotas for user 3e5c5e21b1444df2b472f16c7cdf7523 and project 691ebac218dd472ca7245a35f055ad66. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:11:37.468732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:11:37.471445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:11:37.544067 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ce51fe36-a191-4f50-8ba8-a7c5aa1475f3 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.100065 Oct 10 11:11:37.547278 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2866/5611] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:11:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:11:37.564822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2484199f-d526-46d3-9728-32cf4a52c7c6 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:37.565951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2484199f-d526-46d3-9728-32cf4a52c7c6 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:37.677833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2484199f-d526-46d3-9728-32cf4a52c7c6 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:37.688747 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2484199f-d526-46d3-9728-32cf4a52c7c6 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1247 microversion: 2.1 time: 0.133822 Oct 10 11:11:37.693708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2867/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:37 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1247 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:37.707252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:37.711399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:37.724964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:37.727625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:37.728855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:37.729790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:37.730437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:37.731093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:38.063979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:11:38.064982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:11:38.065711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:11:38.066299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:11:38.067205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:11:38.083055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:38.083563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:38.084230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:38.088363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:38.089130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:38.089810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:38.120494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:38.131038 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2299276a-6e37-469c-8b16-68628e4e6469 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.435254 Oct 10 11:11:38.132279 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2868/5613] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:37 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:38.141226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:11:38.153003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Getting quotas for user 8351cc0551a249848d771e2557458240 and project 961675ffd25642ce8950a792b8ca8188. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:11:38.201756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:11:38.204371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:11:38.273375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-088769a8-db2e-4c76-b841-ad0986d73bed tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.635610 Oct 10 11:11:38.274637 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2746/5614] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:11:36 2022] POST /compute/v2.1/servers => generated 399 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:11:38.285840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c81510e4-b6ce-4d43-bac6-a61a29ca237d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:38.301631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c81510e4-b6ce-4d43-bac6-a61a29ca237d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:38.376683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c81510e4-b6ce-4d43-bac6-a61a29ca237d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:38.388472 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c81510e4-b6ce-4d43-bac6-a61a29ca237d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1241 microversion: 2.1 time: 0.106064 Oct 10 11:11:38.389397 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2869/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:38 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:38.719858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:38.720611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:38.784466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:38.792731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:38.796288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:38.797483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:38.798559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:38.799735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:39.010509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:39.028053 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8165fe24-a428-4d31-ae7e-3159636ed567 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1299 microversion: 2.1 time: 0.314132 Oct 10 11:11:39.045739 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2747/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:38 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1299 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:39.162332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:39.162903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:39.193425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:39.194001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:39.194465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:39.195252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:39.199989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:39.203967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:39.414404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:39.415806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:39.425737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:39.430100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:39.430842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:39.434808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:39.435834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:39.436935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:39.812635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:39.822137 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7495fb79-e0b1-4a2f-a612-1d756acebb39 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1237 microversion: 2.1 time: 0.414232 Oct 10 11:11:39.831035 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2748/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:39 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1237 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:40.060330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:40.061254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:40.110308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:40.121842 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4b87549-898b-465c-a9f0-102cfa0e77e0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.963764 Oct 10 11:11:40.123340 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2870/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:39 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:40.147824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:40.148976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:40.150260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:40.152808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:40.153847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:40.154519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:40.457686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:40.472295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-938ddb69-1202-4e75-b3dc-cc5f7cc8463c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1305 microversion: 2.1 time: 0.415116 Oct 10 11:11:40.475993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2749/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:40 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1305 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:40.858572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:40.859819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:40.875394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:40.876960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:40.877606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:40.884500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:40.885363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:40.886050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:41.147464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:41.148503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:41.171281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:41.171958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:41.173411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:41.175095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:41.175871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:41.178442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:41.309552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:41.323758 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43af5c2f-e189-4f19-988c-54d76f5e3fb9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1299 microversion: 2.1 time: 0.469259 Oct 10 11:11:41.324603 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2871/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:40 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1299 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:41.503341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:41.504077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:41.514755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:41.517109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:41.517860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:41.519627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:41.521268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:41.521893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:41.617233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:41.628464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-715a6e33-24b3-47de-bdd0-90f19e56531f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.486115 Oct 10 11:11:41.628968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2750/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:41 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:41.682811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:41.694630 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3631f1a9-f8e1-45ac-8dd9-acbff25c1008 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1305 microversion: 2.1 time: 0.195576 Oct 10 11:11:41.712759 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2872/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:41 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:42.373887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:42.374604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:42.387632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:42.389158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:42.389589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:42.395886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:42.396509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:42.396986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:42.397415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:42.408984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:42.665456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:42.666363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:42.702083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:42.702602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:42.703087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:42.707090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:42.708432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:42.714522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:43.213155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:43.219078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:43.231222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4bb52cdb-9854-490a-8cce-8793ebcc4957 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.573521 Oct 10 11:11:43.232547 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2873/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:42 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:43.248072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:43.249125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:43.254929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:43.275634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:43.276155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:43.276603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:43.277554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:43.278193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:43.278798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:43.450971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:43.480468 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7bac79c2-ff95-4614-9216-1c3d01f9992c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 1.128709 Oct 10 11:11:43.485558 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2751/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:42 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:43.500789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2bc5e8d-14ee-4760-98b6-c642d822666f", "tag": "e25c76be-c94b-4de9-bf41-2ce0dc1ab454"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:43.570030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:43.570520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:43.570950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:43.590292 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] Creating event network-changed:e25c76be-c94b-4de9-bf41-2ce0dc1ab454 for instance e2bc5e8d-14ee-4760-98b6-c642d822666f on n-h2-860687-2 Oct 10 11:11:43.602275 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c22651ab-fb5c-4329-8439-831ed2f04000 req-065784bf-02c1-40da-ba44-c27c806e2adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112519 Oct 10 11:11:43.604379 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2752/5625] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:43.732842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:43.746942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d367497-0e24-4809-9a53-52ed7eecbf99 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.512992 Oct 10 11:11:43.751175 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2874/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:43 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:44.259782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:44.260603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:44.273271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.273775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.274209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.275795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.279440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.280233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.309580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49", "tag": "975e01fa-5a3b-43c9-8e97-c87d146a2d5d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:44.326297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.327098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.328506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.350344 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] Creating event network-changed:975e01fa-5a3b-43c9-8e97-c87d146a2d5d for instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 on n-h2-860687-2 Oct 10 11:11:44.369438 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-16974029-a6a2-46f2-b5c8-501611fefaba req-56363a78-c615-498e-8010-acfb281173fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063431 Oct 10 11:11:44.370639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2875/5627] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:44.511035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:44.512154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:44.522507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.525199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.525970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.527095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.527796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.528625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.712724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:44.731356 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e1e9700-e17e-4a3f-9407-b043012921b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.474791 Oct 10 11:11:44.746677 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2753/5628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:44 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:44.782453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:44.783626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:44.788546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:44.791537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.792571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.793267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.794379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:44.795113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:44.795809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:44.797970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b21c9ac-eff3-4d6e-9072-18bc89db67c9 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.291905 Oct 10 11:11:44.799048 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2876/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:44 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:45.139555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:45.155435 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c7d0705-724a-43b7-a780-58a45d95e5e9 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.372461 Oct 10 11:11:45.171094 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2754/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:44 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:45.752553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:45.753654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:45.772720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:45.773627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:45.774088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57f0ca0-e56a-448f-81ef-84d456af0509", "name": "network-vif-plugged", "status": "completed", "tag": "4c2100de-3eee-436f-b693-8a68ec8a68e4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:45.775772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:45.776797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:45.777520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:45.778187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:45.816087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:45.816868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:45.818713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:45.847174 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] Creating event network-vif-plugged:4c2100de-3eee-436f-b693-8a68ec8a68e4 for instance f57f0ca0-e56a-448f-81ef-84d456af0509 on n-h1-860687-2 Oct 10 11:11:45.861572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6f25c513-3ab7-422f-adfd-79c06efdd2bc req-2222c5be-7931-4113-89a3-ed3e52349b78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094093 Oct 10 11:11:45.869856 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2755/5631] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:11:45.936593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:45.940372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:45.971095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:45.971742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:45.972284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:45.973675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:45.975497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:45.978366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:46.141906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:46.157307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f862fe43-8b5f-430f-b887-a8edf50a1845 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.409175 Oct 10 11:11:46.158007 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2877/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:45 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:46.180244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:46.181532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:46.193245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:46.193645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:46.194232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:46.195428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:46.197638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:46.198149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:46.247751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:46.257752 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5d8f520-bd32-4a41-995c-a66d033cd422 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.385850 Oct 10 11:11:46.258884 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2756/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:45 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:46.442450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:46.453303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-01117b85-6906-4e01-a98d-8dee98093746 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.276473 Oct 10 11:11:46.472120 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2878/5634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:46 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:47.185408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:47.186673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:47.195207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.195964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.197162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.198133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.198771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.199409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.281579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:47.282882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:47.296037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.297755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.298864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.300997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.300997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.303662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.430264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:47.675694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:47.684280 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fef0b26f-aa9b-4b9e-b05f-aebc93052fd0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1202 microversion: 2.1 time: 0.502704 Oct 10 11:11:47.688700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2757/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:47 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1202 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:47.703092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:47.704001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:47.715316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.716132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.716790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.717689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:47.727877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:47.728867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:47.837829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:47.848406 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c02cd49-1b94-4239-997d-5f43feb7d8a0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.571107 Oct 10 11:11:47.849595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2879/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:47 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:48.063174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:48.071405 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e32daafd-9f4a-46dc-8749-6f82e8308f13 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.381329 Oct 10 11:11:48.072006 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2758/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:47 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:48.716662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:48.719022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:48.728605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=22 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:48.740994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:48.741571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:48.742026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:48.747108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:48.747865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:48.748474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:48.878007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:48.878635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:48.880955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:48.882824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:48.894966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:48.905848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:48.906471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:48.907247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:48.907731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:48.908169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.146377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:49.147354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:49.157670 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e1e1249-8d48-4eb8-b0fd-82dc33e1e2e8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.284504 Oct 10 11:11:49.170674 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-428d8bf8-19be-45e2-9d26-1a5ecbb0764c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1390 microversion: 2.1 time: 0.457661 Oct 10 11:11:49.183045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2759/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:48 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:49.183506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2880/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:48 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:49.183606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:49.183606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:49.188540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.189766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.190442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.191359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.191885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.192657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.195320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:49.196958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:49.225479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.227680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.228282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.230410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.232544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.233528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.549140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:49.562745 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6378ed62-e63c-405c-9692-8da990404b29 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.389618 Oct 10 11:11:49.566561 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2760/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:49 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:49.590096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:49.604408 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6918975e-8ee5-4063-bf6d-cbae9a18b10f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1390 microversion: 2.1 time: 0.413623 Oct 10 11:11:49.612185 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2881/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:49 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:49.624302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49", "name": "network-vif-plugged", "status": "completed", "tag": "975e01fa-5a3b-43c9-8e97-c87d146a2d5d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:49.634531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:49.635655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:49.643037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.643534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.643969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.644801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.645535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.646201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.647335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.648099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:49.648935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:49.671878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] Creating event network-vif-plugged:975e01fa-5a3b-43c9-8e97-c87d146a2d5d for instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 on n-h2-860687-2 Oct 10 11:11:49.676974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-97c39149-9ab2-4b15-be5f-d31675cb3f53 req-95a135d5-5ad3-4d63-813d-0cbcd9b6323c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056255 Oct 10 11:11:49.677589 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2761/5642] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:49.952753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:49.963076 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d041d29-3123-49e5-bc22-c1ebf24c7d4c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1390 microversion: 2.1 time: 0.333035 Oct 10 11:11:49.970345 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2882/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:49 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:49.990907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:49.991518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:49.998652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:49.999167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.000286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.001171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.001797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.002388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.037519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:11:50.122557 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e98c2706-a7c7-4c5e-a43e-8d36d6ea896b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 204 len: 0 microversion: 2.1 time: 0.136784 Oct 10 11:11:50.126785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2762/5644] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:11:49 2022] DELETE /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:11:50.131962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:50.132583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:50.141086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.141804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.142439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.143813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.144274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.144701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.194550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:50.197402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:50.209512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.217258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.217850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.218829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.219434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.220004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.302846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:50.314309 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f47b8545-2dfd-4c66-bfa7-44afcd718ea7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1396 microversion: 2.1 time: 0.186227 Oct 10 11:11:50.316898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2883/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:50 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1396 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:50.473900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:50.486730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee62400a-1c67-4ffc-a57c-5e50cbdc4a90 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.303747 Oct 10 11:11:50.487901 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2763/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:50 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:50.588335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:50.589281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:50.599082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.600095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.600816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.601800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:50.603108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:50.603778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:50.940764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:50.948606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e051e6f-8547-4524-95b3-0682f0143707 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.364959 Oct 10 11:11:50.949197 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2884/5647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:50 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1373 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:51.345163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:51.346587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:51.358129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:51.360704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:51.361356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:51.362079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:51.362543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:51.362983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:51.517274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:51.517917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:51.530457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:51.530959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:51.531431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:51.532159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:51.532625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:51.533055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:52.165030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:52.182546 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07bf7625-2997-4db3-b100-c24f0b1918d2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1396 microversion: 2.1 time: 0.840924 Oct 10 11:11:52.183644 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2764/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:51 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1396 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:52.193198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2bc5e8d-14ee-4760-98b6-c642d822666f", "name": "network-vif-plugged", "status": "completed", "tag": "e25c76be-c94b-4de9-bf41-2ce0dc1ab454"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:52.225816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:52.227063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:52.228080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:52.257394 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] Creating event network-vif-plugged:e25c76be-c94b-4de9-bf41-2ce0dc1ab454 for instance e2bc5e8d-14ee-4760-98b6-c642d822666f on n-h2-860687-2 Oct 10 11:11:52.267768 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1b532349-4eea-410a-948f-67ace3dc2c2e req-e482ec0f-4d62-4d0f-9800-4baa7c359d14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082385 Oct 10 11:11:52.269999 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2765/5649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:52.296980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:52.299167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:52.327450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:52.333679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:52.346970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8750bdfe-af42-46f9-b56e-5573a9c35de3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 0.839767 Oct 10 11:11:52.347591 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2885/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:51 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:52.348332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:52.349298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:52.350233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:52.350855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:52.351483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:52.786490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:52.823027 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a68987a-6dae-4a1a-a7f4-5ffec9aa0eeb tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1545 microversion: 2.1 time: 0.536039 Oct 10 11:11:52.828751 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2766/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:52 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1545 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:52.855783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:52.856502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:52.875392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:52.901211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:52.905842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:52.909939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:52.910663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:52.915277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:53.243737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:53.261884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcc7f35f-a62c-423c-a340-86282f38cdf1 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1545 microversion: 2.1 time: 0.410304 Oct 10 11:11:53.263433 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2767/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:52 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1545 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:53.270410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:53.271270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:53.278380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:53.299572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:53.300203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:53.300983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:53.301468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:53.301909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:53.357295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57f0ca0-e56a-448f-81ef-84d456af0509", "name": "network-vif-deleted", "tag": "4c2100de-3eee-436f-b693-8a68ec8a68e4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:53.368589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:53.369547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:53.370182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:53.383053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] Creating event network-vif-deleted:4c2100de-3eee-436f-b693-8a68ec8a68e4 for instance f57f0ca0-e56a-448f-81ef-84d456af0509 on n-h1-860687-2 Oct 10 11:11:53.391275 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-22db3d23-3df0-4897-8814-4bc9e2563796 req-5df1f037-a8f1-490d-82c0-84ce0a2c8359 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.622447 Oct 10 11:11:53.392369 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2886/5653] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:11:53.400409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:53.426873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:53.462329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:53.463535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:53.464520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:53.467732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:53.468750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:53.471450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:54.011013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:54.016597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:11:54.043583 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-602f9495-79a1-414d-b6f3-5b7856553f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.778684 Oct 10 11:11:54.048014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2768/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:53 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:54.496576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:54.507611 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a72feb82-aa8e-407f-83d5-523bccc175c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1364 microversion: 2.1 time: 1.111729 Oct 10 11:11:54.508619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2887/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:53 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1364 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:55.076654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:55.077885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:55.086029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:55.087461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:55.088251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:55.089141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:55.089802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:55.090499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:55.195598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:55.208509 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65c01a14-ce40-4c9f-a2dc-68b64307fc74 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.138343 Oct 10 11:11:55.212626 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2769/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:55 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:55.535378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:55.536674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:55.550519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:55.551269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:55.552109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:55.553244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:55.563893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:55.565899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:56.233228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:56.233859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:56.249136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:56.249636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:56.250075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:56.250788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:56.251271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:56.251696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:56.462115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:56.473445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84ea6131-251c-4f23-8ee0-7cf2da5bfee2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.244133 Oct 10 11:11:56.475401 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2770/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:56 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:56.702183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:56.729489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f132ea5-19da-4e9e-81d4-15c406dc3654 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1554 microversion: 2.1 time: 1.198049 Oct 10 11:11:56.734441 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2888/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:55 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1554 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:11:56.759932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:56.760431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:56.771607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:56.772097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:56.772531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:56.773231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:56.777883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:56.778363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:57.162058 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-383f6d9f-e92d-4262-bf28-461bad0da2e2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.403201 Oct 10 11:11:57.171429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2771/5659] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:11:56 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-interface => generated 284 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:57.500013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:57.500641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:57.532618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:57.533135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:57.533597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:57.534327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:57.537589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:57.538068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:57.804013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:57.815676 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1568fb6c-a14c-498f-b6a3-08e5d7a0ce61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.320816 Oct 10 11:11:57.835146 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2889/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:57 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:58.189362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49", "tag": "975e01fa-5a3b-43c9-8e97-c87d146a2d5d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:58.215790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:58.216273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:58.216704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:58.266794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] Creating event network-changed:975e01fa-5a3b-43c9-8e97-c87d146a2d5d for instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 on n-h2-860687-2 Oct 10 11:11:58.282412 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cdd36db1-f2a8-4320-b985-03f30dc648ad req-8e100daa-595a-43e8-98e1-96e4908f392e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098017 Oct 10 11:11:58.283687 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2772/5661] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:11:58.842745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:11:58.844301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:11:58.864945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:58.871689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:58.872288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:58.873228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:58.876129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:58.876704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:59.036776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:11:59.053742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8a5961fd-2e9a-4a65-af13-66c25d9c41fb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.215008 Oct 10 11:11:59.054832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2890/5662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:11:58 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:11:59.552345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2bc5e8d-14ee-4760-98b6-c642d822666f", "tag": "e25c76be-c94b-4de9-bf41-2ce0dc1ab454"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:11:59.573540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:11:59.574182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:11:59.574880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:11:59.604176 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] Creating event network-changed:e25c76be-c94b-4de9-bf41-2ce0dc1ab454 for instance e2bc5e8d-14ee-4760-98b6-c642d822666f on n-h2-860687-2 Oct 10 11:11:59.615968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9eeb9037-0ee7-4f5e-b5b9-3eb730bc7f81 req-3089dd4e-cbe9-4eda-996e-f72bf3355f0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068379 Oct 10 11:11:59.622421 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2773/5663] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:00.089925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:00.093657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:00.101830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:00.103681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:00.104308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:00.105500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:00.106141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:00.106742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:00.629476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:00.633861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:00.644030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2d17270-cce9-4e2a-a330-bfdf41f79a5c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 200 len: 1187 microversion: 2.1 time: 0.566456 Oct 10 11:12:00.660534 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2891/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:00 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 1187 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:01.682623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:01.683482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: f57f0ca0-e56a-448f-81ef-84d456af0509] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:01.697786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:01.698282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:01.698719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:01.719381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:01.721015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:01.721757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:01.752846 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 HTTP/1.1 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'f57f0ca0-e56a-448f-81ef-84d456af0509'} Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:01.754840 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. Oct 10 11:12:01.762065 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:01.764322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance f57f0ca0-e56a-448f-81ef-84d456af0509 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:12:01.765400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2705eb52-a9cb-42c3-8775-721e03720689 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509" status: 404 len: 111 microversion: 2.1 time: 0.099183 Oct 10 11:12:01.769691 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2774/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:01 2022] GET /compute/v2.1/servers/f57f0ca0-e56a-448f-81ef-84d456af0509 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:12:09.850585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1213115328", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ed82d6bb-dcc7-4b2e-b226-5f66f4db0252", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:09.936091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:12:10.574317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:12:10.574750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:12:10.575268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:12:10.575728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:12:10.576143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:12:10.605935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:10.606725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:10.607368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:10.608317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:10.611760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:10.612536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:10.655670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:12:10.668875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:12:10.853491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:12:10.855809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed82d6bb-dcc7-4b2e-b226-5f66f4db0252',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:12:11.119283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8af56583-c96f-485f-ada8-9ad4450c6260 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273402 Oct 10 11:12:11.120740 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2892/5666] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:12:11.133150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c626488-8fc1-452f-b174-0bc0ca5bc140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:11.134192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c626488-8fc1-452f-b174-0bc0ca5bc140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:11.260952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c626488-8fc1-452f-b174-0bc0ca5bc140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:11.269785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c626488-8fc1-452f-b174-0bc0ca5bc140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1057 microversion: 2.1 time: 0.141979 Oct 10 11:12:11.271148 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2775/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:11 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1057 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:12.312685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:12.315209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:12.338210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:12.338763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:12.339328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:12.340456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:12.341706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:12.342155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:12.454513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:12.465672 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d299eb1c-91f9-4278-97d6-f8c4bba30ec7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1155 microversion: 2.1 time: 0.165293 Oct 10 11:12:12.467153 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2893/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:12 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1155 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:13.490752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:13.492505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:13.518951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=23 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:13.527673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:13.529825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:13.530692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:13.531961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:13.534013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:13.534686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:13.536025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:13.727123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:13.741451 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0db76557-d879-4018-9550-d225e9d76207 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1173 microversion: 2.1 time: 0.255706 Oct 10 11:12:13.743421 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2776/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:13 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1173 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:14.766918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:14.768361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:14.771485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:14.807413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:14.809462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:14.810737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:14.813152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:14.815639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:14.816629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:15.460437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:15.478620 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e71f253f-e20f-42ef-a3cc-5c420121398b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1215 microversion: 2.1 time: 0.716997 Oct 10 11:12:15.479284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2894/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:14 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1215 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:15.514302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c3330c-a910-4d20-a6c3-c366005141a0", "tag": "4a93ce90-d896-471b-86c6-c4df87533002"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:15.551507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:15.555681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:15.556340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:15.603686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] Creating event network-changed:4a93ce90-d896-471b-86c6-c4df87533002 for instance d8c3330c-a910-4d20-a6c3-c366005141a0 on n-h1-860687-2 Oct 10 11:12:15.619547 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-60b42f72-da6f-46eb-a9aa-f5d286ff4942 req-a65d45b2-4873-4656-8b02-1dc9b93b58e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109547 Oct 10 11:12:15.620172 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2777/5671] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:16.501699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:16.504096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:16.512690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:16.513549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:16.514230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:16.515258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:16.515956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:16.516754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:16.538421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:16.540920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:16.557576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:16.562440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:16.564082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:16.565043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:16.565624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:16.566130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:16.647321 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04728c16-e3b5-4f08-a32e-f0605d5f15f2 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49/action" status: 200 len: 24563 microversion: 2.1 time: 0.113241 Oct 10 11:12:16.647981 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2778/5672] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:12:16 2022] POST /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49/action => generated 24563 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:12:16.875904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:16.885150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-13503d1b-5668-41c0-9093-6371dfdc6756 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1215 microversion: 2.1 time: 0.387363 Oct 10 11:12:16.911741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2895/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:16 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1215 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:17.925607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:17.927418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:17.948737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:17.949242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:17.953612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:17.954681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:17.955931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:17.956786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:18.786016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:18.796204 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36083204-4a26-453f-b466-267ffa1c1f05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1215 microversion: 2.1 time: 0.876449 Oct 10 11:12:18.812906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2779/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:17 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1215 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:19.823892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:19.825492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:19.838486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:19.840588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:19.842005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:19.850529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:19.854008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:19.860008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:20.185255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:20.203728 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1971280a-02d4-4fc6-b23c-041bae3ca17a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1215 microversion: 2.1 time: 0.383379 Oct 10 11:12:20.216022 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2896/5675] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:19 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:21.230648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:21.231368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:21.241140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:21.241726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:21.242153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:21.242873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:21.243366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:21.249481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:21.299549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:21.511980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:21.522459 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16131dc9-54a7-492f-80c2-4e208eefd706 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.296377 Oct 10 11:12:21.524243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2780/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:21 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:22.547851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:22.548668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:22.556081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:22.558257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:22.569688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:22.570597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:22.574733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:22.577641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:22.580470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:22.581089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:22.760364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:22.771154 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-891d9091-066e-4212-b8a9-e548b5ef22bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.227639 Oct 10 11:12:22.772605 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2897/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:22 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:23.794977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:23.795941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:23.811079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:23.811585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:23.812026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:23.812726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:23.813182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:23.813679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:24.090007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:24.102841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-687a2759-0703-4384-b777-b369251bf5eb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.311723 Oct 10 11:12:24.106023 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2781/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:23 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:25.130676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:25.132781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:25.145395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:25.146884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:25.155607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:25.156424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:25.156915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:25.157351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:25.396378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:25.413853 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3035680-cd03-4620-903e-49403a15cc7e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.289430 Oct 10 11:12:25.414966 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2898/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:25 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:26.442751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:26.443837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:26.455913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:26.456547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:26.457110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:26.458337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:26.458988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:26.459550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:26.918011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:26.928021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12924b0e-6ba4-46d6-8a19-a2872305bb48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.494336 Oct 10 11:12:26.940537 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2782/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:26 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:27.627725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:27.630951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:27.641041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:27.649498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:27.651365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:27.651365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:27.651365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:27.651653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:27.721902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41ff719a-486b-4295-a572-79c82850c413 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "POST /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49/action" status: 200 len: 32632 microversion: 2.1 time: 0.098154 Oct 10 11:12:27.729873 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2899/5681] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:12:27 2022] POST /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49/action => generated 32632 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:12:27.953835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:27.955471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:27.967672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:27.968756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:27.970382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:27.971382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:27.973404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:27.974106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:28.450403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:28.461884 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81804d85-79df-4987-bd63-aa4fac84f791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.510440 Oct 10 11:12:28.464129 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2783/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:27 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:29.203201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:29.204407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:29.216352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:29.216871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:29.217297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:29.218014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:29.218480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:29.218911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:29.282921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29f1bed5-70e7-423e-8aa4-541f6249043d tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/ips" status: 200 len: 149 microversion: 2.1 time: 0.495601 Oct 10 11:12:29.290745 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2900/5683] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:12:28 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/ips => generated 149 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:29.498842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:29.500929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:29.525231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:29.525749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:29.526199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:29.527347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:29.527491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:29.527846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:30.180709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:30.193118 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ca3df0c-5289-4d8d-848a-55b9ee09c096 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.693898 Oct 10 11:12:30.196355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2784/5684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:29 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:30.410230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c3330c-a910-4d20-a6c3-c366005141a0", "name": "network-vif-plugged", "status": "completed", "tag": "4a93ce90-d896-471b-86c6-c4df87533002"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:30.439429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:30.439924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:30.440366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:30.474638 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] Creating event network-vif-plugged:4a93ce90-d896-471b-86c6-c4df87533002 for instance d8c3330c-a910-4d20-a6c3-c366005141a0 on n-h1-860687-2 Oct 10 11:12:30.520998 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-df186c21-7870-4077-8609-fd82e304c275 req-3365ce77-ca43-4b2f-9ce3-2ba5012d28b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115525 Oct 10 11:12:30.522161 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2901/5685] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:30.749392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:30.750471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:30.767201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:30.767701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:30.768144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:30.772426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:30.773519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:30.773995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:30.780818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49", "tag": "975e01fa-5a3b-43c9-8e97-c87d146a2d5d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:30.811793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:30.822948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:30.825148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:30.848612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=50 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:30.901191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] Creating event network-changed:975e01fa-5a3b-43c9-8e97-c87d146a2d5d for instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 on n-h2-860687-2 Oct 10 11:12:30.922365 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1d8cc228-4e27-488e-a43a-37706d913968 req-f5f7eb6b-0639-4a51-b188-fc2166e484ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145671 Oct 10 11:12:30.924465 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2902/5686] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:12:30.925621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:12:31.113446 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5964117-de1d-4c24-85c4-e843a4eb8eb8 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 204 len: 0 microversion: 2.1 time: 0.369962 Oct 10 11:12:31.114329 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2785/5687] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:12:30 2022] DELETE /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:12:31.124205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:31.125100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:31.144401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:31.145131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:31.145818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:31.146689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:31.147317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:31.148631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:31.222598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:31.223352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:31.253840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:31.254347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:31.254786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:31.255529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:31.255987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:31.256417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:31.765309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:31.779879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69969d03-b6bd-4c2d-a641-b7d0a9212629 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1203 microversion: 2.1 time: 0.561131 Oct 10 11:12:31.780482 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2786/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:31 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1203 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:32.052413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:32.064983 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8d215ca-45ea-476a-8721-1e522842c701 tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1670 microversion: 2.1 time: 0.945770 Oct 10 11:12:32.066393 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2903/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:31 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1670 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:12:32.141687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fff00957-1fe2-4792-8f9d-097c72ce2059"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:32.144458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:32.164962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:32.167318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:32.168006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:32.168949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:32.169580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:32.170175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:32.670422 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5f4c557-caa4-4950-8012-837fb429d6c7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "POST /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532475 Oct 10 11:12:32.675413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2787/5690] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:12:32 2022] POST /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:32.808886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:32.810467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:32.820686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:32.821467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:32.822118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:32.823067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:32.824034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:32.824680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:33.092882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:33.094337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:33.113221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:33.130809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:33.131562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:33.132513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:33.133115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:33.133682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.000962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:34.014397 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d75b162-56c6-4c1a-b812-c2a57d9c587c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1390 microversion: 2.1 time: 1.212517 Oct 10 11:12:34.023171 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2904/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:32 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1390 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:34.051283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:34.052142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:34.052253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:34.060785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bac680f2-2d78-47cf-9e31-b47ed557164c tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1670 microversion: 2.1 time: 0.972124 Oct 10 11:12:34.064431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.065077 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2788/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:33 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1670 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:12:34.065861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.067878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.072060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.075621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.076765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.368119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:34.385549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4d078ba-5a04-4b73-af05-e4358a16fb78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1390 microversion: 2.1 time: 0.338764 Oct 10 11:12:34.387580 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2905/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:34 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:12:34.414587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:34.416760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:34.431810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.435773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.436430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.437726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.438327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.438917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.805927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49", "name": "network-vif-deleted", "tag": "975e01fa-5a3b-43c9-8e97-c87d146a2d5d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:34.844859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.846815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.849512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.873471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:34.878533 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] Creating event network-vif-deleted:975e01fa-5a3b-43c9-8e97-c87d146a2d5d for instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 on n-h2-860687-2 Oct 10 11:12:34.895102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-47682ee2-54d8-434d-ae1f-2a0a989fd545 req-455290d9-0d53-462d-87e4-1a7e1f79644d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102164 Oct 10 11:12:34.895651 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cb0e6b9-c620-45d1-92db-db31602bf62c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1390 microversion: 2.1 time: 0.485058 Oct 10 11:12:34.896018 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2906/5694] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:34.899708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2789/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:34 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1390 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:34.924112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:34.924767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:34.959926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.967034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.967866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:34.975097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:34.984885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:34.988622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.061638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:12:35.097531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:35.100024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:35.112982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:35.113737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:35.114485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.115397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:35.116613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:35.117194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.152405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:35.167982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:35.170871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:35.171982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.172763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lazy-loading 'fault' on Instance uuid ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:12:35.237452 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07af096e-f2d6-476c-a765-7b7d50acdf9b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 204 len: 0 microversion: 2.1 time: 0.317341 Oct 10 11:12:35.244551 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2907/5696] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:12:34 2022] DELETE /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:12:35.259499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:35.259499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:35.265340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:35.265844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:35.266285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.266992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:35.271686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:35.272831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:35.287776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5c5e21b1444df2b472f16c7cdf7523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691ebac218dd472ca7245a35f055ad66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:35.312809 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5467998-506f-45d4-8a1c-969b26dd84ab tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 200 len: 1337 microversion: 2.1 time: 0.222389 Oct 10 11:12:35.313830 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2790/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:35 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 1337 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:35.731974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:35.742524 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a425c2bf-740c-4dad-b48e-dc63c378d90d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1396 microversion: 2.1 time: 0.495251 Oct 10 11:12:35.755546 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2908/5698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:35 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1396 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:36.345056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:36.346546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] [instance: ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:36.358391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:36.364113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:36.364830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:36.368677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:36.370987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:36.371649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:36.407167 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] HTTP exception thrown: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Request method failure captured: Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 HTTP/1.1 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_06qJFpkTuefK7cxJKtNwMV7c_PBkuvrgOTiuL1t0SjX3JNNIjtiH4TSaC5EgfTQyOFcAlLl9HxxaeuPMW3VdLB8EH-42ZjwrobvwiThrTh5c0QitSklpp7k0N3-nS0CtXbnQDMvJUz8Ew0C6MkcEgx9WVtDVVGERXZwwrQw4N_olk Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_691ebac218dd472ca7245a35f055ad66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/691ebac218dd472ca7245a35f055ad66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/691ebac218dd472ca7245a35f055ad66"}]}] Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkBasicOps-886656240 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 691ebac218dd472ca7245a35f055ad66 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkBasicOps-886656240 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3e5c5e21b1444df2b472f16c7cdf7523 Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkBasicOps-886656240-project Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49'} Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:36.411615 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. Oct 10 11:12:36.415905 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:12:36.417662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Returning 404 to user: Instance ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:12:36.420119 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a1d8176-2cc0-41c3-b1d8-79682945641e tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49" status: 404 len: 111 microversion: 2.1 time: 0.081244 Oct 10 11:12:36.421609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2791/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:36 2022] GET /compute/v2.1/servers/ae9669c9-6e8d-43b3-8396-f8e2fbdb6c49 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:12:36.766837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:36.767486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:36.788850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:36.789884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:36.794743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:36.796027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:36.796727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:36.797362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:36.986311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abbd93e8-ac50-4d40-869e-9c8ed637510a tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] Calling method '.version_select at 0x7f6777745550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:37.027129 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abbd93e8-ac50-4d40-869e-9c8ed637510a tempest-TestNetworkBasicOps-886656240 tempest-TestNetworkBasicOps-886656240-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-863496444" status: 202 len: 0 microversion: 2.1 time: 0.044546 Oct 10 11:12:37.027655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2792/5700] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 10 11:12:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-863496444 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:12:37.317317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:37.331343 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c6781a4-6c27-4619-a3b3-fc39a0da1575 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1396 microversion: 2.1 time: 0.568150 Oct 10 11:12:37.347519 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2909/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:36 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1396 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:37.668227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c3330c-a910-4d20-a6c3-c366005141a0", "name": "network-vif-deleted", "tag": "4a93ce90-d896-471b-86c6-c4df87533002"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:37.698031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:37.703108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:37.703760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:37.725367 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] Creating event network-vif-deleted:4a93ce90-d896-471b-86c6-c4df87533002 for instance d8c3330c-a910-4d20-a6c3-c366005141a0 on n-h1-860687-2 Oct 10 11:12:37.744001 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-babfc452-1a06-4b9e-aae1-efd99df168a4 req-d309981a-2331-4c1c-9ce0-94ec5485c6a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080946 Oct 10 11:12:37.744621 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2793/5702] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:38.361343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:38.363436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:38.379099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:38.379836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:38.380482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:38.381398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:38.382102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:38.382759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:38.523625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:38.532039 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a97b3d0-bc21-4d7b-a009-d58357b3a5ed tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.174473 Oct 10 11:12:38.537195 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2910/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:38 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:39.071862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1733484117", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "780bd892-f7de-465f-95cd-67bccbcb77c2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:39.163524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] validate_networks() for [('780bd892-f7de-465f-95cd-67bccbcb77c2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:12:39.568105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:39.571610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:39.580177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:39.580693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:39.581142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:39.582812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:39.583313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:39.584052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:39.764618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:39.776172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-505a89f7-1ef4-476b-ba17-66e34d7f5474 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.216283 Oct 10 11:12:39.777436 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2911/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:39 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:40.139945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:12:40.140467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:12:40.141352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:12:40.141776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:12:40.142197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:12:40.156700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:40.157198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:40.157645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:40.158388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:40.158852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:40.159319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:40.246445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Getting quotas for project 246df5359fd743318e71a1aa495700bd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:12:40.263251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Getting quotas for user 06c7783e9be446f38af1ed73086a4eb6 and project 246df5359fd743318e71a1aa495700bd. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:12:40.301192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:12:40.311417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:12:40.441365 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a8df625-8046-4e7b-aef8-0ec56a55ef3c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630379 Oct 10 11:12:40.447552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2794/5705] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:12:40.461049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d13e249-1de2-4a42-9256-e18ce610d3e1 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:40.464024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d13e249-1de2-4a42-9256-e18ce610d3e1 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:40.608353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3d13e249-1de2-4a42-9256-e18ce610d3e1 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:40.620708 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d13e249-1de2-4a42-9256-e18ce610d3e1 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1214 microversion: 2.1 time: 0.169303 Oct 10 11:12:40.624790 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2912/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:40 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:40.811964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:40.819764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:40.862147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:40.867781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:40.868360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:40.870517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:40.873190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:40.874329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:40.983990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:41.010002 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a628e50a-0d3b-490c-b5d1-fcea003dfef3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.210195 Oct 10 11:12:41.022185 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2795/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:40 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:41.652031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:41.652827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:41.668699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:41.674429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:41.675462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:41.676406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:41.678962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:41.681959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:42.045809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:42.047074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:42.065487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:42.066281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:42.067337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:42.069936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:42.071572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:42.072173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:42.220647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:42.235831 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b5947189-b7fa-4811-a536-ffada0c3a57f tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1266 microversion: 2.1 time: 0.588339 Oct 10 11:12:42.236354 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2913/5708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:41 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:42.274453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:42.287198 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42258eda-0aaf-4aec-887d-0956d935234c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.245219 Oct 10 11:12:42.291317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2796/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:42 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:43.262324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:43.262952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:43.270388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:43.270884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:43.271375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:43.272144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:43.272599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:43.273109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:43.313791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:43.321509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:43.335376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:43.347373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:43.348044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:43.349512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:43.360029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:43.360741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:43.428124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:43.440739 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92c8cbf8-3c96-40c1-b63b-9f025c96821a tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1272 microversion: 2.1 time: 0.182136 Oct 10 11:12:43.447046 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2914/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:43 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:43.499607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:43.513866 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b44b13c-6346-42ab-82cd-ff162259e161 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.203855 Oct 10 11:12:43.514801 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2797/5711] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:43 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:44.469413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:44.470645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:44.486092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:44.487872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:44.489552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:44.494281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:44.495052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:44.495751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:44.539369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:44.541703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:44.553382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:44.563519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:44.564302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:44.564947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:44.570286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:44.571707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:44.572341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:44.823619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:44.842559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9f7eb46-181a-411c-a5d2-44e2d9ad106a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.304526 Oct 10 11:12:44.845413 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2798/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:44 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:12:45.243027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:45.260136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b8c12d8b-b4b0-4295-a31a-7910a7bb0acc tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.797762 Oct 10 11:12:45.263807 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2915/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:44 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:46.160768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512ed8f3-4257-4c92-8eae-16c6e7e0da6a", "tag": "04392d0f-8892-4101-b831-1ba8ecf19fc3"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:46.175083 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] Creating event network-changed:04392d0f-8892-4101-b831-1ba8ecf19fc3 for instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a on n-h1-860687-2 Oct 10 11:12:46.181661 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6936139a-3bdf-4ce1-9c19-dd9857756cfd req-86b2c5c0-d2f0-4179-8a59-fa20c8fb6fb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232364 Oct 10 11:12:46.181661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2916/5714] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:12:46.266353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:46.278826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10c79a38-75a2-458f-90e9-0497c446864d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.414197 Oct 10 11:12:46.291492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:46.294013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:46.298906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2799/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:45 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:46.326423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:46.326947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:46.329277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:46.330519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:46.333301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:46.333904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:46.641361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:46.653395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9069991c-9685-4bb8-bcd9-24dbea3c0479 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.373188 Oct 10 11:12:46.655238 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2917/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:46 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:47.305944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:47.307274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:47.317959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:47.321465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:47.322187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:47.324301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:47.324774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:47.325212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:47.473444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:47.484762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bec0d6a-860c-48c8-806d-e868516b2e2a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.183263 Oct 10 11:12:47.486206 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2800/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:47 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:47.677044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:47.678639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:47.698201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:47.698915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:47.699765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:47.700660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:47.701297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:47.702065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:47.970340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:47.992172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45206b71-6dda-4ecc-8c6a-57f58440c88c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.318888 Oct 10 11:12:47.993083 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2918/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:47 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:48.508704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:48.509737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:48.526089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:48.528238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:48.528711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:48.531013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:48.533939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:48.534555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:48.711409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:48.727463 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ade861a-8768-452e-be71-cb728d70079f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.217503 Oct 10 11:12:48.730546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2801/5719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:48 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:49.019366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:49.019984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:49.033234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:49.036734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:49.037391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:49.038574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:49.039529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:49.042784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:49.422536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:49.431140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1647b686-9e81-406b-8f55-cc396108ff29 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.416018 Oct 10 11:12:49.436865 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2919/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:49 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:49.768729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:49.769355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:49.782468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:49.782960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:49.785434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:49.789105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:49.789609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:49.790957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:49.958259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:50.010546 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e8bed48-8f19-44e8-a94e-066b0d5762e4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.252378 Oct 10 11:12:50.014356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2802/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:49 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:50.463528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:50.464152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:50.486452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:50.487392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:50.487861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:50.488744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:50.489058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:50.495276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:50.508433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:50.616180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:50.866633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:50.891893 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2b80d7e4-bf9e-4ff7-9e5a-3802165587e7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.433723 Oct 10 11:12:50.894338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2920/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:50 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:50.962297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:50.963455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:12:51.042139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:51.046895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:51.059742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:51.060594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:51.061242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:51.062356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:51.063224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:51.063867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:51.155914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:51.171846 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e571b807-76f2-4757-aa91-c64d21f8d3d8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.138353 Oct 10 11:12:51.172447 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2921/5723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:51 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:12:51.198682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62d308fa-532e-4ed1-afcd-0187569538e8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Action: 'create', calling method: .version_select at 0x7f6777745940>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1555371050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9XdwopNtm4wCpT5jYmgKa+xjT9tJk8+yhtbbJ37mbm6yR77JJbo7yfMtrz5l/a4lfGcoM7UCKwPTBRrUSm3V8PtrYSFIzB7neldufhUPfLycbBPHXfvWtkzA9nnFzulw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:51.219898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-62d308fa-532e-4ed1-afcd-0187569538e8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:12:51.227590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-62d308fa-532e-4ed1-afcd-0187569538e8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for user 2a503073d40d477db4feb2c1757dc247 and project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:12:51.278249 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62d308fa-532e-4ed1-afcd-0187569538e8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.319579 Oct 10 11:12:51.280966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2803/5724] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:12:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:51.924126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:51.924754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:51.936332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:51.936839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:51.937743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:51.938479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:51.938952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:51.940361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.199297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:52.200519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:52.208424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.210242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.211071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.212448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.213246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.213887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.336582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:52.348858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e30f361-d868-44b6-bc53-529ce27c1f09 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.428694 Oct 10 11:12:52.364322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2922/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:51 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:52.442021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:52.442837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:52.450866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.451732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.452402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.453627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.454308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.454954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.467474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:52.485653 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-768ae1ae-c63c-4f91-8f52-7b7810b458d7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.295155 Oct 10 11:12:52.486352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2804/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:52 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:52.500663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512ed8f3-4257-4c92-8eae-16c6e7e0da6a", "name": "network-vif-plugged", "status": "completed", "tag": "04392d0f-8892-4101-b831-1ba8ecf19fc3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:12:52.528651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.529131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.529559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.554589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] Creating event network-vif-plugged:04392d0f-8892-4101-b831-1ba8ecf19fc3 for instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a on n-h1-860687-2 Oct 10 11:12:52.560594 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-982b073b-40d9-4b72-b503-c2f88c1aae8a req-37e7df62-3b94-4e02-a1de-b59766e3e917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072992 Oct 10 11:12:52.561788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2805/5727] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:52.639439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lazy-loading 'services' on Instance uuid e2bc5e8d-14ee-4760-98b6-c642d822666f {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:12:52.797462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c72ba1da-7a34-4cee-933b-b07b83c0a26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments/fff00957-1fe2-4792-8f9d-097c72ce2059" status: 202 len: 0 microversion: 2.1 time: 0.359411 Oct 10 11:12:52.804142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2923/5728] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:12:52 2022] DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments/fff00957-1fe2-4792-8f9d-097c72ce2059 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:12:52.813562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:52.816951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:52.824926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.825708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.826380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.827339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:52.828048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:52.829100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:52.873353 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2e41065-b1d0-4e3b-bda0-b110b1b0315a tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064258 Oct 10 11:12:52.874487 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2806/5729] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:52 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:53.397413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:53.399348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:53.413676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.414600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.415570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.416987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.417934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.419665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.517205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:53.517831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:53.535546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.536033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.540431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.541469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.544310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.545487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.670700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:53.682356 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-981e126c-0418-40e9-aabd-3cacab3aef20 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1314 microversion: 2.1 time: 0.293111 Oct 10 11:12:53.690134 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2924/5730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:53 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:53.716780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:53.728436 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f68bbe8b-bcb3-4a16-88c0-6fc13de46dd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 200 len: 1188 microversion: 2.1 time: 0.216338 Oct 10 11:12:53.731513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2807/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:53 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 1188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:53.886194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:53.888755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:53.900134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.902930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.905963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.906768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:53.908265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:53.908908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:53.984172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-519c553e-f063-4c32-b6d9-e556c1d348c3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102242 Oct 10 11:12:53.991800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2925/5732] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:53 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:54.715232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:54.717254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:54.732190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:54.733729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:54.734398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:54.737934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:54.738712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:54.743565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:54.753468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:54.754866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: d8c3330c-a910-4d20-a6c3-c366005141a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:54.767323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:54.768096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:54.768635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:54.769499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:54.770217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:54.770747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:54.815830 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 HTTP/1.1 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd8c3330c-a910-4d20-a6c3-c366005141a0'} Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:12:54.820820 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. Oct 10 11:12:54.825158 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:12:54.826514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance d8c3330c-a910-4d20-a6c3-c366005141a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:12:54.829059 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a9e523a-8f8c-4f35-b451-cda14832b3a9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0" status: 404 len: 111 microversion: 2.1 time: 0.080671 Oct 10 11:12:54.840031 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2926/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:54 2022] GET /compute/v2.1/servers/d8c3330c-a910-4d20-a6c3-c366005141a0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:12:55.000287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:55.016282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:55.038512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:55.054107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:55.056338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:55.058160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:55.060373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:55.061622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:55.145112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:12:55.160721 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1caf46bd-500d-402c-b9ce-5022d98a02d0 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1498 microversion: 2.1 time: 0.449799 Oct 10 11:12:55.164140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0eb8132-3371-445b-90c1-85b3b7cd9931 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169201 Oct 10 11:12:55.167730 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2927/5734] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:54 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:55.175402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2808/5735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:12:54 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1498 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:12:56.181370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:56.184704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:56.200555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:56.207975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:56.208787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:56.210549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:56.212246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:56.212872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:56.366783 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09e6fa71-f72b-4f86-8d45-96ece5a8053c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191290 Oct 10 11:12:56.367986 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2928/5736] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:56 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:57.388623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:57.390833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:57.406174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:57.406694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:57.407300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:57.408035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:57.409050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:57.409493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:58.290788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-583d769c-cb6a-4a56-9061-1a9030f0ded0 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.914793 Oct 10 11:12:58.296753 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2809/5737] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:57 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:12:59.312214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:12:59.314524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:12:59.350423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:59.351024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:59.351460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:59.352252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:12:59.355645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:12:59.356320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:12:59.438719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d0acfa8b-bfb5-4446-85d4-df29b302a2e7 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133619 Oct 10 11:12:59.439804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2929/5738] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:12:59 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:00.462425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:00.465519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:00.474468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:00.475316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:00.476071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:00.476941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:00.477938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:00.478777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:00.597661 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fd51f93-7436-48fc-9c65-9b166a6c6555 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149292 Oct 10 11:13:00.608091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2810/5739] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:13:00 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:01.274731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:01.275332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:01.296474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.297134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.298060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.298948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.299990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.302112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.399748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:13:01.593051 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de55dc9b-e49a-45e0-8c8b-b8b5e90d6f06 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "DELETE /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 204 len: 0 microversion: 2.1 time: 0.323104 Oct 10 11:13:01.594082 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2930/5740] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:01 2022] DELETE /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:13:01.603621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:01.604331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:01.614344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:01.615875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:01.617015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:01.626357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.627469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.628153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.629211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.629701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.629938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.630153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.634596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.635954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.637376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:01.637901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:01.639847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:01.705329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:01.731151 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c8eb7714-5772-4a9a-91f4-392927757fb2 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123570 Oct 10 11:13:01.735977 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2931/5741] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:13:01 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:13:02.095063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:02.113570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f179a687-eba6-4999-b6b7-ef89042bed5c tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1504 microversion: 2.1 time: 0.514438 Oct 10 11:13:02.113570 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2811/5742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:01 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:02.745023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:02.751917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:02.775993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:02.778670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:02.779958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:02.783814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:02.784969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:02.787545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:02.875982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e35ca2ea-8ac0-42e0-92ee-4478eb647400 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136457 Oct 10 11:13:02.877898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2932/5743] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:13:02 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:13:03.020285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:03.021873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:03.040144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.040888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.041513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.042414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.043067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.043646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.111561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:13:03.145041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:03.146771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:03.160569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.164223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.164803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.166572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.176693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.179712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.328986 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6006ae2-44bf-4e91-bff7-54d90fe4c721 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 204 len: 0 microversion: 2.1 time: 0.312027 Oct 10 11:13:03.335415 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2812/5744] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:03 2022] DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:13:03.343967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:03.344674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:03.365868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.366295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.370610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.372823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:03.373334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:03.375312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:03.698947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:03.715534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8400b9ae-8b9f-4014-ab34-69a77666b8c3 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1504 microversion: 2.1 time: 0.581409 Oct 10 11:13:03.717590 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2933/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:03 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:03.892417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:03.901568 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3407c05-8693-4158-ac0c-4dd58f4a8ec4 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1678 microversion: 2.1 time: 0.561766 Oct 10 11:13:03.905420 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2813/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:03 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1678 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:04.213022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1118860683-access_point-1407502868", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "cdac08b3-d6d9-412d-a106-ebcfc585470f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1555371050", "security_groups": [{"name": "tempest-secgroup_access--1694887433"}, {"name": "tempest-secgroup_general--1867661176"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:04.561740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512ed8f3-4257-4c92-8eae-16c6e7e0da6a", "name": "network-vif-deleted", "tag": "04392d0f-8892-4101-b831-1ba8ecf19fc3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:04.604398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:04.604945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:04.605682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:04.641531 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] Creating event network-vif-deleted:04392d0f-8892-4101-b831-1ba8ecf19fc3 for instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a on n-h1-860687-2 Oct 10 11:13:04.665867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] validate_networks() for [('cdac08b3-d6d9-412d-a106-ebcfc585470f', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:13:04.674669 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1ee3b150-586d-4b18-94fd-07cb6772b3da req-f709f1fa-5e57-4c57-a417-ae17584b5f23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117152 Oct 10 11:13:04.678123 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2814/5747] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:13:04.745370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:04.746268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:04.759105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:04.759715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:04.762922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:04.763872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:04.768927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:04.769729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:04.874685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:04.875289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:04.875741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:04.876206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lazy-loading 'fault' on Instance uuid 512ed8f3-4257-4c92-8eae-16c6e7e0da6a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:13:04.967826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06c7783e9be446f38af1ed73086a4eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246df5359fd743318e71a1aa495700bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:04.978925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84f9a65b-8149-42ca-88d1-55d0b3917bb6 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 200 len: 1304 microversion: 2.1 time: 0.238665 Oct 10 11:13:04.979561 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2815/5748] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:04 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 1304 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:04.996090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:04.996768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:05.012985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:05.013415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:05.013867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:05.014591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:05.015082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:05.015526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:05.451609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:05.463576 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07e7c873-48c9-4ff0-8b71-09cc5458dd9c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1678 microversion: 2.1 time: 0.482877 Oct 10 11:13:05.465963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2816/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:04 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1678 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:05.832943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:13:05.834047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:13:05.834391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:13:05.842045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:13:05.842782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:13:05.868702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:05.870290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:05.872321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:05.876493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:05.877425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:05.878878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:05.911451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:13:05.930174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for user 2a503073d40d477db4feb2c1757dc247 and project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:13:05.961373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:13:05.965639 n-d-860687-2 devstack@n-api.service[128800]: WARNING nova.utils [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1118860683-access_point-1407502868 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1118860683-ac Oct 10 11:13:05.966441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:13:06.007706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:06.011059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] [instance: 512ed8f3-4257-4c92-8eae-16c6e7e0da6a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:06.027415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:06.028838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:06.031359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:06.032417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:06.036193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:06.037479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:06.076927 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] HTTP exception thrown: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Request method failure captured: Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a HTTP/1.1 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_4jEA48RRh3RrYdMZtm48PDdqqkD-on6WDw0JzbEq8ERk6xDgZMEO7kawjYaHUt5-w7C2un4XIlmTtCanLypIgF1dBeiAMn4Hd7Op3Y_jnnrrurgrhug4pj0Z4wqTl4B_1ej4zufad0bBzcFOxGw6hVoWXuE7a4Zeg_2F-mcubtE04 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 246df5359fd743318e71a1aa495700bd Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesActionsTest-334622441 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/246df5359fd743318e71a1aa495700bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_246df5359fd743318e71a1aa495700bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/246df5359fd743318e71a1aa495700bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/246df5359fd743318e71a1aa495700bd"}]}] Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesActionsTest-334622441 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 246df5359fd743318e71a1aa495700bd Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesActionsTest-334622441 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesActionsTest-334622441-project Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 06c7783e9be446f38af1ed73086a4eb6 Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesActionsTest-334622441-project Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '512ed8f3-4257-4c92-8eae-16c6e7e0da6a'} Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:06.089944 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. Oct 10 11:13:06.093469 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:06.097654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] Returning 404 to user: Instance 512ed8f3-4257-4c92-8eae-16c6e7e0da6a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:06.100878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0dd5fca5-7ae4-4837-8773-bc71262d52f7 tempest-VolumesActionsTest-334622441 tempest-VolumesActionsTest-334622441-project] 10.222.0.16 "GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a" status: 404 len: 111 microversion: 2.1 time: 0.098402 Oct 10 11:13:06.112291 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2817/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:06 2022] GET /compute/v2.1/servers/512ed8f3-4257-4c92-8eae-16c6e7e0da6a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:06.185307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1748281c-cfef-4592-922e-d7a4f55a87a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.977245 Oct 10 11:13:06.192108 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2934/5751] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:13:04 2022] POST /compute/v2.1/servers => generated 458 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:13:06.198051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a429a77e-1fec-4306-97c3-0e7e59ae7a05 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:06.198676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a429a77e-1fec-4306-97c3-0e7e59ae7a05 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:06.495372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:06.496007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:06.526194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:06.527574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:06.528054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:06.538124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:06.538795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:06.539283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:06.542121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a429a77e-1fec-4306-97c3-0e7e59ae7a05 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:06.562803 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a429a77e-1fec-4306-97c3-0e7e59ae7a05 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1295 microversion: 2.1 time: 0.368738 Oct 10 11:13:06.566788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2818/5752] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:06 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1295 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:06.923823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:06.927970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:06.949176 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3c01ea47-0a2a-4e2d-b3b3-878a8dcba26c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1613 microversion: 2.1 time: 0.457716 Oct 10 11:13:06.954155 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2935/5753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:06 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1613 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:07.231522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2bc5e8d-14ee-4760-98b6-c642d822666f", "name": "network-vif-deleted", "tag": "e25c76be-c94b-4de9-bf41-2ce0dc1ab454"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:07.300838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:07.311433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:07.312086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:07.345287 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] Creating event network-vif-deleted:e25c76be-c94b-4de9-bf41-2ce0dc1ab454 for instance e2bc5e8d-14ee-4760-98b6-c642d822666f on n-h2-860687-2 Oct 10 11:13:07.402599 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-51e10200-ea7b-445e-808c-a14b3a7abca0 req-3fe777c7-658a-447a-8867-7de232bae5c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175539 Oct 10 11:13:07.413935 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2819/5754] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:07.589881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b6a0cc4-e2d4-4820-a83e-74443a67c484 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:07.590830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b6a0cc4-e2d4-4820-a83e-74443a67c484 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:07.978675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:07.979562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:07.993411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:07.997008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:08.007925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:08.007925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:08.007925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:08.007925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:08.165436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:08.170383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:08.172123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:08.172982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lazy-loading 'fault' on Instance uuid e2bc5e8d-14ee-4760-98b6-c642d822666f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:13:08.539319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b6a0cc4-e2d4-4820-a83e-74443a67c484 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:08.552247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b6a0cc4-e2d4-4820-a83e-74443a67c484 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1295 microversion: 2.1 time: 0.964560 Oct 10 11:13:08.558611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2936/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:07 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1295 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:08.730720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8351cc0551a249848d771e2557458240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961675ffd25642ce8950a792b8ca8188', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:08.740846 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-432f88e3-5d69-4056-aa9f-7daa24b7fca5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 200 len: 1331 microversion: 2.1 time: 0.767839 Oct 10 11:13:08.744796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2820/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:07 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 1331 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:09.587441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:09.588706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:09.598566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:09.599739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:09.602968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:09.604015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:09.604517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:09.604948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:09.782198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:09.787928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:09.789849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:09.806709 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fbb47539-df63-4797-ad7a-8f8a6c59248e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1353 microversion: 2.1 time: 0.220107 Oct 10 11:13:09.808636 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2937/5757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:09 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:09.813635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:09.814277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:09.815883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:09.816712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:09.819166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:09.819850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:09.859978 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f HTTP/1.1 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e2bc5e8d-14ee-4760-98b6-c642d822666f'} Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:09.866049 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:09.869660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:09.871660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:09.873061 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3d75425-3fe1-4273-8d6a-9738bf15d918 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 404 len: 111 microversion: 2.1 time: 0.100886 Oct 10 11:13:09.874130 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2821/5758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:09 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:09.885953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-875b20fd-ffa3-444c-938e-ca5b9073c08e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '.version_select at 0x7f677783e940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:09.953055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-875b20fd-ffa3-444c-938e-ca5b9073c08e tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107134135" status: 202 len: 0 microversion: 2.1 time: 0.073625 Oct 10 11:13:09.957977 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2938/5759] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 11:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107134135 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:13:10.835472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:10.837713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:10.875410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:10.875800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:10.876240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:10.876952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:10.877404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:10.877828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:11.076984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:11.087425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f61debce-80b8-4d76-af58-2cbba0e6da8c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1353 microversion: 2.1 time: 0.255956 Oct 10 11:13:11.103407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2822/5760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:10 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1353 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:12.109866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:12.110481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:12.132586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:12.136286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:12.136777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:12.143022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:12.145629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:12.147388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:12.736363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:12.760075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-68d591de-5649-4ba5-8740-b2134c0783b9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.653496 Oct 10 11:13:12.768830 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2939/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:12 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:13.480925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca555348-5e33-47a7-a976-111a266d139c", "tag": "011dcddb-0ab6-4e8a-bd1f-7da42100460a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:13.526745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:13.527271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:13.529887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:13.564923 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] Creating event network-changed:011dcddb-0ab6-4e8a-bd1f-7da42100460a for instance ca555348-5e33-47a7-a976-111a266d139c on n-h1-860687-2 Oct 10 11:13:13.577492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6625ab82-ab7a-4ef5-aa2e-17826ab96821 req-7fb95e15-c19c-462c-8e26-0f441c811fc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104585 Oct 10 11:13:13.580467 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2823/5762] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:13.794417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:13.795246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:13.808658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:13.809914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:13.810538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:13.811319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:13.812204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:13.812805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:14.133722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:14.146807 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d68f9548-3be7-48e6-9787-c4153a9c57e9 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.356478 Oct 10 11:13:14.167117 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2940/5763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:13 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:15.173044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:15.173750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:15.175815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:15.190080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:15.190850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:15.191470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:15.196079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:15.196911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:15.197498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:15.648996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:15.657503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74feebaa-ec01-4470-8e1c-88cb354cba64 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.489852 Oct 10 11:13:15.666137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2824/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:15 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:16.696487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:16.703827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:16.706741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:16.707740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:16.735908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:16.736419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:16.736866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:16.737596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:16.738056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:16.738486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:17.521383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:17.535829 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87923539-dbda-4bc4-8fea-21272568899b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.847084 Oct 10 11:13:17.536951 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2941/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:16 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:18.561569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:18.562193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:18.571682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:18.574271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:18.576728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:18.578094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:18.580541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:18.581321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:18.584101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:19.048512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:19.057767 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2291f9a1-716c-410a-bc0d-c2ce660f33a2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.502082 Oct 10 11:13:19.061491 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2825/5766] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:18 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:20.093402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:20.094550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:20.112664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:20.117104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:20.127765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:20.128379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:20.129675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:20.130634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:20.131332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:20.331051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca555348-5e33-47a7-a976-111a266d139c", "name": "network-vif-plugged", "status": "completed", "tag": "011dcddb-0ab6-4e8a-bd1f-7da42100460a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:20.371537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:20.372998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:20.375765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:20.435407 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] Creating event network-vif-plugged:011dcddb-0ab6-4e8a-bd1f-7da42100460a for instance ca555348-5e33-47a7-a976-111a266d139c on n-h1-860687-2 Oct 10 11:13:20.456502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4cb9ac3d-d9d8-497e-8cba-28824dfcf267 req-efa8f5a4-bf3f-4af0-8304-153f04db0cbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130766 Oct 10 11:13:20.464976 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2826/5767] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:20.546400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:20.561816 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-672b8dae-a815-4d09-8587-d550e4de91ba tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.475816 Oct 10 11:13:20.562617 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2942/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:20 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:13:21.330866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:21.331692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:21.349602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.350211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.352277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.353070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.353562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.354004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.386697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f HTTP/1.1 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e2bc5e8d-14ee-4760-98b6-c642d822666f'} Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:21.389846 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:21.394050 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5327058-39f1-4e01-98a2-2b3fea8d2aff tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 404 len: 111 microversion: 2.1 time: 0.087109 Oct 10 11:13:21.395366 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2827/5769] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:21 2022] DELETE /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:21.402676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:21.404042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e2bc5e8d-14ee-4760-98b6-c642d822666f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:21.411835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.428473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.429158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.433115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.433753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.434630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.483926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f HTTP/1.1 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e2bc5e8d-14ee-4760-98b6-c642d822666f'} Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:21.485034 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e2bc5e8d-14ee-4760-98b6-c642d822666f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-005e6440-0082-487c-b366-1cf345b4bda8 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f" status: 404 len: 111 microversion: 2.1 time: 0.087619 Oct 10 11:13:21.489096 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2943/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:21 2022] GET /compute/v2.1/servers/e2bc5e8d-14ee-4760-98b6-c642d822666f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:21.594210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:21.595069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:21.611133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.615678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.621848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.628319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:21.630385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:21.633371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:21.970524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:21.980540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ce031fe-23df-439c-a2c6-8e32429a856e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1473 microversion: 2.1 time: 0.393024 Oct 10 11:13:21.981133 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2828/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:21 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:23.014116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:23.014922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:23.030947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:23.033957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:23.034461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:23.035389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:23.036176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:23.036811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:24.160839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:24.171534 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ff8819e-2281-4469-97ea-345121d4aa3d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1645 microversion: 2.1 time: 1.163822 Oct 10 11:13:24.172130 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2944/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:23 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1645 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:24.197258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:24.198534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:24.210043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:24.211065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:24.211685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:24.212665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:24.213274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:24.213865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:24.419202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:24.432284 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d51aed4-65a6-4841-8096-00fe7e62866d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1645 microversion: 2.1 time: 0.236677 Oct 10 11:13:24.433165 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2829/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:24 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1645 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:24.460723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:24.461535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:24.470992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:24.476897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:24.477722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:24.478613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:24.479748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:24.480358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:25.367560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-109d1d39-3744-4fa6-a324-78f396f3f31f tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1796 microversion: 2.1 time: 0.911910 Oct 10 11:13:25.369200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2945/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:24 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1796 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:27.283644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:27.284721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:27.303983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.318207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.318953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.324660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.324660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.324660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.392416 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 HTTP/1.1 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd208fd3e-5f71-4d0f-967c-5da5ec1253a0'} Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:27.394044 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:27.399217 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-faf1e80b-b954-407f-9db9-2c0fe99c3dd6 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 404 len: 111 microversion: 2.1 time: 0.115909 Oct 10 11:13:27.404951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2830/5775] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:27 2022] DELETE /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:13:27.405346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:27.406148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: d208fd3e-5f71-4d0f-967c-5da5ec1253a0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:27.419738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.429540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.433414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.437576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.438109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.438576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.487103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 HTTP/1.1 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd208fd3e-5f71-4d0f-967c-5da5ec1253a0'} Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.490951 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. Oct 10 11:13:27.494622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.495992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance d208fd3e-5f71-4d0f-967c-5da5ec1253a0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:27.496888 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4484df74-e2e7-4303-9b5c-2951dc280af5 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0" status: 404 len: 111 microversion: 2.1 time: 0.096148 Oct 10 11:13:27.500850 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2946/5776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:27 2022] GET /compute/v2.1/servers/d208fd3e-5f71-4d0f-967c-5da5ec1253a0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:13:27.506193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:27.506712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:27.515951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.516442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.516892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.517608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.518064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.518494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.578963 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 HTTP/1.1 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ee4b87f5-f7c0-4181-a618-61476e6fd2f8'} Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:27.592574 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07983d07-b937-4e4b-9a64-393d04859037 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 404 len: 111 microversion: 2.1 time: 0.092577 Oct 10 11:13:27.596601 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2831/5777] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:27 2022] DELETE /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:13:27.604120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:27.604751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: ee4b87f5-f7c0-4181-a618-61476e6fd2f8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:27.619374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.619966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.620417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.623691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:27.624197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:27.624643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:27.663226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 HTTP/1.1 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'ee4b87f5-f7c0-4181-a618-61476e6fd2f8'} Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:27.668033 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance ee4b87f5-f7c0-4181-a618-61476e6fd2f8 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:27.672152 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ec674c2-cc33-42b2-ad69-74fc641acfd3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8" status: 404 len: 111 microversion: 2.1 time: 0.069710 Oct 10 11:13:27.676214 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2947/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:27 2022] GET /compute/v2.1/servers/ee4b87f5-f7c0-4181-a618-61476e6fd2f8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:30.231956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca555348-5e33-47a7-a976-111a266d139c", "tag": "011dcddb-0ab6-4e8a-bd1f-7da42100460a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:30.279388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:30.281170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:30.283520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:30.347500 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] Creating event network-changed:011dcddb-0ab6-4e8a-bd1f-7da42100460a for instance ca555348-5e33-47a7-a976-111a266d139c on n-h1-860687-2 Oct 10 11:13:30.367122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2229b391-a27c-434d-abcb-e3e881e6a7d2 req-385e0412-9191-4d16-aea0-66760d1c7f79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145508 Oct 10 11:13:30.368320 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2832/5779] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:13:35.884096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:35.884827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:35.902980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:35.904174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:35.904750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:35.905495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:35.905961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:35.906399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:35.940900 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 HTTP/1.1 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e4120b66-c3a2-414b-908a-d1566b7d0613'} Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:35.943194 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:35.947539 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:35.950475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:35.951414 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9e3f80c-af56-4630-9fd5-ee21e3ac00d3 tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 404 len: 111 microversion: 2.1 time: 0.076545 Oct 10 11:13:35.952328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2948/5780] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:13:35 2022] DELETE /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:35.963613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:35.964336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] [instance: e4120b66-c3a2-414b-908a-d1566b7d0613] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:35.978642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:35.979186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:35.979645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:35.980366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:35.980838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:35.981278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:36.014902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:36.016700 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] HTTP exception thrown: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Request method failure captured: Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 HTTP/1.1 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_zZdpUZvFiT99-Z60TREGw5wuy2Q70qJMBliTCx0GObMapr6WIYGcCDWgl3YQ--jCCt4EogFK8EyaObl1hxY-s-vZdGoAIvZRQenyp6bO7BEpEaiZwRReK2lFu39LC6wtG-LCMxYr1Sdp4a4-JVNsdIv4wiCrxnJLu2yK0VBq_xeA8 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_961675ffd25642ce8950a792b8ca8188", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/961675ffd25642ce8950a792b8ca8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/961675ffd25642ce8950a792b8ca8188"}]}] Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 961675ffd25642ce8950a792b8ca8188 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1887246113 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 8351cc0551a249848d771e2557458240 Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-1887246113-project Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e4120b66-c3a2-414b-908a-d1566b7d0613'} Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:36.018390 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] Returning 404 to user: Instance e4120b66-c3a2-414b-908a-d1566b7d0613 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c75995a-f00f-4af9-9e6f-b142a437c43c tempest-AttachVolumeNegativeTest-1887246113 tempest-AttachVolumeNegativeTest-1887246113-project] 10.222.0.16 "GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613" status: 404 len: 111 microversion: 2.1 time: 0.063505 Oct 10 11:13:36.022600 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2833/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:35 2022] GET /compute/v2.1/servers/e4120b66-c3a2-414b-908a-d1566b7d0613 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:13:45.911641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=15 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:45.912546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=51 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:46.226951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b558ddd-c07f-4adb-9d60-1d3f8b9cd3c5 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Action: 'create', calling method: .version_select at 0x7f67778f3f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-939258100", "metadata": {"Type": "work"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b558ddd-c07f-4adb-9d60-1d3f8b9cd3c5 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 121 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-939258100", "metadata": {"Type": "work"}}} Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-939258100', 'metadata': {'Type': 'work'}}}} Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi '#$%' Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:13:46.231135 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b558ddd-c07f-4adb-9d60-1d3f8b9cd3c5 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.234851 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b558ddd-c07f-4adb-9d60-1d3f8b9cd3c5 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.329661 Oct 10 11:13:46.239689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2949/5782] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 10 11:13:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:13:46.252350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57b16108-76bc-4a41-81ed-b0a0f08e01d9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Action: 'create', calling method: .version_select at 0x7f6777811700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-415477806", "metadata": {"Type": "work"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57b16108-76bc-4a41-81ed-b0a0f08e01d9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 119 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-415477806", "metadata": {"Type": "work"}}} Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-415477806', 'metadata': {'Type': 'work'}}}} Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '0' Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:13:46.266045 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.270499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57b16108-76bc-4a41-81ed-b0a0f08e01d9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.272309 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57b16108-76bc-4a41-81ed-b0a0f08e01d9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033052 Oct 10 11:13:46.276890 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2834/5783] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 10 11:13:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:13:46.283444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-652c101e-e83c-4404-8615-a5a210f988fc tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Action: 'create', calling method: .version_select at 0x7f677779d0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-491807095", "metadata": {"Type": "work"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-652c101e-e83c-4404-8615-a5a210f988fc tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 118 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-491807095", "metadata": {"Type": "work"}}} Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-491807095', 'metadata': {'Type': 'work'}}}} Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi '' Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:13:46.287434 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 11:13:46.291450 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.293857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-652c101e-e83c-4404-8615-a5a210f988fc tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.294922 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-652c101e-e83c-4404-8615-a5a210f988fc tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016728 Oct 10 11:13:46.303961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:13:46.307122 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2950/5784] 10.222.0.16 () {60 vars in 1156 bytes} [Mon Oct 10 11:13:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:13:46.308813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4d25bed-02dc-466b-b05e-9d6cda903af6 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Calling method '.version_select at 0x7f67779ef820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:46.351865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e4d25bed-02dc-466b-b05e-9d6cda903af6 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] HTTP exception thrown: Volume tempest-invalid-160217041 could not be found. Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4d25bed-02dc-466b-b05e-9d6cda903af6 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-160217041 HTTP/1.1 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: exception: Volume tempest-invalid-160217041 could not be found. Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'tempest-invalid-160217041'} Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-160217041 could not be found. (HTTP 404) (Request-ID: req-3f98ef57-ac7d-4bc1-8fff-6ff261982208) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.354298 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-160217041 could not be found. Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-160217041 could not be found. Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-160217041 could not be found. Oct 10 11:13:46.357869 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.361687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4d25bed-02dc-466b-b05e-9d6cda903af6 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 404 to user: Volume tempest-invalid-160217041 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.362767 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4d25bed-02dc-466b-b05e-9d6cda903af6 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-160217041" status: 404 len: 98 microversion: 2.1 time: 0.061004 Oct 10 11:13:46.374561 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b6f8d3fe-779c-4dba-8500-648223322eb9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003894 Oct 10 11:13:46.379508 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2951/5786] 10.222.0.16 () {58 vars in 1140 bytes} [Mon Oct 10 11:13:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 11:13:46.383106 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2835/5786] 10.222.0.16 () {58 vars in 1215 bytes} [Mon Oct 10 11:13:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-160217041 => generated 98 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 11:13:46.390589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d13dcb18-efdc-456f-8bb5-75ac352750b0 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009738 Oct 10 11:13:46.392670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2952/5787] 10.222.0.16 () {58 vars in 1137 bytes} [Mon Oct 10 11:13:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 11:13:46.416978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a992d0b5-122b-4d36-a01a-85f336ca17a9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Calling method '.version_select at 0x7f67778115e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:46.465271 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a992d0b5-122b-4d36-a01a-85f336ca17a9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] HTTP exception thrown: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a992d0b5-122b-4d36-a01a-85f336ca17a9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-volumes/650505ad-7a11-4636-bfd1-345913c0086d HTTP/1.1 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: method: Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: exception: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '650505ad-7a11-4636-bfd1-345913c0086d'} Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. (HTTP 404) (Request-ID: req-1c9e8abf-9430-4c8f-8305-ddb2c64e5f4d) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 11:13:46.467269 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a992d0b5-122b-4d36-a01a-85f336ca17a9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 404 to user: Volume 650505ad-7a11-4636-bfd1-345913c0086d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a992d0b5-122b-4d36-a01a-85f336ca17a9 tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/650505ad-7a11-4636-bfd1-345913c0086d" status: 404 len: 109 microversion: 2.1 time: 0.062091 Oct 10 11:13:46.470680 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2836/5788] 10.222.0.16 () {58 vars in 1248 bytes} [Mon Oct 10 11:13:46 2022] DELETE /compute/v2.1/os-volumes/650505ad-7a11-4636-bfd1-345913c0086d => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:46.481336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b220a42-8a8e-4760-914c-e71191f86f9f tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Calling method '.version_select at 0x7f67777a78b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:46.521946 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9b220a42-8a8e-4760-914c-e71191f86f9f tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] HTTP exception thrown: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b220a42-8a8e-4760-914c-e71191f86f9f tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Request method failure captured: Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/os-volumes/3d740e28-b4b3-4ee5-b8da-900676c49edb HTTP/1.1 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_5p4Kzn1X3JjqwBKBMamRlnCgJRA5OVUsFpdHXLMFEGLd6fWndTECZldVSmZzQLMCeUmhhz4-F4qYZg4qAinX7FZpVtJtOYgc58kkPrgRvm3YwzPdn50KuE4lpu7-ruc3NmU1mJ5Pc5yX_wjEHx5Sax4XJC_lZOCufz-EhK6S1NlXo Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95c256a86f664e3895a466a653ef39aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95c256a86f664e3895a466a653ef39aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95c256a86f664e3895a466a653ef39aa"}]}] Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 95c256a86f664e3895a466a653ef39aa Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-VolumesNegativeTest-688663575 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: eef9cfa5b5b8445ea3dd1c37b09e8690 Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-VolumesNegativeTest-688663575-project Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: method: Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: exception: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3d740e28-b4b3-4ee5-b8da-900676c49edb'} Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. (HTTP 404) (Request-ID: req-8a80811d-f4fa-4779-996d-e880fd0a6280) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 11:13:46.523975 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. Oct 10 11:13:46.527439 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:13:46.541424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9b220a42-8a8e-4760-914c-e71191f86f9f tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] Returning 404 to user: Volume 3d740e28-b4b3-4ee5-b8da-900676c49edb could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:13:46.542499 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9b220a42-8a8e-4760-914c-e71191f86f9f tempest-VolumesNegativeTest-688663575 tempest-VolumesNegativeTest-688663575-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3d740e28-b4b3-4ee5-b8da-900676c49edb" status: 404 len: 109 microversion: 2.1 time: 0.065303 Oct 10 11:13:46.549502 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2953/5789] 10.222.0.16 () {58 vars in 1245 bytes} [Mon Oct 10 11:13:46 2022] GET /compute/v2.1/os-volumes/3d740e28-b4b3-4ee5-b8da-900676c49edb => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:13:51.649675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1518924458", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "db9dfe3a-660e-4193-a597-1b79c37026d2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:13:51.883217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:13:53.047821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:13:53.048429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:13:53.048961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:13:53.049642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:13:53.050399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:13:53.063357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:53.065197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:53.067422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:53.070339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:53.071261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:53.072175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:53.094304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:13:53.100957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:13:53.115348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:13:53.117833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='db9dfe3a-660e-4193-a597-1b79c37026d2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:13:53.289398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68fda5af-8e70-484e-922d-d0a31fd84a0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653715 Oct 10 11:13:53.293224 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2837/5790] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:13:53.306521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4827253-e5df-48e9-94d3-1a8ffc61fd87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:53.308007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e4827253-e5df-48e9-94d3-1a8ffc61fd87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:53.462028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e4827253-e5df-48e9-94d3-1a8ffc61fd87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:53.473239 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4827253-e5df-48e9-94d3-1a8ffc61fd87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1057 microversion: 2.1 time: 0.173067 Oct 10 11:13:53.483852 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2954/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:53 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1057 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:54.499023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:54.499643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:54.522655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:54.539138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:54.539598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:54.540346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:54.540803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:54.541228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:54.772668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:54.812442 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7d8b022-ae92-4316-93a8-dd857e327621 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1061 microversion: 2.1 time: 0.318408 Oct 10 11:13:54.829735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2838/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:54 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1061 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:55.845130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:55.846478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:55.860634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:55.861344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:55.861936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:55.863360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:55.866435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:55.867111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:56.105445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:56.115976 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0725f0d8-9615-4440-928c-fdb074b23615 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1127 microversion: 2.1 time: 0.276486 Oct 10 11:13:56.116579 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2955/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:55 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1127 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:57.145577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:57.146194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:57.156298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:57.156802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:57.157249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:57.157964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:57.158421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:57.158851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:57.328223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:57.336771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8822ca19-753e-4e56-b190-1f20d70b7fb7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1127 microversion: 2.1 time: 0.195606 Oct 10 11:13:57.352009 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2839/5794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:57 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1127 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:58.361319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:58.365063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:58.376178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:58.381660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:58.382508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:58.383560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:58.384432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:58.387230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:58.884857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:13:58.918363 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c4fd94a-2ef0-434a-bbda-e667db07da77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.561293 Oct 10 11:13:58.934889 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2956/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:58 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:13:59.961846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:13:59.962458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:13:59.974604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:59.980736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:59.984557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:13:59.987184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:13:59.991874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:13:59.999689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:00.331879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:00.357849 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6a01651-76c9-4da1-94a7-294a49de83ae tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.399781 Oct 10 11:14:00.363365 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2840/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:13:59 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:01.385335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:01.386030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:01.398340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:01.399035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:01.399651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:01.400533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:01.403106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:01.403711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:01.952363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:01.974682 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4f1db73-017c-41ce-8ec0-351c85fa7f8c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.593421 Oct 10 11:14:01.999636 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2957/5797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:01 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:02.017497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e914964c-bb04-4a73-ba3e-7f948eddd8c8", "tag": "196070f5-3cb7-40d2-bd48-a949707f8e13"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:02.035954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:02.043605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:02.047523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:02.082839 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] Creating event network-changed:196070f5-3cb7-40d2-bd48-a949707f8e13 for instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 on n-h2-860687-2 Oct 10 11:14:02.096567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-516ed8f9-729b-4d5e-83ee-829c76ab7f35 req-76edfac4-4d94-49ed-ab9c-3dfda5d9ec75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083417 Oct 10 11:14:02.120785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2841/5798] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:03.027729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:03.029197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:03.061949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:03.062445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:03.063119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:03.064040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:03.064694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:03.065303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:03.467747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:04.214390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:04.274393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bfc0aea-235d-4d6b-a822-405aefea0dc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 1.255453 Oct 10 11:14:04.283501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2958/5799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:03 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:05.313920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:05.315257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:05.342634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:05.350372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:05.399323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:05.399846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:05.406118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:05.412280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:05.414096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:05.415338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:06.324922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:06.391935 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-725e3ea4-9350-4370-aa22-d3291bc4ad89 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 1.068748 Oct 10 11:14:06.409794 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2842/5800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:05 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:07.417038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:07.418039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:07.432516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:07.434169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:07.435795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:07.436873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:07.438924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:07.441107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:07.972298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:07.996134 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc6b6bf9-0f6a-46d0-a2d4-de70d834d1b4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.583181 Oct 10 11:14:08.018091 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2959/5801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:07 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:09.043268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:09.047813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:09.064140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:09.071268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:09.076708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:09.078374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:09.079814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:09.083031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:09.730025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:09.770429 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f14aa50-c8cf-4fdb-915e-52b4de82cfd1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.723165 Oct 10 11:14:09.788821 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2843/5802] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:09 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:10.801506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:10.802728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:10.840345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:10.847199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:10.848573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:10.855522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:10.861055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:10.865126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:11.656706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:11.681855 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e943ee60-b89f-4a3b-b9ca-b8a73d0a248e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.881391 Oct 10 11:14:11.682279 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2960/5803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:10 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:12.733898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:12.734477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:12.761125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:12.762695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:12.763925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:12.765544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:12.769027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:12.774552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:13.544481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:13.563086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7798b990-04f4-4b77-8dd0-21c82a3bbbc9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.833932 Oct 10 11:14:13.586054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2844/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:12 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:14.593283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:14.594537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:14.613852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:14.616902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:14.619147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:14.622465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:14.629008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:14.630421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:15.024357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-242538658", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "ecc4f7ba-80d6-4373-9b52-24edf542538a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1555371050", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ca555348-5e33-47a7-a976-111a266d139c"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:15.171929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] validate_networks() for [('ecc4f7ba-80d6-4373-9b52-24edf542538a', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:14:15.512776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:15.525664 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90349ec1-3e12-4910-9b55-8f848d93f7e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.936283 Oct 10 11:14:15.531069 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2961/5805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:14 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:16.550438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:16.552344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:16.563436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=19 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:16.565701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:16.568592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:16.570446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:16.571804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:16.574597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:16.575268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:16.586439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=43 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:16.622707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:14:16.623278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:14:16.623992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:14:16.624486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:14:16.625340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:14:16.628313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:16.667297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:16.680436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:16.682193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:16.687804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:16.688528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:16.689141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:16.732971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=42 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:16.755147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:14:16.764433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Getting quotas for user 2a503073d40d477db4feb2c1757dc247 and project 04ac806af1e441b3aaf35e071cf2cc79. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:14:16.781184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:14:16.783873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:14:16.878685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77dbc828-ffe3-470d-b13a-27023b1bb92d tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.857770 Oct 10 11:14:16.881199 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2845/5806] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:14:15 2022] POST /compute/v2.1/servers => generated 361 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:14:16.892658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7e41dd4-1ff0-4f4f-bfac-712df8e70a2e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:16.896088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7e41dd4-1ff0-4f4f-bfac-712df8e70a2e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:16.956561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:16.973413 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7b1097c-1e52-4703-844d-c68616aff79c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.424175 Oct 10 11:14:16.974041 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2962/5807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:16 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:17.118365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7e41dd4-1ff0-4f4f-bfac-712df8e70a2e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:17.171988 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7e41dd4-1ff0-4f4f-bfac-712df8e70a2e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1241 microversion: 2.1 time: 0.283718 Oct 10 11:14:17.179545 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2846/5808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:16 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1241 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:18.000097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:18.000989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:18.013113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:18.013614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:18.014065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:18.014788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:18.015282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:18.033866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:18.217753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:18.218385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:18.235761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:18.236264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:18.236793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:18.248024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:18.248777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:18.249364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:18.545283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:18.556329 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fc1bf40-0ac8-4734-b674-d96a74ff4190 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1237 microversion: 2.1 time: 0.342319 Oct 10 11:14:18.571995 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2847/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:18 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1237 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:18.607559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:18.617622 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24585820-33a8-4365-9c35-e7c925decf73 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.621333 Oct 10 11:14:18.622921 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2963/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:17 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:19.586140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:19.587858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:19.627048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:19.628752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:19.629595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:19.630547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:19.631271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:19.631937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:19.654536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:19.655397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:19.671802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:19.677622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:19.678466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:19.680636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:19.685769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:19.687726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:19.817039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:19.831395 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c379dbbb-646c-4c52-b688-d177e56f8f83 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.252951 Oct 10 11:14:19.833513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2848/5811] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:19 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:20.121539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:20.144729 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40ee6bff-af8d-4383-8055-981432a7445d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.497662 Oct 10 11:14:20.146151 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2964/5812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:19 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:20.862724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:20.863415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:20.882635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:20.887133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:20.889389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:20.894605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:20.894944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:20.896783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:21.172052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:21.173305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:21.207589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:21.212550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:21.214318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:21.215740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:21.222660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:21.229056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:21.345311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:21.368437 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f920f46-0ac0-4839-8db6-f4260ac68c69 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.511321 Oct 10 11:14:21.371961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2849/5813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:20 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:21.869532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:21.883663 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b9f72ce4-711b-4124-8311-b268f1ab3e40 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.713565 Oct 10 11:14:21.907040 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2965/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:21 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:22.401164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:22.403346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:22.428975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:22.431362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:22.432527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:22.446485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:22.463239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:22.472271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:22.720819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:22.746480 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28237a8f-4146-4def-b257-f15454fefa6b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.351032 Oct 10 11:14:22.748339 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2850/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:22 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:22.914782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:22.915672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:22.938256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:22.948656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:22.949253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:22.950138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:22.959878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:22.962766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:23.453411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:23.462873 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dea86df7-b927-4c83-bf7c-36c34e8e7553 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.554556 Oct 10 11:14:23.472481 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2966/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:22 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:23.776622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:23.779816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:23.790029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:23.792221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:23.792839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:23.793904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:23.794519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:23.795639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:24.009755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:24.029671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67915aef-a88f-47df-a327-bc0f7f580503 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.251852 Oct 10 11:14:24.031728 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2851/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:23 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:24.506604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:24.507342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:24.539435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:24.544672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:24.550968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:24.551937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:24.552573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:24.553148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:24.810974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f3da53-df75-4b21-9704-17a9edeaf650", "tag": "1218af6d-459b-4e5c-ac78-dd6b0f9652ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:24.835027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:24.840751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:24.841413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:24.872829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] Creating event network-changed:1218af6d-459b-4e5c-ac78-dd6b0f9652ec for instance 36f3da53-df75-4b21-9704-17a9edeaf650 on n-h2-860687-2 Oct 10 11:14:24.883833 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f4913f92-5baf-4062-9369-8825a8f39684 req-c885d9e1-de16-4a34-8a15-b52efeef1486 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075862 Oct 10 11:14:24.884823 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2852/5818] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:14:24.976728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:25.003874 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a0f9825-347a-41c0-9a8c-1cbaa8d3754a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.499096 Oct 10 11:14:25.010413 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2967/5819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:24 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:25.060420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:25.064492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:25.097485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:25.098008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:25.099537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:25.100592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:25.101220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:25.106083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:25.318445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:25.341860 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08c75e98-f7f3-4928-9226-c59026977196 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.288101 Oct 10 11:14:25.342968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2853/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:25 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:26.035815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:26.037269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:26.054271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:26.055284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:26.058262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:26.059468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:26.060165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:26.063163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:26.409743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:26.410929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:26.411593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:26.422096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:26.422778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:26.423529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:26.425729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:26.426366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:26.427129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:26.435575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da135381-83d0-496c-ac51-f889bec0a3b1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.402550 Oct 10 11:14:26.436206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2968/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:26 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:26.695947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:26.704525 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8501567f-6cbe-4b0a-ae09-38afc221249e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.300282 Oct 10 11:14:26.723903 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2854/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:26 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:27.465924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:27.466609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:27.477860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:27.478637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:27.479299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:27.480944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:27.482214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:27.482806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:27.733219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:27.734638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:27.775435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:27.780497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:27.805737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:27.812780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:27.815374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:27.816333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:27.816924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:27.819564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:27.847054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:27.856222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d4509055-e98f-49b9-a20b-ebd388c8acfd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1169 microversion: 2.1 time: 0.395045 Oct 10 11:14:27.857013 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2969/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:27 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1169 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:27.995600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:28.006916 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccf9a421-57aa-4a1e-889d-0ffda7ba3b4a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.277555 Oct 10 11:14:28.007757 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2855/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:27 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:28.886274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:28.889354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:28.898153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:28.899773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:28.900604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:28.901838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:28.902530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:28.903296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:29.035623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:29.036840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:29.058530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:29.059278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:29.059909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:29.060795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:29.061417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:29.062006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:29.133094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:29.143740 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-044c4fac-e7cc-4f95-9870-bf9fa2ad1b87 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.261617 Oct 10 11:14:29.144639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2970/5825] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:28 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:29.240073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:29.248717 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8a2ec64-75d4-472d-afa9-4d99c7abd483 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.219571 Oct 10 11:14:29.249906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2856/5826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:29 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:30.170825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:30.171556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:30.199368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:30.200833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:30.201507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:30.204717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:30.206362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:30.206821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:30.274624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:30.276495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:30.288127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:30.297405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:30.298027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:30.302322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:30.302924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:30.303408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:30.698731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:30.710949 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bed167f-1b32-4dd7-9a5e-64413cc185e4 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.440380 Oct 10 11:14:30.712601 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2857/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:30 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:30.777389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:30.802477 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0e6b852a-9ad6-415f-8548-cf8a0e56903d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.637480 Oct 10 11:14:30.804280 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2971/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:30 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:31.022437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f3da53-df75-4b21-9704-17a9edeaf650", "name": "network-vif-plugged", "status": "completed", "tag": "1218af6d-459b-4e5c-ac78-dd6b0f9652ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:31.047905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:31.048397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:31.049067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:31.080546 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] Creating event network-vif-plugged:1218af6d-459b-4e5c-ac78-dd6b0f9652ec for instance 36f3da53-df75-4b21-9704-17a9edeaf650 on n-h2-860687-2 Oct 10 11:14:31.120499 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-da8a5b5d-2910-4d08-84e5-ab9a03707693 req-4794515b-df29-4e31-89bd-07a01eb74d7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404641 Oct 10 11:14:31.120499 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2858/5829] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:31.735503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:31.736165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:31.752747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:31.753648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:31.754263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:31.755389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:31.757745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:31.758376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:31.833031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:31.834419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:31.843901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:31.844598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:31.845217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:31.846155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:31.846821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:31.847444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:32.068537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:32.084343 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75dd4c01-a8f5-4473-900d-013f23d7453e tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1299 microversion: 2.1 time: 0.354173 Oct 10 11:14:32.084953 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2972/5830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:31 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1299 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:32.097616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:32.105733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0233832-ffb7-4fb0-89e5-6da5730b1a96 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.282219 Oct 10 11:14:32.107240 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2859/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:31 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:33.113067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:33.113694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:33.132643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:33.133575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.134088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.134370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:33.134529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.135278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.135738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.136166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.148297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.149042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.149691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.153532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.155057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.157214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.402560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:33.415540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0007a69c-fc18-44c7-8203-b1b9ef95e060 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1472 microversion: 2.1 time: 0.307690 Oct 10 11:14:33.419842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2973/5832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:33 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:33.446096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:33.446721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:33.456967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:33.467266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.467763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.470023 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab29581d-ac82-4710-bb60-dade86b0bead tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.341365 Oct 10 11:14:33.471865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2860/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:33 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:33.474636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.479533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.480239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.480669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.668673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:33.687283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e5f11223-8cc7-4922-bef0-c2b37f3f56b8 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1472 microversion: 2.1 time: 0.244941 Oct 10 11:14:33.703026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2974/5834] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:33 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:33.717454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:33.719727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:33.733533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.735050 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.737695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.739140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.740396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.742612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.942189 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca93c9b7-fb8a-44a3-a010-98db8210611c tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1623 microversion: 2.1 time: 0.226245 Oct 10 11:14:33.970036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:33.971458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:33.975279 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2861/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:33 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1623 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:33.983959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.984554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.985092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:33.987694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:33.988440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:33.998405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.344670 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-32f13efe-8865-444a-ac0e-1aa3c5ac1756 tempest-TestSecurityGroupsBasicOps-1440292467 tempest-TestSecurityGroupsBasicOps-1440292467-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1914 microversion: 2.1 time: 0.379453 Oct 10 11:14:34.347270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2975/5836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:33 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1914 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:34.482863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:34.484507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:34.498005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:34.499134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:34.509728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.512783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.514852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.515323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.516046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.516853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.518373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.520222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.520927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.521680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.522486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.524712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.584544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:14:34.765269 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d9f0ea3-d815-41ca-a2bc-6f147d16d55b tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 204 len: 0 microversion: 2.1 time: 0.285872 Oct 10 11:14:34.765915 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2862/5837] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:14:34 2022] DELETE /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:14:34.799254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:34.800189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:34.823125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.824103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.824560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.827714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:34.831796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:34.832271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:34.907971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:35.045682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:35.053395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:35.060288 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94626a2f-fd04-4144-bb8f-6371bbea6140 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.569885 Oct 10 11:14:35.061283 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2976/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:34 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:35.065948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8e45cd9-22a2-4575-9a5f-8ff364898718 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1478 microversion: 2.1 time: 0.290999 Oct 10 11:14:35.066522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2863/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:34 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1478 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:36.087031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:36.088609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:36.090062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:36.091300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:36.101615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:36.102352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:36.102929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:36.103923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:36.104535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:36.104899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:36.105404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:36.105840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:36.105959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:36.106559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:36.107049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:36.107491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:36.545344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:36.570659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93e5ad09-64d7-4113-822d-7c455822ca0f tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1478 microversion: 2.1 time: 0.484559 Oct 10 11:14:36.584381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2864/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:36 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1478 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:36.662171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:36.680903 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-71602fa9-2c9e-4e17-bed4-ed000e997441 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.601968 Oct 10 11:14:36.683874 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2977/5841] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:36 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:37.606448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:37.608960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:37.632446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:37.633060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:37.633679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:37.634573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:37.635187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:37.635866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:37.707392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:37.708118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:37.734630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:37.735086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:37.735773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:37.736796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:37.737586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:37.739560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:37.843243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:37.855644 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e4aec28-ffd4-41d3-9348-43a1dea5b447 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 200 len: 1478 microversion: 2.1 time: 0.257759 Oct 10 11:14:37.875505 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2865/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:37 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 1478 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:37.913621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f3da53-df75-4b21-9704-17a9edeaf650", "name": "network-vif-deleted", "tag": "1218af6d-459b-4e5c-ac78-dd6b0f9652ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:37.946411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:37.948096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:37.951566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:38.003887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] Creating event network-vif-deleted:1218af6d-459b-4e5c-ac78-dd6b0f9652ec for instance 36f3da53-df75-4b21-9704-17a9edeaf650 on n-h2-860687-2 Oct 10 11:14:38.010030 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8b039dee-c552-43ee-b186-0e37c364c5a3 req-ed1b0a7c-2a3c-4a96-bc2a-e1dba0e8538d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133188 Oct 10 11:14:38.011045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2866/5843] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:38.212386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:38.214972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:38.232587 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bebe9226-daa1-4f27-940b-1d87b66ce716 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.530583 Oct 10 11:14:38.244459 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2978/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:37 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:38.489259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e914964c-bb04-4a73-ba3e-7f948eddd8c8", "name": "network-vif-plugged", "status": "completed", "tag": "196070f5-3cb7-40d2-bd48-a949707f8e13"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:38.514550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:38.518538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:38.518838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:38.579452 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] Creating event network-vif-plugged:196070f5-3cb7-40d2-bd48-a949707f8e13 for instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 on n-h2-860687-2 Oct 10 11:14:38.593996 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-69b58b4d-d9fd-42ec-ac4f-40cf96c914aa req-734f8156-5a9a-4e45-986e-b0af4cc13959 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117109 Oct 10 11:14:38.598978 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2867/5845] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:38.884319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:38.886794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: 36f3da53-df75-4b21-9704-17a9edeaf650] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:38.902992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:38.910173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:38.912307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:38.918535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:38.919307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:38.919833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:38.952076 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] HTTP exception thrown: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Request method failure captured: Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 HTTP/1.1 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_4weuZhI4K1nF_9Jmup6CZzYymFD1OG7PHVC0RGmkpiWXpY53S34ipezyk36w7dZ02GwCeYCKYseSWoTcm5t5QgYDcuR8heX-y1ob8_j5ycv4TJSPwDdr-t5Frdwcq0SFb8XsqDBOj0slMFYDXhhIOWYruoXCUZOa8xi0grJaZKoqo Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 04ac806af1e441b3aaf35e071cf2cc79 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04ac806af1e441b3aaf35e071cf2cc79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04ac806af1e441b3aaf35e071cf2cc79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04ac806af1e441b3aaf35e071cf2cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04ac806af1e441b3aaf35e071cf2cc79"}]}] Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 04ac806af1e441b3aaf35e071cf2cc79 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestSecurityGroupsBasicOps-1118860683-project Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 2a503073d40d477db4feb2c1757dc247 Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1118860683-project Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '36f3da53-df75-4b21-9704-17a9edeaf650'} Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:38.954343 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Returning 404 to user: Instance 36f3da53-df75-4b21-9704-17a9edeaf650 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bff9155-737c-4ab7-a06e-8034b17205dc tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650" status: 404 len: 111 microversion: 2.1 time: 0.077537 Oct 10 11:14:38.959457 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2979/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:38 2022] GET /compute/v2.1/servers/36f3da53-df75-4b21-9704-17a9edeaf650 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:14:39.258435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:39.259208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:39.280317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:39.280824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:39.281269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:39.282326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:39.282861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:39.283811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:39.617905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:39.631161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e34af3a8-e72a-46d1-b488-f59de4f4bcb6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1203 microversion: 2.1 time: 0.377238 Oct 10 11:14:39.632666 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2868/5847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:39 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1203 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:40.660548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:40.661328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:40.697192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:40.700571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:40.702338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:40.706609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:40.708197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:40.709443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:41.302394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:41.319155 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34f59f82-3faa-4547-9f70-296a899ffb09 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1390 microversion: 2.1 time: 0.660861 Oct 10 11:14:41.321723 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2980/5848] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:40 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1390 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:41.344465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:41.347030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:41.363922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:41.364764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:41.365400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:41.366312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:41.366962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:41.367611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:41.635022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:41.661549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a674dc9-a818-4d25-885d-b889ccba1c6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1390 microversion: 2.1 time: 0.321126 Oct 10 11:14:41.699035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:41.699705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:41.707071 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2869/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:41 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:41.735617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:41.736728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:41.737198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:41.737949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:41.738413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:41.738871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:42.120827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:42.131939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0834d878-b7ba-4ee4-a1cc-508b346d5e54 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1390 microversion: 2.1 time: 0.444581 Oct 10 11:14:42.132514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2981/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:41 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1390 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:42.286162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:42.286678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:42.311969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:42.312490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:42.312948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:42.316599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:42.317094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:42.317874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:42.394662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:14:42.633326 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fee2dbd-977c-4fdd-95e6-70e35364ce12 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 204 len: 0 microversion: 2.1 time: 0.350930 Oct 10 11:14:42.634104 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2870/5851] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:14:42 2022] DELETE /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:14:42.643132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:42.644079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:42.654471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:42.655015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:42.655469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:42.656205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:42.656680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:42.657117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:43.215736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:43.235413 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0118f23b-696c-4b37-aa1d-e17f1b211d65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1396 microversion: 2.1 time: 0.596935 Oct 10 11:14:43.255111 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2982/5852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:42 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1396 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:44.270041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:44.271442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:44.281900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:44.284727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:44.287651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:44.289946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:44.290436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:44.292359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:44.703944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:44.731090 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80db5b72-7237-4aed-8967-5aad448c6c0a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1396 microversion: 2.1 time: 0.465469 Oct 10 11:14:44.744272 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2871/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:44 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1396 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:45.385657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e914964c-bb04-4a73-ba3e-7f948eddd8c8", "name": "network-vif-deleted", "tag": "196070f5-3cb7-40d2-bd48-a949707f8e13"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:45.413996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:45.414606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:45.414943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:45.445694 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] Creating event network-vif-deleted:196070f5-3cb7-40d2-bd48-a949707f8e13 for instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 on n-h2-860687-2 Oct 10 11:14:45.468666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5d2e7999-85ce-4529-b0fc-f704f6a9708f req-987a838b-183d-4261-b80a-3cc09d931e5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121663 Oct 10 11:14:45.474241 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2983/5854] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:45.770518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:45.772235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:45.799998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:45.800815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:45.803137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:45.804610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:45.806186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:45.807267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:46.080506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:46.092984 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-147d83ce-9dda-4d41-9127-2a27ecf7800c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.339231 Oct 10 11:14:46.135621 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2872/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:45 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:47.159734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:47.160451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:47.168222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=44 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:47.184297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:47.184812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:47.185257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:47.185974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:47.186434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:47.186861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:47.532070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:47.541455 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c6e1e0c-98ae-4eab-b1d7-108c43091ed6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.387387 Oct 10 11:14:47.560776 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2984/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:47 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:48.569644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:48.570272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:48.573616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:14:48.601018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:48.602718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:48.604091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:48.605074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:48.605757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:48.606434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:48.948360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:48.961125 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-245e33fd-fd53-47dd-941b-13a4880365a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.395895 Oct 10 11:14:48.963994 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2873/5857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:48 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:49.422964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:49.424658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:49.452730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:49.453622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:49.455483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:49.457708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:49.484247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:49.487492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:49.650350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:14:49.892820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca555348-5e33-47a7-a976-111a266d139c", "tag": "011dcddb-0ab6-4e8a-bd1f-7da42100460a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:49.944189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:49.947499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:49.947993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:49.949238 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09e24d73-4acb-45bd-9479-461ea7a62ae2 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 204 len: 0 microversion: 2.1 time: 0.529833 Oct 10 11:14:49.949867 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2985/5858] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:14:49 2022] DELETE /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:14:49.966031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:49.966776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:49.979684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:49.980252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:49.983402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:49.984463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:49.986178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:49.989308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:49.992517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] Creating event network-changed:011dcddb-0ab6-4e8a-bd1f-7da42100460a for instance ca555348-5e33-47a7-a976-111a266d139c on n-h1-860687-2 Oct 10 11:14:50.008652 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e1f09e4f-ab18-4bef-bdde-bce1c667905a req-eb25df79-e52d-4a8b-8fa9-57be76acc710 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.551180 Oct 10 11:14:50.016175 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2874/5859] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:50.036510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:50.040978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:50.058175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:50.058681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:50.061289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:50.062205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:50.065462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:50.066118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:50.270253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:50.272419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:50.283520 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa232dc6-4cdb-42d4-a4d4-f6ebc2301a6c tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1769 microversion: 2.1 time: 0.328178 Oct 10 11:14:50.285036 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2986/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:49 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1769 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:50.296057 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5c76bb1-a763-4236-a137-eaa3ba50ff8a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.273347 Oct 10 11:14:50.296841 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2875/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:50 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:51.309740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:51.310541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:51.320342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:51.320918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:51.323812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:51.325223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:51.325917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:51.332794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:51.333264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:51.333717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:51.345597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:51.346111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:51.346560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:51.347325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:51.347790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:51.348216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:51.543821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:51.585186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34eb68c1-9379-475d-8932-8dbb17c00849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.268779 Oct 10 11:14:51.599087 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2876/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:51 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:14:51.714158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:51.729825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5204e6b2-5d57-4660-8dda-045e3425d5fb tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1769 microversion: 2.1 time: 0.418133 Oct 10 11:14:51.730811 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2987/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:51 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1769 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:52.476707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca555348-5e33-47a7-a976-111a266d139c", "name": "network-vif-deleted", "tag": "011dcddb-0ab6-4e8a-bd1f-7da42100460a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:14:52.524159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.527115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.529046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.571145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] Creating event network-vif-deleted:011dcddb-0ab6-4e8a-bd1f-7da42100460a for instance ca555348-5e33-47a7-a976-111a266d139c on n-h1-860687-2 Oct 10 11:14:52.583735 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-416e7f8f-da9b-42d9-8d3c-052b8eb7dc8c req-31f28576-9b76-4a32-bdd2-a96bcec3af02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111189 Oct 10 11:14:52.586283 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2877/5864] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:14:52.612308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:52.612994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:52.634793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.639598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.640887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.644079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.644610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.645129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.755546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:52.756894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:52.765661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.780408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.783321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.787232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.788291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.790131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.807901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:52.825121 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ebe0b67c-54e6-4b44-8c1d-8ac002bc8ddb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1188 microversion: 2.1 time: 0.218688 Oct 10 11:14:52.839025 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2988/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:52 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:52.890149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:52.903371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:52.903974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:52.904457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lazy-loading 'fault' on Instance uuid ca555348-5e33-47a7-a976-111a266d139c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:14:52.979215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a503073d40d477db4feb2c1757dc247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac806af1e441b3aaf35e071cf2cc79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:52.992193 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c675db86-cb1c-42a3-85a7-9a0e2fb8c740 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 200 len: 1385 microversion: 2.1 time: 0.242161 Oct 10 11:14:53.009723 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2878/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:52 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 1385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:53.850803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:53.853385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:53.866398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:53.867351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:53.868519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:53.869309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:53.870213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:53.870852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:53.940117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:53.941905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:53.942588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:53.943331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lazy-loading 'fault' on Instance uuid e914964c-bb04-4a73-ba3e-7f948eddd8c8 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:14:53.993886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:14:54.009949 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7196a80a-27e3-4c41-8dd1-c0d40a6ffd4b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 200 len: 1147 microversion: 2.1 time: 0.164074 Oct 10 11:14:54.010568 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2989/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:53 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 1147 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:14:54.020321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:54.021562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] [instance: ca555348-5e33-47a7-a976-111a266d139c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:54.038639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:54.039191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:54.039638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:54.044979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:54.044979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:54.044979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:54.071939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] HTTP exception thrown: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Request method failure captured: Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c HTTP/1.1 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_4weuZhI4K1nF_9Jmup6CZzYymFD1OG7PHVC0RGmkpiWXpY53S34ipezyk36w7dZ02GwCeYCKYseSWoTcm5t5QgYDcuR8heX-y1ob8_j5ycv4TJSPwDdr-t5Frdwcq0SFb8XsqDBOj0slMFYDXhhIOWYruoXCUZOa8xi0grJaZKoqo Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 04ac806af1e441b3aaf35e071cf2cc79 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04ac806af1e441b3aaf35e071cf2cc79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04ac806af1e441b3aaf35e071cf2cc79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04ac806af1e441b3aaf35e071cf2cc79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04ac806af1e441b3aaf35e071cf2cc79"}]}] Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 04ac806af1e441b3aaf35e071cf2cc79 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1118860683 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestSecurityGroupsBasicOps-1118860683-project Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 2a503073d40d477db4feb2c1757dc247 Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1118860683-project Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ca555348-5e33-47a7-a976-111a266d139c'} Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:14:54.073652 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. Oct 10 11:14:54.077730 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:14:54.084599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Returning 404 to user: Instance ca555348-5e33-47a7-a976-111a266d139c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:14:54.085703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03b803de-724c-45ea-894c-7f89c31b2e6a tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c" status: 404 len: 111 microversion: 2.1 time: 0.069911 Oct 10 11:14:54.086464 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2879/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:54 2022] GET /compute/v2.1/servers/ca555348-5e33-47a7-a976-111a266d139c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:14:55.045066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:14:55.046776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:14:55.061405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:55.063390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:55.066815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:55.067945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:14:55.068661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:14:55.071239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:14:55.107474 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 HTTP/1.1 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e914964c-bb04-4a73-ba3e-7f948eddd8c8'} Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:14:55.111859 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:14:55.116315 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:14:55.119468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:14:55.124044 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bcac19ea-5363-4c7b-96e6-57e1df141e20 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 404 len: 111 microversion: 2.1 time: 0.083572 Oct 10 11:14:55.125401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2990/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:14:55 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:15:01.934638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:01.935579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:01.954216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:01.955054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:01.963802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:01.965376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:01.966056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:01.966669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:02.015302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 HTTP/1.1 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'e914964c-bb04-4a73-ba3e-7f948eddd8c8'} Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:15:02.018814 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.023555 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.035640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:15:02.036566 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-494ed7d0-c302-488e-947f-a79dc98f1072 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 404 len: 111 microversion: 2.1 time: 0.106315 Oct 10 11:15:02.040570 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2880/5870] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:15:01 2022] DELETE /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:15:02.045740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:02.046372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: e914964c-bb04-4a73-ba3e-7f948eddd8c8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:02.063698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:02.063947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:02.064216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:02.074113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:02.074928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:02.075266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:02.127982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 HTTP/1.1 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e914964c-bb04-4a73-ba3e-7f948eddd8c8'} Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:15:02.130016 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. Oct 10 11:15:02.134184 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:15:02.143701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance e914964c-bb04-4a73-ba3e-7f948eddd8c8 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:15:02.144870 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bb5edc0-9ce1-4ef8-b3e8-5168ca3c737d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8" status: 404 len: 111 microversion: 2.1 time: 0.103017 Oct 10 11:15:02.145610 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2991/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:02 2022] GET /compute/v2.1/servers/e914964c-bb04-4a73-ba3e-7f948eddd8c8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:15:06.246275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1d674a2-4d98-4a29-93d9-8dc009e4db90 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] Calling method '.version_select at 0x7f67777ede50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:06.340769 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1d674a2-4d98-4a29-93d9-8dc009e4db90 tempest-TestSecurityGroupsBasicOps-1118860683 tempest-TestSecurityGroupsBasicOps-1118860683-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1555371050" status: 202 len: 0 microversion: 2.1 time: 0.098510 Oct 10 11:15:06.353330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2881/5872] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Oct 10 11:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1555371050 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:15:14.714918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:14.716027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:15.129141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a56d2ada-a391-42f3-93e7-bf85083eb6e1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: .version_select at 0x7f67778f3dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2031715812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs2j5V/ZSLtkQeYtUSFoWFB+C7FZXnj8naMjVUBVnemNwaPjvLBCDmwRQEYXyweOUHovLX9N1uzC4C06Mp86TC/B9yyVqMVsjoBgJAQddvDdab8oLmtzZqp/1HTP4QIYg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:15.174501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a56d2ada-a391-42f3-93e7-bf85083eb6e1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:15.196159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a56d2ada-a391-42f3-93e7-bf85083eb6e1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:15.265093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a56d2ada-a391-42f3-93e7-bf85083eb6e1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.555880 Oct 10 11:15:15.268495 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2992/5873] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:15:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:15:42.996034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:42.996812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:43.003293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-572974981", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "5b5b489f-570f-41a8-b9f6-bd72ddacbd83"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2031715812", "security_groups": [{"name": "tempest-secgroup-smoke-1974879065"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:43.367800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] validate_networks() for [('5b5b489f-570f-41a8-b9f6-bd72ddacbd83', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:15:44.585368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:15:44.586760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:15:44.587652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:15:44.588651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:15:44.589302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:15:44.615267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:44.616917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:44.621736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:44.622898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:44.625228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:44.627908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:44.686684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:44.694641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:44.713493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:15:44.718654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:15:44.793689 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d4b4017-530e-402b-a3d8-da67ef1251b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.799557 Oct 10 11:15:44.798239 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2882/5874] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:15:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:15:44.807074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:44.809074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:44.810289 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:15:44.810595 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 (ip 10.222.0.16) !!! Oct 10 11:15:44.833234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17fe0517-ccd1-4e64-833e-f5058b9a6fd5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:44.834145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17fe0517-ccd1-4e64-833e-f5058b9a6fd5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:45.054010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-17fe0517-ccd1-4e64-833e-f5058b9a6fd5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:45.074485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17fe0517-ccd1-4e64-833e-f5058b9a6fd5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1266 microversion: 2.1 time: 0.269122 Oct 10 11:15:45.084530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2993/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:44 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:45.659367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1993378601", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c8f39c7f-1f67-42f4-9c3b-6fd8f5d0660a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:45.868967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:15:46.011732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81423503-8fea-4862-973e-953719aceed5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Action: 'create', calling method: .version_select at 0x7f67779efaf0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-331791270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmrfcU98qmhFB6jhmhu3ABKYx4COYQPZvR4NadjjK60QFbxd1yK/JPFDKv5sPUgVcwZqheduLwbcTfmmg2GTtfWfDzhWoJnTK+yfbhO1K45pUguhHZSAf+LWN3PdV+SGA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:46.096335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-81423503-8fea-4862-973e-953719aceed5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for project 6f5b3774dae74613a69cb5036316a57c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:46.113282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-81423503-8fea-4862-973e-953719aceed5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for user 3b0d502eb15e4edf8ff82b32307f5c0f and project 6f5b3774dae74613a69cb5036316a57c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:46.179819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81423503-8fea-4862-973e-953719aceed5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.820178 Oct 10 11:15:46.195067 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2883/5876] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:15:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:15:46.209504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:46.210518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:46.218367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:46.219297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:46.219972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:46.220937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:46.221619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:46.222405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:46.472863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:46.484359 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61c48dcf-7f78-41ae-98be-7795d920391e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1270 microversion: 2.1 time: 0.287761 Oct 10 11:15:46.506658 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2884/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:46 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:47.513053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:47.515827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:47.536133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:47.536857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:47.537194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:47.537942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:47.538405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:47.538831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:47.736882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:47.746672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9de85968-e50f-410d-84fa-40654e3321a9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1262 microversion: 2.1 time: 0.237709 Oct 10 11:15:47.767393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2885/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:47 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1262 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:47.847415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:15:47.847924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:15:47.848305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:15:47.848717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:15:47.849121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:15:47.875601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:47.878072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:47.888463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:47.889365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:47.890057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:47.890471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:47.982580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:48.005639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:48.172728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:15:48.175314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8f39c7f-1f67-42f4-9c3b-6fd8f5d0660a',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:15:48.516658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd478531-670a-4260-8170-3087f8521dcf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.862966 Oct 10 11:15:48.523514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2994/5879] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:15:48.529227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e25739f7-66a2-43c7-b1e2-029086a80e39 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:48.529858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e25739f7-66a2-43c7-b1e2-029086a80e39 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:48.775964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:48.776370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:48.794648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:48.795182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:48.796211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:48.806762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:48.807540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:48.808007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:48.859998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e25739f7-66a2-43c7-b1e2-029086a80e39 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:48.872261 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e25739f7-66a2-43c7-b1e2-029086a80e39 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1071 microversion: 2.1 time: 0.346797 Oct 10 11:15:48.873110 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2886/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:48 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1071 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:49.121193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:49.158899 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bbcd38f-029c-471b-9709-70b54a0abcc7 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1324 microversion: 2.1 time: 0.384541 Oct 10 11:15:49.161327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2995/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:48 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:49.898614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:49.899581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:49.918151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:49.918819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:49.919295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:49.925051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:49.925547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:49.926461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:50.170080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:50.182200 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e56aac29-833a-4548-94a5-59fb5d3742e1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1113 microversion: 2.1 time: 0.285711 Oct 10 11:15:50.191796 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2887/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:49 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1113 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:50.213278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:50.215059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:50.253645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:50.254156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:50.257729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:50.258880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:50.259406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:50.259855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:50.394750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:50.407084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73a3941a-4bb5-4023-88a3-077c363b2628 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1324 microversion: 2.1 time: 0.223676 Oct 10 11:15:50.409992 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2996/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:50 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:51.219789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:51.221038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:51.238261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:51.238957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:51.239603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:51.240502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:51.241144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:51.241774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:51.361683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:51.371462 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65036626-31b7-4fd6-ba20-b4450941f7fd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1187 microversion: 2.1 time: 0.156106 Oct 10 11:15:51.396040 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2888/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:51 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:51.430316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:51.430939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:51.453119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:51.453872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:51.454480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:51.455839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:51.456458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:51.457045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:51.716120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:51.727801 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6717aca7-3b4c-4dbd-b70c-864620225c4e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1324 microversion: 2.1 time: 0.301642 Oct 10 11:15:51.746896 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2997/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:51 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:52.409791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:52.410399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:52.439752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:52.440343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:52.440974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:52.441892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:52.442677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:52.454701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:52.754601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:52.756366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:52.765317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:52.771682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:52.772435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:52.776217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:52.777141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:52.777769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:53.033762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:53.048536 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26d8acd0-1d62-4e9b-97f1-3c9bfb066c78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1187 microversion: 2.1 time: 0.642523 Oct 10 11:15:53.057840 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2889/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:52 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1187 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:53.257520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1010507490", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-331791270", "security_groups": [{"name": "tempest-secgroup-smoke-1731279924"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "15c159c7-4fd7-41d9-9fbb-82d61a0814ce"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:53.304763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:53.323230 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-492d5e81-d08b-40db-a39e-9c29cf93c74e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.572674 Oct 10 11:15:53.323925 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2998/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:52 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:53.511621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] validate_networks() for [('15c159c7-4fd7-41d9-9fbb-82d61a0814ce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:15:54.085463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:54.086647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:54.111060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.111847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.112470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:54.113367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.113994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.114614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:54.671618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:54.814532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:54.822475 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5c1e60b0-77f1-41cd-8d90-9306af95ca88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1229 microversion: 2.1 time: 0.742231 Oct 10 11:15:54.823101 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 2999/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:54 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1229 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:15:54.834455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:54.835371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:54.851460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.856973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.857749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:54.870392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.872855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for project 6f5b3774dae74613a69cb5036316a57c. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:54.878177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.883568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:54.900751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for user 3b0d502eb15e4edf8ff82b32307f5c0f and project 6f5b3774dae74613a69cb5036316a57c. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:54.941089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:15:54.951968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:15:54.953711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:15:54.956048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:15:54.957054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:15:54.985704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.988954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.989474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:54.990274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:54.990754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:54.991225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:55.024196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for project 6f5b3774dae74613a69cb5036316a57c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:15:55.031031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Getting quotas for user 3b0d502eb15e4edf8ff82b32307f5c0f and project 6f5b3774dae74613a69cb5036316a57c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:15:55.047473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:15:55.050029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:15:55.184513 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b0acbb2-4c4f-4d1a-b655-2795e216d7ee tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.917008 Oct 10 11:15:55.196116 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2890/5889] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:15:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:15:55.207043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b33ce923-d02e-460f-b7b7-3938a9357c05 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:55.223444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b33ce923-d02e-460f-b7b7-3938a9357c05 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:55.409756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b33ce923-d02e-460f-b7b7-3938a9357c05 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:55.444522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b33ce923-d02e-460f-b7b7-3938a9357c05 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1302 microversion: 2.1 time: 0.247107 Oct 10 11:15:55.458587 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2891/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:55 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1302 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:55.488319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:55.496572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bc27618-f9dd-4d98-8bb6-ede54d81275b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.670112 Oct 10 11:15:55.501479 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3000/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:54 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:55.846182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:55.847515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:55.861333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:55.861846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:55.862283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:55.862991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:55.863481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:55.863912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:56.284762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:56.298883 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-725bc91c-8efa-4749-b6a3-14e24c69f0d5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1229 microversion: 2.1 time: 0.456844 Oct 10 11:15:56.300056 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2892/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:55 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1229 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:56.473401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:56.474037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:56.485397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:56.485866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:56.488820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:56.491939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:56.492633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:56.493341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:56.528950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:56.530550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:56.539702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:56.548312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:56.549127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:56.550105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:56.554178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:56.555255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:56.770824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:56.786778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47b2ff5b-b679-4e6f-bd3e-144843476f09 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1306 microversion: 2.1 time: 0.317985 Oct 10 11:15:56.787434 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3001/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:56 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:56.938311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:56.954777 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3333c999-ee7f-4e87-9381-65acb49b4404 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.429549 Oct 10 11:15:56.958147 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2893/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:56 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:15:57.324122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:57.325210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:57.339499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:57.340494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:57.343835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:57.345145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:57.346493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:57.347144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:57.794173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:57.814334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:57.815991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:57.832421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09cec78a-b36d-4146-b653-33065ecfd919 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1229 microversion: 2.1 time: 0.499389 Oct 10 11:15:57.834187 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3002/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:57 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1229 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:57.838422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:57.839141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:57.839751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:57.841107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:57.842478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:57.843706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:57.930967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:57.950671 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3573f9f2-6518-45a0-888c-21181ae9fa60 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1360 microversion: 2.1 time: 0.144718 Oct 10 11:15:57.953651 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2894/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:57 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:57.983608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:57.984663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:57.987798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:58.003632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:58.005210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:58.008456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:58.010876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:58.015120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:58.016168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:58.063670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:15:58.528216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:15:58.555267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:58.556036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:58.556815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:58.562784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:58.575269 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d58cf33c-2367-45b4-a777-233be01789f8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.598634 Oct 10 11:15:58.587090 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3003/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:57 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:58.594913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] Creating event network-changed:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h2-860687-2 Oct 10 11:15:58.607310 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-436a3527-4f6f-438f-9883-97ee5b9e75c3 req-e4d19103-179a-47d8-b1d6-af124fef1c09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084196 Oct 10 11:15:58.609091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2895/5898] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:15:58.860961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:58.861592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:58.875534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:58.876045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:58.876482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:58.877190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:58.877646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:58.878075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:58.982336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:58.983623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:58.999254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:59.000062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:59.000583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:59.003374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:59.005465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:59.006264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:59.433051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:59.435560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:15:59.458210 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e28cea30-b9c1-46ae-b77f-c0e43f18b91c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.480316 Oct 10 11:15:59.461237 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2896/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:58 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:15:59.461486 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-50ade55d-fc02-4602-b55a-24a5f0bd7fbc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1229 microversion: 2.1 time: 0.604799 Oct 10 11:15:59.462526 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3004/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:58 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1229 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:15:59.603113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:15:59.603945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:15:59.621407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:59.621917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:59.622375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:59.625601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:15:59.629454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:15:59.629927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:15:59.988405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:00.004177 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bcd3e51-c52a-449c-aff8-77ea1448d2b0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.405658 Oct 10 11:16:00.005336 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2897/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:15:59 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:00.490226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:00.491156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:00.492166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:00.493802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:00.510500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.511131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.512022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.512436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.512895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.513500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.514915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.515402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.516590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.517639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.518242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.523501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.886826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:00.902481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:00.907544 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4ea08fc3-bd86-4ad4-b9c9-d4fa920ff5af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.416847 Oct 10 11:16:00.908221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3005/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:00 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:00.915719 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-523082db-51bd-4970-9cd2-2c0f123da651 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1229 microversion: 2.1 time: 0.430164 Oct 10 11:16:00.917818 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2898/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:00 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1229 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:00.921670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e9b761-8166-41e2-8089-f62d37c79c84", "tag": "d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:00.926803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf562b-c500-48e3-888b-53a4854fb676", "tag": "bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:00.943076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.943546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:00.943705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.944018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.944218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:00.944680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:00.958268 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] Creating event network-changed:bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7 for instance d8cf562b-c500-48e3-888b-53a4854fb676 on n-h2-860687-2 Oct 10 11:16:00.959139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] Creating event network-changed:d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c for instance b3e9b761-8166-41e2-8089-f62d37c79c84 on n-h1-860687-2 Oct 10 11:16:00.963746 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cb84d323-7108-4dd9-8a19-fe84d8ec2e70 req-21c7683d-ef97-4a5d-9080-d561713ee2f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044417 Oct 10 11:16:00.964345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2899/5904] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:00.967283 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-70f902cb-c60d-42bb-a8ef-4c2572433016 req-90472f34-05f6-4f26-844b-22a81351f161 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057682 Oct 10 11:16:00.968736 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3006/5905] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:01.031167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:01.032474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:01.041723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.042216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.042831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:01.043814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.044629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.045884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:01.216298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:01.225443 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a347768-a0e2-4f53-b51c-4d471ad24116 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.199616 Oct 10 11:16:01.235909 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2900/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:01 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:01.945781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:01.947272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:01.949353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:01.951908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:01.960888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.964211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.964829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:01.965571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.966040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.966462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:01.969111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.974339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.975198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:01.976035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:01.976656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:01.977261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:02.503758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:02.508104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:02.522149 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ec29f95-50c2-4b15-8d69-d78d7791f07f tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.580346 Oct 10 11:16:02.525911 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1c0012f-e954-4d30-be7f-ab8c5fdb00ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.588986 Oct 10 11:16:02.526714 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3007/5907] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:01 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:02.529297 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2901/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:01 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:02.533467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:02.534249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:02.540708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:02.541467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:02.542135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:02.543133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:02.543813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:02.544461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:02.697605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:02.706560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cdf3b161-70da-4361-85cb-9c7f462fb5b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.178088 Oct 10 11:16:02.708494 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3008/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:02 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:03.553235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:03.554501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:03.569554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:03.571638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:03.578645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.579521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.582241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:03.583241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.585314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.585974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:03.586732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.588438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.593579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:03.594698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.595427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.596104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:03.965626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:03.974576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:03.976673 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c3c5ca0a-161e-425d-b961-491dbb7d5ec5 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.411817 Oct 10 11:16:03.978158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3009/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:03 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:03.983260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:03.984086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:03.991459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.992181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.992840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:03.993831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:03.994480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:03.995132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:04.003069 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e69720b3-e7b0-4404-8a7c-ba1232b27da6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.455649 Oct 10 11:16:04.004898 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2902/5911] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:03 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:04.340851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:04.354486 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6e2ee33-f461-479b-9dc4-8a5618fbec1d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.375089 Oct 10 11:16:04.356033 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3010/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:03 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:04.618426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "name": "network-vif-plugged", "status": "completed", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:04.639205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:04.640868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:04.647434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:04.670462 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] Creating event network-vif-plugged:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h2-860687-2 Oct 10 11:16:04.680393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a1f37103-8036-4c93-8270-6304e5daf9f2 req-824c6e3b-80b4-4338-a1e6-7a9ef602623f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066821 Oct 10 11:16:04.682763 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2903/5913] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:05.004206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:05.005506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:05.013358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.014852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.015397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.016369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.017079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.017740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.024201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:05.029601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:05.030883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:05.037858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:05.044427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.050090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.050883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.051751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.056644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.057219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.443378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=24 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:05.569071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:05.575549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:05.587328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f93381f-6411-45bd-89c3-911d60218521 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.559614 Oct 10 11:16:05.588638 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2904/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:05 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:05.610852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:05.611837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:05.621272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.622449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.623824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.624913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:05.625544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:05.626141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:05.637428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:05.641489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:05.650892 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-471ff523-c641-4324-bb6b-ba83c7444db3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.650524 Oct 10 11:16:05.663033 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3011/5915] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:04 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:05.841024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:05.856424 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24f9527f-f9b3-45e5-a9ee-7e25e4ff2897 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1392 microversion: 2.1 time: 0.265670 Oct 10 11:16:05.857859 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2905/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:05 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:06.612654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:06.615371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:06.632288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:06.633418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:06.634297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:06.635325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:06.639279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:06.639753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:06.678960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:06.679605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:06.707647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:06.710393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:06.710696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:06.711453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:06.711917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:06.712402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:07.469946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:07.479593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0474ced2-71b7-4b2c-a645-df3eb680bfba tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.871668 Oct 10 11:16:07.495299 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3012/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:06 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:07.495299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:07.495299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:07.502210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:07.502721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:07.503208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:07.503933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:07.504397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:07.504835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:07.509375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:07.534600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf3ae42e-a80a-4415-b102-88b9e63be671 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.861186 Oct 10 11:16:07.537883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2906/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:06 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:07.822362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:07.831971 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a172beef-da37-4383-bb58-0bf049f9468a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1563 microversion: 2.1 time: 0.345461 Oct 10 11:16:07.843764 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3013/5919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:07 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1563 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:07.869210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:07.870690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:07.886642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:07.887568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:07.890119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:07.893538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:07.895020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:07.896041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:08.177759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:08.189170 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44732ff2-2d46-4b3f-9a9a-7ec9a852f1ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1563 microversion: 2.1 time: 0.324554 Oct 10 11:16:08.190388 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2907/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:07 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1563 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:08.506420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:08.508676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:08.525961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:08.526667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:08.530740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:08.538267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:08.538972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:08.539601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:08.569785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:08.570420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:08.588979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:08.589485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:08.589929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:08.590648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:08.607485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:08.607883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:09.368649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:09.380972 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f4319415-9c69-47c5-bb78-9bd242a17c79 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.879555 Oct 10 11:16:09.383768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3014/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:08 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:09.393659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cf562b-c500-48e3-888b-53a4854fb676", "name": "network-vif-plugged", "status": "completed", "tag": "bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:09.411300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:09.412800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:09.413104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:09.429673 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] Creating event network-vif-plugged:bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7 for instance d8cf562b-c500-48e3-888b-53a4854fb676 on n-h2-860687-2 Oct 10 11:16:09.439202 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f3c547b6-6d8b-4c50-8f15-843724a9f150 req-fe00fd55-4358-4a2d-929f-a7b9493c070b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051502 Oct 10 11:16:09.440432 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3015/5922] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:09.490622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:09.503152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04a5d2f5-ea43-4de2-aa31-d19d3269c0f4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.942899 Oct 10 11:16:09.504256 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2908/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:08 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:10.408064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:10.408926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:10.422346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:10.422948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:10.424171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:10.426195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:10.427376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:10.428898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:10.529872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:10.530516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:10.544328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:10.545897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:10.546854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:10.549283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:10.549955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:10.551052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:11.050246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:11.058958 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ec7b3949-f5d8-4c1d-83c8-982500e18683 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.656646 Oct 10 11:16:11.067755 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3016/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:10 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:11.334805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:11.344170 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-868808ff-342a-4ddd-b32c-5d6b485ccefc tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1428 microversion: 2.1 time: 0.819528 Oct 10 11:16:11.349968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2909/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:10 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1428 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:12.092480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:12.093791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:12.101505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:12.103549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:12.104240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:12.105173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:12.105840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:12.106497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:12.379592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:12.381511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:12.394301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:12.395957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:12.396774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:12.397874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:12.398675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:12.399360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:12.816906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:12.829931 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7916fc4-8bcd-40f2-a621-fb1102c5c137 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.741376 Oct 10 11:16:12.831516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3017/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:12 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:12.838391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e9b761-8166-41e2-8089-f62d37c79c84", "name": "network-vif-plugged", "status": "completed", "tag": "d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:12.850409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:12.851185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:12.851766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:12.867226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] Creating event network-vif-plugged:d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c for instance b3e9b761-8166-41e2-8089-f62d37c79c84 on n-h1-860687-2 Oct 10 11:16:12.877030 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-49d60ea3-169d-478e-85e8-91abf9aa60e9 req-d98bd3f5-0dd4-41cf-b4a6-0ade2a191596 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043822 Oct 10 11:16:12.877694 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3018/5927] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:12.969722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:12.978376 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4ff4833-78a8-4a36-a238-5be84710531e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1607 microversion: 2.1 time: 0.605828 Oct 10 11:16:12.979507 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2910/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:12 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1607 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:13.005677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:13.006615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:13.015937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.016714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.017315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.018488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.019127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.019710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.360437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:13.381161 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2ee92b20-42a2-42e1-8b53-eed2df917175 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1607 microversion: 2.1 time: 0.380848 Oct 10 11:16:13.387853 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3019/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:12 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1607 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:13.414453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:13.415782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:13.432231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.433077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.433759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.434722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.435660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.436249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.510926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:13.511581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:13.518871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.522260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.524452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.525334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.525702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.528638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.887547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:13.902726 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-828f7cf5-b8d7-42fc-8009-7d7fef7fda0e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1607 microversion: 2.1 time: 0.499079 Oct 10 11:16:13.903638 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2911/5930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:13 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1607 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:13.917081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:13.931973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.933203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.933993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.939709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:13.951925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] Creating event network-changed:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h2-860687-2 Oct 10 11:16:13.952478 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af3143b0-b60e-4548-b8ef-1f9bbffd1b22 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1563 microversion: 2.1 time: 0.444938 Oct 10 11:16:13.965774 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f741812a-7ca6-4e5e-a00a-dcb1e4d0b8e7 req-b5e8e0a3-e10a-49c1-90f0-1696d3f29239 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052444 Oct 10 11:16:13.967591 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2912/5932] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:13.967787 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3020/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:13 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1563 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:13.975769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:13.976705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:13.983681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.984354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.984944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:13.985996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:13.986459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:13.986889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:14.370578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:14.391506 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20bd3c55-bc6d-4530-81aa-23b95886edfa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1217 microversion: 2.1 time: 0.422205 Oct 10 11:16:14.404027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2913/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:13 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1217 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:15.416258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:15.417473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:15.421367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:15.433275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:15.434014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:15.434600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:15.436944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:15.437573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:15.438161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:15.842053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:15.853684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5e79f20-6174-4972-a41c-72874621eec0 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1404 microversion: 2.1 time: 0.441373 Oct 10 11:16:15.855904 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3021/5934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:15 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:15.877991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:15.879285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:15.886479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:15.886968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:15.887439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:15.888947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:15.889588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:15.890202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:16.221384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:16.236005 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-257ad23a-d005-4c3f-be38-8ee2df8cd4aa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1404 microversion: 2.1 time: 0.362018 Oct 10 11:16:16.236895 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2914/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:15 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1404 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:16.487816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-722458614"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:16.491467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:16.498796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:16.499512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:16.499959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:16.500728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:16.501188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:16.501617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:16.611327 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Attempting to quiesce instance before volume snapshot. Oct 10 11:16:16.678735 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 10 11:16:16.775350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Creating snapshot from volume c8f39c7f-1f67-42f4-9c3b-6fd8f5d0660a. {{(pid=128800) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 10 11:16:16.824877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf562b-c500-48e3-888b-53a4854fb676", "tag": "bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:16.838420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:16.839173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:16.839820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:16.853803 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] Creating event network-changed:bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7 for instance d8cf562b-c500-48e3-888b-53a4854fb676 on n-h2-860687-2 Oct 10 11:16:16.862837 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-79cf2c5b-af07-413b-aa80-2669d29caf72 req-dfaf5911-3dc1-4470-993b-7c871b99588e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041068 Oct 10 11:16:16.867951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2915/5936] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:16:18.566527 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10e2f919-043c-49be-a4d5-4c6797ae2079 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84/action" status: 202 len: 0 microversion: 2.1 time: 2.311241 Oct 10 11:16:18.574017 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3022/5937] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:16:16 2022] POST /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84/action => generated 0 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 11:16:21.008954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-962662789", "imageRef": "0c4799f2-0369-478c-a071-66ab67816075", "flavorRef": "452", "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:21.124202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:16:22.760444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:16:22.761597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:16:22.762448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:16:22.763163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:16:22.764634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:16:22.780515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:22.781654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:22.782848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:22.784143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:22.785169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:22.785820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:22.816239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:16:22.823277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:16:22.838882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:16:22.842683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='814970e5-6ea9-40f0-8af6-8406319f5e7f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:16:22.965569 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e9b8f9d-4fcc-459f-9821-1a9f8fdb7e77 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960766 Oct 10 11:16:22.974111 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2916/5938] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:16:22.980537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0415637f-a13a-4e08-8bc6-e21016f2340b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:22.981265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0415637f-a13a-4e08-8bc6-e21016f2340b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:23.115997 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0415637f-a13a-4e08-8bc6-e21016f2340b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:23.124075 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0415637f-a13a-4e08-8bc6-e21016f2340b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1229 microversion: 2.1 time: 0.148771 Oct 10 11:16:23.128350 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3023/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:22 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1229 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:24.173349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:24.174348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:24.229754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:24.235146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:24.236500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:24.239776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:24.240528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:24.242891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:24.499604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:24.516045 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d673791-a07c-42d8-94fa-08097c3ddbec tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1233 microversion: 2.1 time: 0.350274 Oct 10 11:16:24.516899 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2917/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:24 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1233 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:25.544126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:25.545820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:25.568803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:25.569993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:25.570658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:25.571835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:25.572534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:25.573551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:25.757214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:25.767986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46e57d33-35b8-431a-aba6-340b1238aed5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1299 microversion: 2.1 time: 0.228544 Oct 10 11:16:25.768592 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3024/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:25 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:26.792917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:26.793454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:26.820302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:26.820828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:26.821287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:26.822024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:26.822497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:26.822937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:26.937016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:26.949190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa2bd1a3-9362-40d7-b250-ce5edf60674d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1299 microversion: 2.1 time: 0.159186 Oct 10 11:16:26.949801 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2918/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:26 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:27.978564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:27.980055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:27.992384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:27.999504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:28.002125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:28.005252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:28.006491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:28.008564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:28.533856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:28.545349 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-76cd8509-2017-4a21-93c8-d4db8632a293 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.572831 Oct 10 11:16:28.548209 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3025/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:27 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:29.591068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:29.592039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:29.607091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:29.610517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:29.610756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:29.612429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:29.613632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:29.615259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:30.035614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:30.052159 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec18b98f-b1c5-41ff-9e4f-2dbe0b1f0fe2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.481001 Oct 10 11:16:30.065317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2919/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:29 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:31.078410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:31.079547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:31.100248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955a0ba4-3ac9-4b15-888b-2ef811c12855", "tag": "be73fbf4-cda4-450a-95ef-6490258be38d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:31.123651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:31.126053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:31.127291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:31.129471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:31.129995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:31.130364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:31.131580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:31.133475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:31.135529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:31.181493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] Creating event network-changed:be73fbf4-cda4-450a-95ef-6490258be38d for instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 on n-h1-860687-2 Oct 10 11:16:31.213964 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e544f1b4-dbd5-491c-b48a-a2943cd4c13d req-4007fce2-0ccd-439b-acda-37c8b8ca2a8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118772 Oct 10 11:16:31.218028 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2920/5945] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:16:31.596040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:31.601049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:31.619076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:31.619602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:31.620053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:31.623830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:31.624357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:31.628083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:31.729123 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53edcb92-cbd6-452d-be5b-3195864d6372 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action" status: 200 len: 24568 microversion: 2.1 time: 0.138635 Oct 10 11:16:31.736260 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2921/5946] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:16:31 2022] POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action => generated 24568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:16:31.893289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:31.912483 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7398ab81-e34f-42de-b50e-36ab49c28314 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.829666 Oct 10 11:16:31.934263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3026/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:31 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:32.945567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:32.946598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:32.959865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:32.963481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:32.982959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:32.989486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:32.990088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:32.991192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:32.992393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:32.994235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:33.861608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:33.890449 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8d90a69-4e82-41c9-9684-7b9541e03e2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.951382 Oct 10 11:16:33.891759 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2922/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:32 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:34.933016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:34.935048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:34.978267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:34.984449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:34.985823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:34.987158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:34.988689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:34.989757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:34.990608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:35.407510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:35.451905 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2badfabf-4d49-4a0b-8f62-4ccdbc74e51c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.529104 Oct 10 11:16:35.452927 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3027/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:34 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:36.485915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:36.489534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:36.522095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:36.544302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:36.548807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:36.551282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:36.553356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:36.555932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:36.556820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:36.578945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=91 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:37.415930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:37.432789 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eefa0b8a-b010-453c-8766-eaddfed8c733 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.947762 Oct 10 11:16:37.439356 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2923/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:36 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:38.469308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:38.475227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:38.505543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:38.506526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:38.510733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:38.515754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:38.519918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:38.521243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:38.538985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:39.072031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:39.087428 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5854ccaa-a6d8-407b-9f5f-5e39d11a4fa4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.626584 Oct 10 11:16:39.105545 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3028/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:38 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:40.114022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:40.115741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:40.200604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:40.203264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:40.205094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:40.208042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:40.211195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:40.213046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:41.360169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:41.373985 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ba3a619-a305-4a68-a913-f1da6edad4bf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 1.264372 Oct 10 11:16:41.389139 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2924/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:40 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:42.418176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:42.422263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:42.450285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:42.452536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:42.453337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:42.454491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:42.457928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:42.458505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:42.776657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:42.777437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:42.790911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:42.791598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:42.792283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:42.793115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:42.793855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:42.797921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:42.806827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:42.807827 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c7589684-07d0-45da-999e-e391787c8460 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.408119 Oct 10 11:16:42.812773 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3029/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:42 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:43.505255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcfecb4e-5a19-4f8f-848f-063a0185f771 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1833 microversion: 2.1 time: 0.732554 Oct 10 11:16:43.508113 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2925/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:42 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1833 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:43.535639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:43.536593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:43.555745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:43.556570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:43.557135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:43.561611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:43.562466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:43.564124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:43.845652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:43.845652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:43.861508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:43.862764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:43.864003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:43.867157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:43.867837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:43.869525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:44.362616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:44.384163 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ede6ef40-b5ed-4482-9a06-a499178aca8d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.548596 Oct 10 11:16:44.384774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2926/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:43 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:44.429106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:44.456291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a6b526e-a3c4-48ab-8911-5f575efa434d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1682 microversion: 2.1 time: 0.926700 Oct 10 11:16:44.459486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3030/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:43 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1682 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:44.788095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:44.790522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:44.805908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:44.806583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:44.807251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:44.808162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:44.814155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:44.814155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:44.909872 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-825e5364-dc2d-4a2e-acfb-19f3303de88a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action" status: 200 len: 32641 microversion: 2.1 time: 0.125486 Oct 10 11:16:44.910857 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2927/5957] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:16:44 2022] POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action => generated 32641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:16:45.059921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:16:45.060468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:45.075615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.076212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.078035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:45.078902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.080824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.082309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:45.182786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a10c416179344704beb48131217301d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285bcd83b5184eb6bdacd6ee7f0d13ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:45.183606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] flavor_id is None. Assuming migration. {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 11:16:45.185836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:16:45.412907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:45.413683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:45.429617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.430388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.432463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:45.435931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.436545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.437089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:45.582674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:16:45.742729 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d501895-9596-4667-ab03-f246c1aa5032 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action" status: 202 len: 0 microversion: 2.1 time: 0.687183 Oct 10 11:16:45.745918 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3031/5958] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:16:45 2022] POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:16:45.765587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:45.767832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:45.786184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.789427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.790281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:45.792016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:45.794666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:45.795709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:46.264095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:46.300477 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc9e48a6-59a1-438e-ac47-c8acec85019a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.873530 Oct 10 11:16:46.301298 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2928/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:45 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:46.598830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:46.621802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a39fb6c-67c9-4c2d-9aa8-6d61abba5013 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1691 microversion: 2.1 time: 0.868034 Oct 10 11:16:46.623689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3032/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:45 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1691 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:47.331699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:47.332320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:47.346782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:47.350508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:47.351181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:47.355984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:47.356958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:47.357578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:47.653026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:47.653539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:47.674618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:47.675232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:47.675924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:47.676820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:47.677505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:47.678139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:48.035272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:48.053203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06dd1184-8244-4c62-80df-d925b59b6cf6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.724649 Oct 10 11:16:48.055236 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2929/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:47 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:48.202119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:48.212024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df08d3e2-a7e0-4358-a79b-d9c9a329d90e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1691 microversion: 2.1 time: 0.563513 Oct 10 11:16:48.213216 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3033/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:47 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1691 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:49.084018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:49.085662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:49.102796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:49.103325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:49.103788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:49.104508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:49.104967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:49.105926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:49.238801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:49.239548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:49.263376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:49.264182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:49.264796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:49.265709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:49.266508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:49.267205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:49.530987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:49.562844 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3cb4d1e-ef81-41ea-9309-659a1dce83fc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.477690 Oct 10 11:16:49.578819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2930/5963] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:49 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:49.730053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:49.742271 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c667628d-03b5-43a8-a913-52d0c284bdf3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1691 microversion: 2.1 time: 0.507752 Oct 10 11:16:49.755681 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3034/5964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:49 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1691 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:50.587587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:50.588169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:50.606653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:50.607780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:50.609884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:50.611707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:50.612286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:50.612687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:50.770254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:50.771477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:50.781820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:50.789966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:50.790757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:50.795586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:50.801565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:50.802305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:51.133662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:51.147444 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6878de3b-7949-46cd-aa9a-69f5b5926ac5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1341 microversion: 2.1 time: 0.562367 Oct 10 11:16:51.149137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2931/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:50 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1341 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:51.269966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:51.282267 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3fd30d68-9023-474a-88b6-de7a9c81e305 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1691 microversion: 2.1 time: 0.516289 Oct 10 11:16:51.286406 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3035/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:50 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1691 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:51.400735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:51.401572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:51.412602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:51.413429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:51.413873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:51.414727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:51.415385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:51.416100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:51.489862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6475c41b-6533-474b-bca5-88a8dc8e9554 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.084071 Oct 10 11:16:51.499227 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2932/5967] 10.222.0.16 () {58 vars in 1293 bytes} [Mon Oct 10 11:16:51 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676/os-server-password => generated 116 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:16:52.173021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:52.173662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:52.181771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:52.183630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:52.184280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:52.188097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:52.188623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:52.189085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:52.314189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:52.315596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:52.329897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:52.330625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:52.331371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:52.332257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:52.333035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:52.333727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:52.564231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:52.582364 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-df4d4e3e-07b3-4da3-a72b-af378ccc13dc tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.413824 Oct 10 11:16:52.583803 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3036/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:52 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:52.732416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:52.753961 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f9ce47f-e3fd-4147-b688-9b9bd1cc59b9 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.443016 Oct 10 11:16:52.757364 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2933/5969] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:52 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:53.613113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:53.614171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:53.622018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:53.625873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:53.626395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:53.628962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:53.629463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:53.629953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:53.782310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:53.783027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:53.799189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:53.799783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:53.800300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:53.801739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:53.802726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:53.803422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:54.116760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:54.130926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3f3d2f35-664a-4821-b2a3-f8cbac6f58a3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.521765 Oct 10 11:16:54.132782 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3037/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:53 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:54.194667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:54.205501 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e853fbd8-d1bf-45a2-9be8-1b82b8351b46 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.427599 Oct 10 11:16:54.222594 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2934/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:53 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:55.159068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:55.160357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:55.171409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:55.172259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:55.172955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:55.173874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:55.174945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:55.177133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:55.236238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:55.236996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:55.248028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:55.248791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:55.249462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:55.250450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:55.251098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:55.251726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:55.441361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:55.452773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb380573-612d-4427-bc9a-a49a16e9561f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.297885 Oct 10 11:16:55.454304 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3038/5972] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:55 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:55.476441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:55.487770 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cd3cde2-68e3-4bed-8189-de21784c65d0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.257205 Oct 10 11:16:55.499268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2935/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:55 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:56.479139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:56.479788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:56.502678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:56.503124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:56.503585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:56.504526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:56.506333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:56.506967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:56.514442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:56.515099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:56.550696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:56.551448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:56.552000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:56.552929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:56.557123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:56.557697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:56.920800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:56.929910 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-caa7d05e-e89f-4142-a3cc-4a85c9061196 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.455057 Oct 10 11:16:56.935315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3039/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:56 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:56.979510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:56.990034 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34e9ef4f-5f37-470c-a6f6-9b59e822e41c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.480537 Oct 10 11:16:56.995405 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2936/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:56 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:16:57.963135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:57.965174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:57.978737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:57.979289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:57.979935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:57.981167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:57.982840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:57.983613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:58.022688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:58.024946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:58.041589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:58.043213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:58.046506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:58.047650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:58.048295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:58.049818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:58.373939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:58.392180 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3d214f34-e0a1-4808-a864-a777b5e2d6c9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.434599 Oct 10 11:16:58.393396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3040/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:57 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:58.431659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:16:58.441275 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8f7d397-f8fd-4c49-99c3-ec571395ecc6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.422510 Oct 10 11:16:58.442406 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2937/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:58 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:16:59.443564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:59.444316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:59.463773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:59.464462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:59.465962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:59.466886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:59.467498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:59.468089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:59.469535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:16:59.470145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:16:59.486555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:59.487148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:59.487594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:16:59.488291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:16:59.488926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:16:59.489530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:00.161381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:00.169216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:00.173465 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b79fa6f-299e-4877-8ccb-4236bcfccb44 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.708090 Oct 10 11:17:00.180819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2938/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:59 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:00.190089 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c2c86f94-ab16-451d-982f-3f03059c8ba4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.771062 Oct 10 11:17:00.208074 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3041/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:16:59 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:01.201561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:01.202229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:01.217101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:01.218383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:01.225225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:01.238004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:01.238967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:01.239448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:01.240229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:01.240742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:01.241148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:01.244527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:01.244993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:01.247100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:01.247763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:01.248396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:01.610680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:01.620299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:01.621488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0047418d-2717-43e4-a913-e5ad5f00b4f2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.409182 Oct 10 11:17:01.622250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3042/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:01 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:01.629561 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86e9fca1-728d-4812-9136-77a59b6a0213 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.433222 Oct 10 11:17:01.643366 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2939/5981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:01 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:02.701501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:02.706625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:02.707461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:02.709805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:02.752812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:02.756631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:02.757682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:02.759840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:02.761477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:02.762291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:02.764982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:02.768447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:02.768912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:02.771692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:02.774244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:02.775060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:02.796845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:02.833120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:03.097466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:03.123641 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd764330-0415-4a12-a4bc-b8040650e006 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1696 microversion: 2.1 time: 0.458637 Oct 10 11:17:03.126414 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3043/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:02 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1696 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:03.233473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:03.243289 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3ef630a-8f09-448f-a493-ef231ad4ad65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.578034 Oct 10 11:17:03.246847 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2940/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:02 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:03.313558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955a0ba4-3ac9-4b15-888b-2ef811c12855", "name": "network-vif-plugged", "status": "completed", "tag": "be73fbf4-cda4-450a-95ef-6490258be38d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:03.365529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:03.366546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:03.368274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:03.402353 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] Creating event network-vif-plugged:be73fbf4-cda4-450a-95ef-6490258be38d for instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 on n-h1-860687-2 Oct 10 11:17:03.411291 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c441cf99-99b4-4fdc-b998-17053350bd4b req-a2babcdb-9239-4404-a7bb-33d5383003a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102025 Oct 10 11:17:03.412536 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3044/5984] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:04.154966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:04.156236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:04.179565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:04.180393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:04.181166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:04.182917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:04.183676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:04.184325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:04.272040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:04.273405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:04.289389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:04.295902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:04.296568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:04.297494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:04.298299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:04.298930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:04.518710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:04.527291 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63d7999e-bdf0-40e5-87e7-1276c0b9c1be tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1695 microversion: 2.1 time: 0.377603 Oct 10 11:17:04.534506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2941/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:04 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1695 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:04.607165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:04.638962 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43cbeec5-2091-4f18-bf98-0675848473c4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1375 microversion: 2.1 time: 0.371803 Oct 10 11:17:04.648355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3045/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:04 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1375 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:05.561891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:05.562694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:05.576009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:05.584346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:05.586380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:05.590157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:05.595942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:05.596549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:05.666395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "name": "network-vif-unplugged", "status": "completed", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:05.689459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:05.689946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:05.690377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:05.726826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Creating event network-vif-unplugged:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h1-860687-2 Oct 10 11:17:05.733920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:17:05.756369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2956e210-c903-4c67-9e12-e4e53ac493a3 req-d806f50f-0264-49c1-b4bb-9090feda75ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.481440 Oct 10 11:17:05.758108 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2942/5987] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:05.772004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:05.773972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:05.790823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:05.794403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:05.796673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:05.800782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:05.801637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:05.802288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:06.099379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:06.112579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:06.118981 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa80c3fa-7d6f-48c2-a5b0-6fd42c6e3ca8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1695 microversion: 2.1 time: 0.560891 Oct 10 11:17:06.125180 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04e2cd44-513a-4214-b788-244ab843fb42 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1562 microversion: 2.1 time: 0.361705 Oct 10 11:17:06.125976 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2943/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:05 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1562 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:06.158965 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3046/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:05 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1695 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:06.159230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:06.159874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:06.170605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:06.171520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:06.172242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:06.174329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:06.175224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:06.177697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:06.654731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:06.669131 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6702bb26-ad5e-4f24-a959-02ada44193be tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1562 microversion: 2.1 time: 0.514799 Oct 10 11:17:06.684302 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2944/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:06 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1562 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:06.817974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:06.819682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:06.829970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:06.830654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:06.831316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:06.834363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:06.837274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:06.837892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:06.890337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:17:07.060434 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-989c7db4-52b8-45fb-9ff0-85723ed5fcb9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 204 len: 0 microversion: 2.1 time: 0.248376 Oct 10 11:17:07.061340 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3047/5991] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:17:06 2022] DELETE /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:17:07.072160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:07.072874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:07.081913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=44 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:07.083989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:07.085242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:07.085758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:07.086683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:07.087204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:07.087907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:07.152769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:07.153749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:07.160588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:07.161922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:07.162566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:07.163506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:07.164234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:07.164852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:07.527876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:07.541204 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdd9bdae-e5d5-4c80-93b2-1c1054f66174 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1568 microversion: 2.1 time: 0.473403 Oct 10 11:17:07.541768 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2945/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:07 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:07.805922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:07.818773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:07.819474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:07.819919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:07.843517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Creating event network-changed:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h1-860687-2 Oct 10 11:17:07.857332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:17:07.871175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0124882b-541c-4ec4-baff-6dab40299964 req-44477c9c-efe7-4556-a866-f1e484d21ebb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069458 Oct 10 11:17:07.873095 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2946/5993] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:07.943665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:07.955918 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8a39544-28c4-4fe2-8cdc-193d5efb5395 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1695 microversion: 2.1 time: 0.807999 Oct 10 11:17:07.967566 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3048/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:07 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1695 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:17:08.570792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:08.571626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:08.585601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:08.586547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:08.587180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:08.588706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:08.590595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:08.591719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:08.991332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:08.997021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:09.044896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:09.046415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:09.048274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:09.049804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:09.050963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:09.051963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:09.246698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:09.260973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-442b6b3c-74f8-48b7-b8bb-35491e43c86a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1568 microversion: 2.1 time: 0.694349 Oct 10 11:17:09.261870 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2947/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:08 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1568 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:09.571540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:09.582002 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17efcacd-22bd-493a-bd04-455095b22983 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1695 microversion: 2.1 time: 0.602809 Oct 10 11:17:09.595375 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3049/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:08 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1695 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:10.288591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:10.289979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:10.298113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:10.299035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:10.300480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:10.301447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:10.302129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:10.302795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:10.492986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:10.507915 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6530c7d-96fa-4188-84d9-cc6286ad1f61 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1568 microversion: 2.1 time: 0.223264 Oct 10 11:17:10.520539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2948/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:10 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:10.611047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:10.612416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:10.621040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:10.621988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:10.623159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:10.624126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:10.627622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:10.628492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:10.790338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:10.799375 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e6c2072-c642-4813-b420-bc51bea0497c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1695 microversion: 2.1 time: 0.192739 Oct 10 11:17:10.810898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3050/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:10 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:11.164697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955a0ba4-3ac9-4b15-888b-2ef811c12855", "name": "network-vif-deleted", "tag": "be73fbf4-cda4-450a-95ef-6490258be38d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:11.188712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:11.189231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:11.189678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:11.240126 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] Creating event network-vif-deleted:be73fbf4-cda4-450a-95ef-6490258be38d for instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 on n-h1-860687-2 Oct 10 11:17:11.254350 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-036ecb53-ecf1-44f7-a9ee-283316027f55 req-72faede4-3469-4ac0-ad19-8e41c7f1d1bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091835 Oct 10 11:17:11.257768 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2949/5999] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:11.533524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:11.534223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:11.541388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:11.542262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:11.542685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:11.543440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:11.544023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:11.544346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:11.675580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:11.689912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8fb8cf60-98e4-4c26-8008-7a9102325cf2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1526 microversion: 2.1 time: 0.159275 Oct 10 11:17:11.691123 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3051/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:11 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:11.824967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:11.826174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:11.840744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:11.841890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:11.842410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:11.843402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:11.843949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:11.844445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:12.233426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:12.244472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cacc63cc-3758-42e4-bb85-16a43657e186 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1693 microversion: 2.1 time: 0.424278 Oct 10 11:17:12.245660 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2950/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:11 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1693 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:12.715679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:12.716939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:12.757050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:12.763154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:12.763648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:12.771516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:12.774799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:12.775416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.038312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:13.054253 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d21ccef7-efa4-411f-bf7d-c9b95e5a2ceb tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1360 microversion: 2.1 time: 0.345412 Oct 10 11:17:13.055935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3052/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:12 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1360 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:13.269939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:13.270551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:13.285019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.285707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.286407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.287405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.290023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.291269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.514213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:13.522666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9b17afb-6c5a-44c9-8c68-eded7d8cf1e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1690 microversion: 2.1 time: 0.258059 Oct 10 11:17:13.523810 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2951/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:13 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:13.545729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:13.546543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:13.562986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.562986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.562986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.563379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.563694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.564141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.641643 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a7faf7f-f225-47a3-9790-4f474817bd53 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action" status: 204 len: 0 microversion: 2.1 time: 0.099585 Oct 10 11:17:13.643088 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3053/6004] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:17:13 2022] POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:17:13.652065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:13.653333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:13.660761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.662818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.663346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.664242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:13.665396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:13.666006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:13.970016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:13.991297 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0334a649-1df4-4701-902b-6b5ddd3882fe tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1690 microversion: 2.1 time: 0.343712 Oct 10 11:17:14.008850 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2952/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:13 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:14.079127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:14.080105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:14.091565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:14.092084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:14.092537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:14.093260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:14.093737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:14.094178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:14.216418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:14.228527 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-316caaa9-8caa-421c-acd7-043b3213022e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1360 microversion: 2.1 time: 0.152177 Oct 10 11:17:14.234052 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3054/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:14 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:15.017749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:15.019371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:15.031291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:15.032028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:15.032777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:15.035085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:15.035881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:15.036894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:15.256488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:15.257142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:15.275759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:15.277237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:15.277911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:15.278865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:15.279597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:15.280102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:15.336960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:15.353002 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59df61f0-dae8-4343-ae60-2ae3904d5ecc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1690 microversion: 2.1 time: 0.339637 Oct 10 11:17:15.356463 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2953/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:15 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1690 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:15.423781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:15.441615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5f2f6246-8d32-4e4e-97db-a4381d295243 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1360 microversion: 2.1 time: 0.188875 Oct 10 11:17:15.442237 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3055/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:15 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:17:16.382641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:16.384066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:16.397291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:16.397828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:16.398262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:16.399190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:16.400108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:16.400108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:16.471407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:16.475842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:16.488939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:16.495502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:16.496013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:16.496548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:16.499031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:16.501539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:16.502015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:16.976782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:16.991577 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40979161-218a-48b9-969c-c8722b315245 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1360 microversion: 2.1 time: 0.529639 Oct 10 11:17:16.996309 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3056/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:16 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1360 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:17:17.095624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:17.108951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f33dd21f-a092-4545-b3bf-537acb4e09c3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1682 microversion: 2.1 time: 0.730829 Oct 10 11:17:17.110276 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2954/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:16 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1682 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:17.243456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "name": "network-vif-plugged", "status": "completed", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:17.265402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:17.266245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:17.266954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:17.289787 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] Creating event network-vif-plugged:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h1-860687-2 Oct 10 11:17:17.301121 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-405162af-ac51-4069-b964-e7fc60b7d6f7 req-60836633-9834-412b-a8af-6ca09117605c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059291 Oct 10 11:17:17.306105 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3057/6011] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:18.025485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:18.026943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:18.041861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:18.042642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:18.043415 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:18.044337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:18.044988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:18.045603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:18.125147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:18.125937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:18.126586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:18.127574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lazy-loading 'fault' on Instance uuid 955a0ba4-3ac9-4b15-888b-2ef811c12855 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:17:18.184670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:18.193544 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee8e1606-6f43-4642-9001-462683a3e697 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 200 len: 1365 microversion: 2.1 time: 0.178068 Oct 10 11:17:18.208254 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2955/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:18 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:19.222260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:19.223310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:19.241700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:19.242930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:19.243492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:19.246062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:19.246584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:19.247076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:19.294559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:19.320404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 HTTP/1.1 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '955a0ba4-3ac9-4b15-888b-2ef811c12855'} Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:19.322501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:19.327966 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:19.328928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:19.330210 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5b3700de-2098-4244-a330-2408edf58c05 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 404 len: 111 microversion: 2.1 time: 0.114431 Oct 10 11:17:19.330920 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3058/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:19 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:17:28.196266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:28.196266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:28.200314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=23 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:28.201843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=87 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:28.209383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:28.213889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:28.214633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:28.215795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:28.216597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:28.217230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:28.273786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:17:28.421826 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06a6b050-faa7-4f3a-a273-d0aa08622116 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 204 len: 0 microversion: 2.1 time: 0.229091 Oct 10 11:17:28.422609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2956/6014] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:17:28 2022] DELETE /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:17:28.429130 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:17:28.431036 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 (ip 10.222.0.16) !!! Oct 10 11:17:28.437046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:28.438107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:28.456935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:28.457779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:28.458425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:28.459395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:28.460634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:28.461265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:28.752468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:28.807668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d25daecb-002f-463f-b653-e4e796d4318b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1410 microversion: 2.1 time: 0.379050 Oct 10 11:17:28.810619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3059/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:28 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1410 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:29.834727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:29.836699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:29.853010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:29.853514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:29.854063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:29.855035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:29.855519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:29.855955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:30.547455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:30.558139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-faa8500a-7e23-4ab5-918a-73b118ee4d68 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1410 microversion: 2.1 time: 0.727467 Oct 10 11:17:30.559369 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2957/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:29 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1410 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:30.689764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e9b761-8166-41e2-8089-f62d37c79c84", "name": "network-vif-deleted", "tag": "d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:30.712342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:30.715915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:30.716489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:30.730895 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] Creating event network-vif-deleted:d96b2a84-9d5b-4c3b-be27-cc0fc6ec820c for instance b3e9b761-8166-41e2-8089-f62d37c79c84 on n-h1-860687-2 Oct 10 11:17:30.736236 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8d9b5aa5-bb7a-453d-af91-56ca31143a7f req-82956534-0e33-4424-912b-ce465859eba8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050986 Oct 10 11:17:30.737512 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3060/6017] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:31.588986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:31.591318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:31.605832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:31.606338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:31.606789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:31.607743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:31.608270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:31.608719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:31.740848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:31.751225 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b22eed41-e83b-4f29-879e-47161e011ade tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1202 microversion: 2.1 time: 0.168798 Oct 10 11:17:31.752252 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2958/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:31 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:32.777837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:32.779353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:32.787943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:32.788935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:32.789609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:32.791354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:32.792508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:32.793178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:33.009617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:33.023451 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e743659-58da-4ce1-9b7f-ad1f5fe8fb9c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1202 microversion: 2.1 time: 0.249558 Oct 10 11:17:33.024328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3061/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:32 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1202 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:34.047380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:34.048690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:34.065034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:34.065830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:34.066458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:34.067391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:34.069189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:34.069957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:34.162258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:34.171219 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78f8502c-d4b2-4143-924d-3f1f06a03ca7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1202 microversion: 2.1 time: 0.127601 Oct 10 11:17:34.171893 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2959/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:34 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1202 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:35.195560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:35.197010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:35.206653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:35.207453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:35.208084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:35.209001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:35.209624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:35.210374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:35.330467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:35.340897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c31b89e3-56df-4981-9667-b14454cafa15 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 200 len: 1202 microversion: 2.1 time: 0.149988 Oct 10 11:17:35.346857 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3062/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:35 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:36.373482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:36.376312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:36.414196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:36.417100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:36.417821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:36.420553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:36.421560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:36.426760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:36.476781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 HTTP/1.1 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b3e9b761-8166-41e2-8089-f62d37c79c84'} Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:36.481689 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:36.488251 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:36.501870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:36.503679 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9db31396-a863-411f-b16c-81d2d4a2a738 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 404 len: 111 microversion: 2.1 time: 0.137634 Oct 10 11:17:36.506086 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2960/6022] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:36 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:17:37.566132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:37.568762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:37.582288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:37.582986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:37.586922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:37.588590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:37.591973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:37.592463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:37.686373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67c07e70-9a45-4cd7-9fa4-e08a71c3b7d3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action" status: 200 len: 24578 microversion: 2.1 time: 0.125514 Oct 10 11:17:37.687460 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3063/6023] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:17:37 2022] POST /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008/action => generated 24578 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:17:40.946149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:40.946780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:40.957947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:40.958727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:40.958883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:40.959657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:40.960114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:40.960643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:40.981914 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 HTTP/1.1 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '955a0ba4-3ac9-4b15-888b-2ef811c12855'} Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:40.984012 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:40.988380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:40.992034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:40.994332 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6d0734e-a54d-470e-853b-895a11baf4c7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 404 len: 111 microversion: 2.1 time: 0.052176 Oct 10 11:17:40.995075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2961/6024] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:17:40 2022] DELETE /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:17:41.004005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:41.004889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 955a0ba4-3ac9-4b15-888b-2ef811c12855] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:41.013518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:41.014035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:41.014498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:41.015257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:41.015739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:41.016186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:41.035220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 HTTP/1.1 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '955a0ba4-3ac9-4b15-888b-2ef811c12855'} Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:41.037675 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. Oct 10 11:17:41.043294 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.045076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance 955a0ba4-3ac9-4b15-888b-2ef811c12855 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:41.046144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba833fa4-85c1-4f87-9975-7c099dfc30f8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855" status: 404 len: 111 microversion: 2.1 time: 0.046540 Oct 10 11:17:41.047322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3064/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:40 2022] GET /compute/v2.1/servers/955a0ba4-3ac9-4b15-888b-2ef811c12855 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:17:41.956830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:41.957367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:41.965088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:41.965813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:41.966253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:41.966957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:41.968649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:41.969166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:41.986733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 HTTP/1.1 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b3e9b761-8166-41e2-8089-f62d37c79c84'} Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:41.988373 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9c03b0d-4fef-4852-93c8-73ac13528c83 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 404 len: 111 microversion: 2.1 time: 0.038422 Oct 10 11:17:41.992159 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2962/6026] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:17:41 2022] DELETE /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:17:41.999825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:42.000459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b3e9b761-8166-41e2-8089-f62d37c79c84] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:42.010791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:42.011481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:42.011793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:42.012525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:42.013002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:42.013447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:42.028760 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 HTTP/1.1 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b3e9b761-8166-41e2-8089-f62d37c79c84'} Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:42.030501 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance b3e9b761-8166-41e2-8089-f62d37c79c84 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:42.034961 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b04907be-8ac9-4261-9ca1-ed50d5d46e3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84" status: 404 len: 111 microversion: 2.1 time: 0.036063 Oct 10 11:17:42.036033 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3065/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:41 2022] GET /compute/v2.1/servers/b3e9b761-8166-41e2-8089-f62d37c79c84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:17:42.134884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e750f67-775f-4ce5-8e25-2cc9d955b682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: .version_select at 0x7f677cf8c280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-775495568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGgjTMdkiSRB8GXpkArDvN6KT/edbb9BKIlum93uJdpEOrF0+SALyAjw4UhTgbLSl1DXI7WgcAlhX4e7RdVUhv0ct7PfzYbFsKmAk1Q9Q/cIjcignRM6kWcXGtaHXp2XA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:42.172516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e750f67-775f-4ce5-8e25-2cc9d955b682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:17:42.181921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e750f67-775f-4ce5-8e25-2cc9d955b682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:17:42.215781 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e750f67-775f-4ce5-8e25-2cc9d955b682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.092255 Oct 10 11:17:42.216903 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2963/6028] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:17:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:17:43.885444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:43.889401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:43.918678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:43.918678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:43.919029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:43.919789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:43.920280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:43.920720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:44.192025 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a81fcaa2-77da-43ff-9389-ce2a1a74e176 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1833 microversion: 2.1 time: 0.315347 Oct 10 11:17:44.193979 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3066/6029] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:43 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1833 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:46.468133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:46.469263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:46.481172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:46.492155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:46.496258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:46.498383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:46.503521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:46.507211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:46.507880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:46.510740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:46.512710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:46.518448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:46.567892 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] Creating event network-changed:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h1-860687-2 Oct 10 11:17:46.601859 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1555c4b5-84ad-4843-88b7-162166e249fe req-47a6a905-bdd2-49c1-9232-9f97c24abd3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125174 Oct 10 11:17:46.622980 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3067/6030] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:46.650919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:17:46.878186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71a88b5a-327f-4c42-9889-a49564561341 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 204 len: 0 microversion: 2.1 time: 0.413558 Oct 10 11:17:46.879099 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2964/6031] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:17:46 2022] DELETE /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:17:46.892513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:46.894830 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:46.898393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:17:46.918346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:46.921701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:46.922594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:46.926141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:46.926680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:46.927182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:47.649348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:47.662212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac5f0280-5424-4ba0-bfc2-b12a69ca2c3c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1688 microversion: 2.1 time: 0.777734 Oct 10 11:17:47.669159 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3068/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:46 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1688 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:48.701180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:48.701944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:48.711934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:48.717099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:48.718473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:48.725211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:48.726074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:48.728978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:49.325258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:49.337999 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8279fb4-82de-43da-90b0-f6bb1c5f5905 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1688 microversion: 2.1 time: 0.640217 Oct 10 11:17:49.341034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2965/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:48 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1688 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:49.997455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ffb0fd-76e5-4745-a144-71d7373cb008", "name": "network-vif-deleted", "tag": "813bd1f8-dac5-4a65-9a52-575687b171e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:17:50.067718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:50.068714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:50.072434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:50.123994 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] Creating event network-vif-deleted:813bd1f8-dac5-4a65-9a52-575687b171e2 for instance 22ffb0fd-76e5-4745-a144-71d7373cb008 on n-h1-860687-2 Oct 10 11:17:50.149775 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2fb36e13-aad2-403b-a922-6c327cd3ad31 req-a6b077b5-c30d-4bc0-9a42-7ae9105c6606 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157879 Oct 10 11:17:50.151556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3069/6034] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:17:50.370220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:50.371580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:50.416430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:50.416933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:50.417380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:50.418105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:50.418624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:50.431475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:50.551700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:50.552394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:50.553005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:50.553661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lazy-loading 'fault' on Instance uuid 22ffb0fd-76e5-4745-a144-71d7373cb008 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:17:50.913644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:17:50.947681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3db1a333-6e8a-4cd1-bc32-35953bed695c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 200 len: 1356 microversion: 2.1 time: 0.579620 Oct 10 11:17:50.967370 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2966/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:50 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 1356 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:17:51.976771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:17:51.977588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 22ffb0fd-76e5-4745-a144-71d7373cb008] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:17:51.995255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:51.997505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:51.997505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:52.001562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:17:52.002529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:17:52.005240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:17:52.027330 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] HTTP exception thrown: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Request method failure captured: Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 HTTP/1.1 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_7BjWrQtnk0VmWOwDWpSOEGZYin8R-sdrxgCrPN2aOTZ_i6XNa1S_JyARJZNFDlvM1DztiCMiSKU3VQIIpSkOzI7sYaqVIqTmdQGkQ82s6jJUqdISKf4fdhEOtmR2m__AyWTZaKEl5cTdbEhTU5RPIZQk2RWrm-VoglyEKYGhKnk4o Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54da2131a9b342e1a6f07e885362d9cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54da2131a9b342e1a6f07e885362d9cc"}]}] Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 41d437cade74442790b99ce41ef0fd87 Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '22ffb0fd-76e5-4745-a144-71d7373cb008'} Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:52.029619 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. Oct 10 11:17:52.034810 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:17:52.037439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Returning 404 to user: Instance 22ffb0fd-76e5-4745-a144-71d7373cb008 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:17:52.040054 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-090bb8f3-93ab-41de-a1ff-112e517067c5 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008" status: 404 len: 111 microversion: 2.1 time: 0.069269 Oct 10 11:17:52.042435 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3070/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:17:51 2022] GET /compute/v2.1/servers/22ffb0fd-76e5-4745-a144-71d7373cb008 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:18:03.558366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4c60572-1807-4d9f-9285-08d88b6d1769 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '.version_select at 0x7f677ce34b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:03.564504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:03.573076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:03.575935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:03.614511 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4c60572-1807-4d9f-9285-08d88b6d1769 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031715812" status: 202 len: 0 microversion: 2.1 time: 0.061248 Oct 10 11:18:03.615295 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2967/6037] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Oct 10 11:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031715812 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:18:03.647399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e25e0ea4-c4c3-4e1d-aee2-808407c5d824 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: .version_select at 0x7f677c7d9160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-253801551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQR7DvUMaF+Gb69lbdwRPjMaFEh298OPZLJHoslYaucXzEXGZHVwbnluyPNu5Q/F1u5noBthMGQ4w1oQbtFjP4lN1mfTOc5FdvDVVDE92Hlsm2H0GhS3X5uF81EKvgfRA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:03.666299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:03.669134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=46 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:03.700049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25e0ea4-c4c3-4e1d-aee2-808407c5d824 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:18:03.713906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e25e0ea4-c4c3-4e1d-aee2-808407c5d824 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:18:03.761727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e25e0ea4-c4c3-4e1d-aee2-808407c5d824 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.119048 Oct 10 11:18:03.768221 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3071/6038] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:18:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:04.953727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86017ab0-63be-4347-a9bc-e2a383ec0891 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-874458668", "availability_zone": "foo_zone"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:04.988360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-86017ab0-63be-4347-a9bc-e2a383ec0891 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Generated uuid fc321f15-c5b8-47b6-a4af-6e5007bc8f4a for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 11:18:05.023667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86017ab0-63be-4347-a9bc-e2a383ec0891 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.327995 Oct 10 11:18:05.027824 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2968/6039] 10.222.0.16 () {60 vars in 1164 bytes} [Mon Oct 10 11:18:04 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:05.044579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b891a5cb-7ef0-4494-952f-22ed91ce351a tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:05.104571 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b891a5cb-7ef0-4494-952f-22ed91ce351a tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.070066 Oct 10 11:18:05.106843 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3072/6040] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 11:18:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:05.120389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:05.125750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:05.126673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:05.127589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:05.128665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:05.129595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:05.130388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:05.182241 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0543833-70b2-4498-ade5-a7d27f5f77fe tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065528 Oct 10 11:18:05.184946 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2969/6041] 10.222.0.16 () {58 vars in 1176 bytes} [Mon Oct 10 11:18:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:05.196607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83719a78-1a25-4438-b27e-8160cbe0b252 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:05.205738 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83719a78-1a25-4438-b27e-8160cbe0b252 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013457 Oct 10 11:18:05.206659 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3073/6042] 10.222.0.16 () {58 vars in 1143 bytes} [Mon Oct 10 11:18:05 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:05.219536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69f7c0fe-a932-4e00-9217-fdc2fc3716d3 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860687-2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:05.247935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f7c0fe-a932-4e00-9217-fdc2fc3716d3 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:05.248440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f7c0fe-a932-4e00-9217-fdc2fc3716d3 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:05.249854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f7c0fe-a932-4e00-9217-fdc2fc3716d3 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:05.793878 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69f7c0fe-a932-4e00-9217-fdc2fc3716d3 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.579021 Oct 10 11:18:05.795364 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2970/6043] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 11:18:05 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:05.808329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6ebba6b-63ea-40ab-bfb7-8d62658bc208 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:05.829273 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6ebba6b-63ea-40ab-bfb7-8d62658bc208 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.022699 Oct 10 11:18:05.829928 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3074/6044] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:18:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:05.842476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-935fa2b7-9063-44eb-b243-e1b77174c4e0 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1499542555", "availability_zone": "foo_zone"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:06.125517 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-935fa2b7-9063-44eb-b243-e1b77174c4e0 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.286914 Oct 10 11:18:06.128165 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2971/6045] 10.222.0.16 () {60 vars in 1173 bytes} [Mon Oct 10 11:18:05 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:06.137766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f8fe9374-1976-41a5-90e5-580932231439 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:06.187280 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f8fe9374-1976-41a5-90e5-580932231439 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.053796 Oct 10 11:18:06.194768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3075/6046] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 11:18:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:06.200829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ccbe559-8deb-4ca5-9cf8-114395ce283a tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:06.219966 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ccbe559-8deb-4ca5-9cf8-114395ce283a tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023094 Oct 10 11:18:06.223737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2972/6047] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Oct 10 11:18:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:06.237032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a20f6bf-4aec-4e4d-a68f-df516b7d7eee tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860687-2"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:06.262942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a20f6bf-4aec-4e4d-a68f-df516b7d7eee tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:06.264124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a20f6bf-4aec-4e4d-a68f-df516b7d7eee tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:06.264774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a20f6bf-4aec-4e4d-a68f-df516b7d7eee tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:06.529701 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a20f6bf-4aec-4e4d-a68f-df516b7d7eee tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.298062 Oct 10 11:18:06.531461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3076/6048] 10.222.0.16 () {60 vars in 1194 bytes} [Mon Oct 10 11:18:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:06.550555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2467c6c0-bddb-43bc-aa85-801372c61420 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:06.605218 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2467c6c0-bddb-43bc-aa85-801372c61420 tempest-TestAggregatesBasicOps-544918130 tempest-TestAggregatesBasicOps-544918130-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066072 Oct 10 11:18:06.610680 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2973/6049] 10.222.0.16 () {58 vars in 1155 bytes} [Mon Oct 10 11:18:06 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 11:18:16.639811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1268892560", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "112eeacd-f4c5-44a1-9078-9c2bd79850de"}], "key_name": "tempest-TestNetworkAdvancedServerOps-253801551", "security_groups": [{"name": "tempest-secgroup-smoke-965418981"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:16.715542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:16.721204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:16.722290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:17.058534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] validate_networks() for [('112eeacd-f4c5-44a1-9078-9c2bd79850de', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:18:18.800013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:18:18.801196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:18:18.802197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:18:18.802499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:18:18.803054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:18:18.826490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:18.827410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:18.827544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:18.829583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:18.831417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:18.832050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:18.891601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:18:18.898040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:18:18.937939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:18:18.942136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:18:19.056304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e053409-ca54-48e8-b2c0-37703a3fba8a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.421803 Oct 10 11:18:19.076734 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3077/6050] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:18:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:18:19.086806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:19.089136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:19.091313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:19.111105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8138b77-ae31-4e15-be68-4f4ab8d5c455 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:19.112046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8138b77-ae31-4e15-be68-4f4ab8d5c455 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:19.399133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8138b77-ae31-4e15-be68-4f4ab8d5c455 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:19.413013 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8138b77-ae31-4e15-be68-4f4ab8d5c455 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1266 microversion: 2.1 time: 0.328801 Oct 10 11:18:19.437388 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2974/6051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:19 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:19.826738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1129626697", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-775495568", "security_groups": [{"name": "tempest-secgroup-smoke-1217491596"}], "block_device_mapping_v2": [{"uuid": "7eb1a8e9-8f6f-4f30-ba6a-e18de7d703f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:20.062425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:18:20.446667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:20.447892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:20.456926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:20.457529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:20.457967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:20.458690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:20.459224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:20.459668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:20.699742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:20.710738 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f2262a8-9aea-4f5b-b7b7-a762239c6581 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1262 microversion: 2.1 time: 0.269900 Oct 10 11:18:20.714533 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2975/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:20 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1262 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:18:20.946663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:18:20.947840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:18:20.948555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:18:20.949321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:18:20.949995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:18:20.960972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:20.964036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:20.964958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:20.965984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:20.967569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:20.971372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:20.999065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:18:21.005185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:18:21.184996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:18:21.187424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7eb1a8e9-8f6f-4f30-ba6a-e18de7d703f8',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:18:21.486009 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-315586aa-51de-4a51-841c-7ce332657f0f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.664013 Oct 10 11:18:21.488353 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3078/6053] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:18:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:18:21.498864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbcb7847-e2ae-46cb-bfc5-5b225468617f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:21.499526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbcb7847-e2ae-46cb-bfc5-5b225468617f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:21.649838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbcb7847-e2ae-46cb-bfc5-5b225468617f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:21.661117 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbcb7847-e2ae-46cb-bfc5-5b225468617f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1094 microversion: 2.1 time: 0.163534 Oct 10 11:18:21.663593 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2976/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:21 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1094 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:21.743453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:21.744279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:21.759535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:21.760391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:21.761022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:21.763725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:21.764398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:21.766781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:21.964933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:21.974902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67f692a9-f116-4d0b-ac46-d2741de5288b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1324 microversion: 2.1 time: 0.237460 Oct 10 11:18:21.984842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3079/6055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:21 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:22.701986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:22.704930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:22.816469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:22.816975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:22.817425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:22.818158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:22.818617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:22.829912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:23.022158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:23.022915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:23.080032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:23.094310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:23.094310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:23.094310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:23.100145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:23.100660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:23.101117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:23.114741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-653897af-1729-4569-94fc-25c29e86ed2e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1144 microversion: 2.1 time: 0.427219 Oct 10 11:18:23.119455 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2977/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:22 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1144 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:23.653884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:23.666795 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-899f9789-02f2-4384-975b-c7dee098e89d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1324 microversion: 2.1 time: 0.654552 Oct 10 11:18:23.670504 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3080/6057] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:23 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:18:24.163582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:24.165041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:24.187224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:24.188139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:24.191924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:24.193233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:24.196085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:24.198894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:24.569432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:24.582699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09b739ba-9684-4935-9f0d-10b8d91a1849 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1210 microversion: 2.1 time: 0.425866 Oct 10 11:18:24.586901 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2978/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:24 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:24.697784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:24.699243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:24.719894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:24.720626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:24.724663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:24.728640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:24.730433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:24.731702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:25.000958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:25.013947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04ac8e4f-a2f8-4108-aff7-2a152d5e8d84 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.322050 Oct 10 11:18:25.017183 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3081/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:24 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:25.612570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:25.613128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:25.624959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:25.625461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:25.625908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:25.626701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:25.627624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:25.628153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:25.802306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:25.811527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-770cf08d-555c-4733-999a-07e68b53c445 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1210 microversion: 2.1 time: 0.203682 Oct 10 11:18:25.816160 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2979/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:25 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1210 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:26.043898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:26.045103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:26.063568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:26.073234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:26.074129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:26.080287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:26.081022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:26.081656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:26.456407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:26.476523 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3b6c72b1-da1c-49b7-9b6a-b2970340e791 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.436509 Oct 10 11:18:26.478586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3082/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:26 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:26.839444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:26.840088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:26.842917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:26.857040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:26.862568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:26.869021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:26.873673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:26.875202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:26.875886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:26.879756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:26.884782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:26.885857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:26.924590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] Creating event network-changed:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:18:26.952750 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-114c2d48-f9d9-4ec3-9b19-370b5cc2bd3f req-4d1e5b68-f5b3-4104-b591-0adffabb8c69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117625 Oct 10 11:18:26.953919 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3083/6062] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:27.306893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:27.318448 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d93339c2-3888-4c7e-8139-33efc0af2946 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1278 microversion: 2.1 time: 0.488171 Oct 10 11:18:27.333183 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2980/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:26 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1278 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:27.504463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:27.505182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:27.521317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:27.522081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:27.522536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:27.523330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:27.523807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:27.524247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:27.819459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:27.828141 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-012ba523-04be-4e51-8f57-13a163c1b14d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.327837 Oct 10 11:18:27.830960 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3084/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:27 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:28.354557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:28.357079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:28.424657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:28.426691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:28.430650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:28.431798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:28.433438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:28.434154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:28.624665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:28.641117 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04780f40-0e51-43a3-af8d-23300b0a6adf tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1278 microversion: 2.1 time: 0.290397 Oct 10 11:18:28.642152 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2981/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:28 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:28.857746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:28.859165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:28.866391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:28.868410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:28.869147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:28.870122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:28.870838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:28.871540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:29.043057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf6fe0d-fbc3-4f3e-9bfd-02257698551d", "tag": "9aa37b65-91e4-48db-8b56-e3a202d4b806"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:29.044980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:29.053259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:29.054004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:29.054733 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1710c588-7273-4066-bb73-4631b03a074d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.200210 Oct 10 11:18:29.055414 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:29.056266 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3085/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:28 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:29.074152 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] Creating event network-changed:9aa37b65-91e4-48db-8b56-e3a202d4b806 for instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d on n-h2-860687-2 Oct 10 11:18:29.081347 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3caf4563-8c16-46ee-8778-5860c709b902 req-08b94ba6-8399-4115-85da-eccc25618fbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042058 Oct 10 11:18:29.082826 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2982/6067] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:29.669564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:29.670488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:29.686376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:29.689114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:29.690155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:29.691923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:29.694020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:29.695307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:29.936335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:29.945150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f82bc3cb-e125-4e9d-88f4-5d43a8b9e04b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1278 microversion: 2.1 time: 0.279215 Oct 10 11:18:29.947618 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3086/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:29 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:18:30.083320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:30.085071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:30.094436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:30.095322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:30.096001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:30.096966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:30.097666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:30.098607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:30.308441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:30.323679 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9caf7e8d-6818-4417-81d6-80c681bcd4ab tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.245348 Oct 10 11:18:30.324708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2983/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:30 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:30.972731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:30.973444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:30.981421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:30.981937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:30.982510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:30.983400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:30.983937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:30.984447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:30.990403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:31.022767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:31.323656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:31.333263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a82a33d-269e-4905-ad95-ce58cba8a6b2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1278 microversion: 2.1 time: 0.364821 Oct 10 11:18:31.350838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:31.352898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:31.362470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3087/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:30 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:31.364670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:31.368635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:31.375077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:31.376310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:31.377040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:31.378597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:31.655998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:31.693421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:31.706947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbd49ec4-7cb9-4176-b26d-9f2c2f9dc7c2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.360955 Oct 10 11:18:31.720221 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2984/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:31 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:18:32.363042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:32.363731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:32.371548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:32.372067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:32.372529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:32.373257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:32.373732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:32.374497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:32.529008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:32.537951 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b28a7ab7-8c13-4455-bae6-f95b1d1fb1b8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.180934 Oct 10 11:18:32.539964 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3088/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:32 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:32.733696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:32.734363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:32.744416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:32.745493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:32.746522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:32.747834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:32.748637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:32.749267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:32.897754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:32.906824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06ca54b3-6ec6-4939-943c-1003269ca42f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.177220 Oct 10 11:18:32.922720 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2985/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:32 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:33.253044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "name": "network-vif-plugged", "status": "completed", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:33.272522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:33.275753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:33.276409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:33.299675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] Creating event network-vif-plugged:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:18:33.306303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e78aad8c-efdc-4a05-b464-0f03c5a2720c req-febb7430-779e-4b42-afe9-c84582d37fd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062545 Oct 10 11:18:33.307590 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3089/6074] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:33.565370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:33.566085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:33.573431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:33.574138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:33.574584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:33.575334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:33.575795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:33.576209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:33.727113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:33.736129 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16a1961d-d442-4520-8407-43c18505e0f1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.174927 Oct 10 11:18:33.737221 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2986/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:33 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:33.935758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:33.936401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:33.942630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:33.943173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:33.943628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:33.944343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:33.944870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:33.945313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:34.079841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:34.088105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-554f458f-2c15-4411-a839-83001a24cdeb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1391 microversion: 2.1 time: 0.157485 Oct 10 11:18:34.088784 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3090/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:33 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:34.760737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:34.761359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:34.768393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:34.768875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:34.769307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:34.770000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:34.770451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:34.770889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:34.911867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:34.920988 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-242f0fdb-fdfb-44de-a144-01719829c70e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.165035 Oct 10 11:18:34.921590 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2987/6077] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:34 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:35.111730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:35.112358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:35.120622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.121135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.121594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:35.122314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.122790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.123262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:35.267097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:35.276760 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a961f29a-e2ba-4bd3-9fb6-8acb1b8cd054 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1563 microversion: 2.1 time: 0.169007 Oct 10 11:18:35.277450 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3091/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:35 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:35.300049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:35.301056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:35.308520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.309351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.309831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:35.310611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.311237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.311729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:35.470138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:35.479299 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ad7e9a1-9309-4f0d-bcd2-c50263ae791e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1563 microversion: 2.1 time: 0.183502 Oct 10 11:18:35.480425 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2988/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:35 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:35.946719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:35.947525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:35.964831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.965430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.966323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:35.968387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:35.971852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:35.972586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:36.231879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:36.246558 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-792efca8-e4e7-4560-aec4-b72369c49248 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.305903 Oct 10 11:18:36.247657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3092/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:35 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:37.270862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:37.272058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:37.279842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:37.290447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:37.291094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:37.292013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:37.292486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:37.292913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:37.592166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:37.636018 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffc47623-54d7-4cb8-8668-2b754b8037a1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.369452 Oct 10 11:18:37.640544 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2989/6081] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:37 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:38.183462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:38.184871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:38.185569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:38.195737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:38.196464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:38.197092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:38.198892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:38.202110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:38.205322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:38.206405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:38.207169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:38.207945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:38.213609 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] Creating event network-changed:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:18:38.219845 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7bdecc58-6cb6-4d96-b72d-552d2fcada8f req-4aa1b6c0-d7a5-4fce-b501-96a21b040b5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Oct 10 11:18:38.225345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2990/6082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:38.524430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:38.559225 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-84380955-abf1-458f-a9ea-ea5a66232269 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1563 microversion: 2.1 time: 0.381001 Oct 10 11:18:38.572144 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3093/6083] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:38 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1563 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:38.664160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:38.665441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:38.674397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:38.696057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:38.697449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:38.699157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:38.702000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:38.704136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:38.959124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:38.971393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-719ee471-b26b-4544-aadf-1f506942aab9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.312943 Oct 10 11:18:38.972609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2991/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:38 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:39.997293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:39.999535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:40.008723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:40.009548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:40.010416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:40.011645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:40.012662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:40.012662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:40.205479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:40.216834 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90649be7-fe73-46b2-b981-c5fbdcec2dd3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.224377 Oct 10 11:18:40.217431 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3094/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:39 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:41.243796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:41.244411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:41.252417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:41.252915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:41.253514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:41.254462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:41.254931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:41.255390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:41.441979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:41.450970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cfb3ffa-db14-46c6-8689-a83dc40ec179 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.212718 Oct 10 11:18:41.455402 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2992/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:41 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:42.474132 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:42.474771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:42.485413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:42.625153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:42.633514 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-78a244b0-85bb-4c2c-a34d-c662bf9975e9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.163795 Oct 10 11:18:42.634089 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3095/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:42 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:42.938112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf6fe0d-fbc3-4f3e-9bfd-02257698551d", "name": "network-vif-plugged", "status": "completed", "tag": "9aa37b65-91e4-48db-8b56-e3a202d4b806"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:42.950691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:42.951637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:42.952315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:42.965799 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] Creating event network-vif-plugged:9aa37b65-91e4-48db-8b56-e3a202d4b806 for instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d on n-h2-860687-2 Oct 10 11:18:42.971325 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f982ee95-0255-4257-833c-70a0fd95adfb req-54da3458-0582-44f3-8c04-76d898ac30c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Oct 10 11:18:42.972155 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2993/6088] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:18:43.656357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:43.657017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:43.663956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:43.664457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:43.664910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:43.665618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:43.666088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:43.666533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:43.670654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:43.803706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:43.813706 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aa7c1e81-fcf3-418c-9883-24143e2eb76b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1266 microversion: 2.1 time: 0.161150 Oct 10 11:18:43.814569 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3096/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:43 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:44.839308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:44.840028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:44.846425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:44.846910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:44.847384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:44.848082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:44.848546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:44.849010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:44.868743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:44.992894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:45.001758 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-804717b6-0fde-4b72-9dc0-65087b180ad4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1453 microversion: 2.1 time: 0.168363 Oct 10 11:18:45.002487 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2994/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:44 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:45.024677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:18:45.025558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:45.033299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:45.033973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:45.034531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:45.035493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:45.036195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:45.036833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:45.179214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:18:45.189304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c3dc89d9-d63c-41b8-a14f-622bb479373a tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1453 microversion: 2.1 time: 0.169212 Oct 10 11:18:45.190700 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3097/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:18:45 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:18:47.301520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf6fe0d-fbc3-4f3e-9bfd-02257698551d", "tag": "9aa37b65-91e4-48db-8b56-e3a202d4b806"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:47.324228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:47.325094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:47.326464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:47.353556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] Creating event network-changed:9aa37b65-91e4-48db-8b56-e3a202d4b806 for instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d on n-h2-860687-2 Oct 10 11:18:47.359715 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-45f8a02e-6737-46e2-8a26-370e1dbdd92d req-0c51436e-ae4a-406f-8956-bc7f17930cac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062286 Oct 10 11:18:47.361220 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2995/6092] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:18:58.942960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:18:58.945290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:18:58.947890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:58.949151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:18:58.954603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:58.955170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:58.955627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:58.956443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:18:58.956915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:18:58.957359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:18:59.017651 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab8a8183-7b0f-45fc-bc1a-353fd67eeb31 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action" status: 200 len: 24572 microversion: 2.1 time: 0.078655 Oct 10 11:18:59.018305 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3098/6093] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:18:58 2022] POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:19:10.095676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=52 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:19:10.096624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:19:10.102983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:10.104122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:10.111686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.112256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.112764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.113542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.114080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.114607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.263472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64b28032-2e68-43bd-818a-d0417379109f tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1833 microversion: 2.1 time: 0.170374 Oct 10 11:19:10.264079 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2996/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:10 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1833 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:10.287974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:10.289316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:10.294474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:19:10.296270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:19:10.304488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.304996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.305449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.306167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.306635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.307129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.481385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:10.489144 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9cce5fcd-f792-4ff4-952a-0a4a70cf952e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1682 microversion: 2.1 time: 0.205915 Oct 10 11:19:10.499981 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3099/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:10 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:10.620832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:10.623523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:10.632000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.632672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.633332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.634238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.634701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.635349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.699248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60e4eaef-314f-4056-985f-0e09ddca847b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action" status: 200 len: 32648 microversion: 2.1 time: 0.081657 Oct 10 11:19:10.701389 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2997/6096] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:19:10 2022] POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action => generated 32648 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:19:10.886294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:10.886958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:10.895205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.896103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.896990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.898031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:10.898699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:10.899325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:10.945624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a10c416179344704beb48131217301d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285bcd83b5184eb6bdacd6ee7f0d13ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:10.946792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] flavor_id is None. Assuming migration. {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 11:19:10.948460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:19:11.124567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc41ddaa-b97c-4299-a354-e4b12692ec90 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action" status: 202 len: 0 microversion: 2.1 time: 0.245920 Oct 10 11:19:11.126197 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3100/6097] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:19:10 2022] POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:19:11.137233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:11.138236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:11.148132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:11.148719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:11.149442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:11.150250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:11.150645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:11.151552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:11.380403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:11.396367 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1431c546-79e6-453d-a8cc-a4b6b6da9826 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1691 microversion: 2.1 time: 0.265032 Oct 10 11:19:11.414767 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2998/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:11 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:12.429961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:12.432060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:12.441513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:12.442230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:12.445491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:12.447146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:12.448240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:12.449811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:12.645805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:12.657323 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0618d5ef-ceb6-4952-bc62-33f955ca5c90 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1691 microversion: 2.1 time: 0.232165 Oct 10 11:19:12.658602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3101/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:12 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:13.683852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:13.684572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:13.696813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:13.697465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:13.698338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:13.698856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:13.699411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:13.699959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:13.880492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:13.891302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73493364-cb8d-4110-b6b8-3f5cb9553d26 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1691 microversion: 2.1 time: 0.211230 Oct 10 11:19:13.892055 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2999/6100] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:13 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:14.919017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:14.920021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:14.928882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:14.929401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:14.929864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:14.930603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:14.931134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:14.932019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:15.077638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:15.087238 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fbb8fe85-e161-4a39-9ba9-c1e31d5aa921 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.173277 Oct 10 11:19:15.087816 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3102/6101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:14 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:16.112862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:16.113808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:16.126758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:16.127388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:16.127841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:16.128546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:16.129001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:16.129434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:16.321781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:16.331286 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0af3b5fe-78a7-49ba-b721-f667e924a0cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.223646 Oct 10 11:19:16.332678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3000/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:16 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:17.359250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:17.359838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:17.372528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:17.373049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:17.373505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:17.374238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:17.375650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:17.376632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:17.596095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:17.605987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c21d118f-41f5-41d2-a306-cb033984d3f4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.252699 Oct 10 11:19:17.611247 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3103/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:17 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:18.635299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:18.635842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:18.643066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:18.643560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:18.643999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:18.644749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:18.645231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:18.645657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:18.784227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:18.792578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c3ce8fb-178a-4912-9ce2-1329a8e38c3b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.162071 Oct 10 11:19:18.793157 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3001/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:18 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:19.817050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:19.819305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:19.827255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:19.827956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:19.828863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:19.829735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:19.830374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:19.830984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:20.021562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:20.034352 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ace57936-4903-41f2-a416-7d412a7d432f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.221277 Oct 10 11:19:20.035861 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3104/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:19 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:21.062751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:21.064228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:21.082044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:21.082800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:21.083524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:21.084460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:21.086935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:21.087943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:21.307397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:21.317816 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54b062f7-8849-42e7-a0cb-19505e7051cb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.259693 Oct 10 11:19:21.318700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3002/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:21 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:22.351068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:22.352571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:22.371742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:22.372634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:22.374221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:22.379123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:22.379123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:22.379123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:22.538236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:22.546157 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-87943adc-de35-4f4b-b8d9-93ee01538f69 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.200187 Oct 10 11:19:22.546717 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3105/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:22 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:23.570416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:23.571829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:23.581892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:23.582696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:23.583467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:23.584547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:23.585681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:23.586351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:23.761350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:23.770905 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0ac40b6-9f62-4645-8353-0d0cf1e2e070 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.204583 Oct 10 11:19:23.778478 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3003/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:23 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:24.800947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:24.802266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:24.811449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:24.812140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:24.812803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:24.813796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:24.814532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:24.815217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:24.994340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:25.002468 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-998670df-eebe-40e7-8168-5f6ce77c4c0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.205992 Oct 10 11:19:25.003301 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3106/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:24 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:26.028036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:26.029374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:26.040735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:26.041453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:26.042098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:26.043265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:26.044458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:26.045804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:26.268923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:26.280475 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b59e2b52-e438-4d22-96c8-a14930426941 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1696 microversion: 2.1 time: 0.257718 Oct 10 11:19:26.314005 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3004/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:26 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1696 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:26.902067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "name": "network-vif-unplugged", "status": "completed", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:26.914089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:26.914581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:26.915235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:26.927504 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Creating event network-vif-unplugged:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h2-860687-2 Oct 10 11:19:26.933605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] Instance c09404e1-4a93-4086-9f84-ef19b2ee629f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:19:26.947212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e9b7c3f3-4b0a-4dc3-92bd-eda22430e5ec req-ea571baf-6cae-4c79-af79-514ebd2c53ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049182 Oct 10 11:19:26.947976 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3107/6111] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:19:27.308871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:27.309531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:27.316959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:27.317919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:27.318518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:27.319935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:27.320395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:27.321043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:27.490174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:27.499224 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6da8204-d2b5-4b4f-9b57-8f80ca79efce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1695 microversion: 2.1 time: 0.194210 Oct 10 11:19:27.499889 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3005/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:27 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:28.526217 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:28.526860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:28.533907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:28.534408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:28.534860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:28.535601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:28.536067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:28.536506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:28.716296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:28.725171 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3e59a74c-c296-4e48-bb19-94b6b6ad8e76 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1693 microversion: 2.1 time: 0.204559 Oct 10 11:19:28.728687 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3108/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:28 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:28.978354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:28.989094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:28.989566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:28.989991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:29.003054 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Creating event network-changed:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h2-860687-2 Oct 10 11:19:29.008730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] Instance c09404e1-4a93-4086-9f84-ef19b2ee629f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:19:29.019789 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9d641f5e-6a89-4d2c-b82a-f942b4679eb5 req-6e8470a5-4a87-4930-ae0f-f16217eb6a80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045897 Oct 10 11:19:29.020390 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3006/6114] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:19:29.758502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:29.759885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:29.769912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:29.770977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:29.774807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:29.776806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:29.777676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:29.778530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:29.985741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:29.995495 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4a0155e-33a0-4d9c-8071-8d2970a9e69a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1690 microversion: 2.1 time: 0.241886 Oct 10 11:19:29.996207 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3109/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:29 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:30.025625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:30.027073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:30.044799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:30.045602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:30.046229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:30.047570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:30.048307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:30.048986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:30.199324 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-534b2863-e1e2-4474-a6ac-d9c677daba5f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action" status: 202 len: 0 microversion: 2.1 time: 0.180282 Oct 10 11:19:30.200617 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3007/6116] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:19:30 2022] POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:19:30.215839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:30.216872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:30.228233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:30.229123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:30.229851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:30.230850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:30.232037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:30.232831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:30.451884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:30.461919 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5cfad9f8-06ac-40b6-8e0d-c3878369bb0a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.255493 Oct 10 11:19:30.463370 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3110/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:30 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:31.495186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:31.496757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:31.503667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:31.504534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:31.505219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:31.506309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:31.507226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:31.507892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:31.734076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:31.744860 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb2edbec-0475-4933-ae76-0359a17e94ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.256988 Oct 10 11:19:31.750679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3008/6118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:31 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:32.773870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:32.774517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:32.799894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:32.800403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:32.803679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:32.807177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:32.808032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:32.808485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:32.997961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:33.007381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2bcf2898-6bb5-4ff3-9152-6807420ed971 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.240233 Oct 10 11:19:33.008609 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3111/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:32 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:34.045128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:34.046317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:34.057606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:34.058397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:34.059101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:34.060039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:34.060775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:34.061559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:34.120658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:34.144683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:34.145796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:34.147277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:34.186150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Creating event network-changed:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:19:34.206863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] Instance c09404e1-4a93-4086-9f84-ef19b2ee629f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:19:34.236480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:34.247579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71bd387d-cd8a-44ca-a394-8fd6e63a530f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.207362 Oct 10 11:19:34.253562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a6aa623f-5269-473d-9690-54c5f72a9ed2 req-51f8f74d-9168-4ba2-8ed6-d106169d1601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135514 Oct 10 11:19:34.256514 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3112/6120] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:19:34.264807 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3009/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:34 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:35.276441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:35.277161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:35.283883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:35.285017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:35.285666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:35.286549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:35.287288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:35.287900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:35.442606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:35.450856 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aaa456e7-6ba5-4723-836a-8d1cf8b89fa4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.180565 Oct 10 11:19:35.452080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3113/6122] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:35 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:36.474008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:36.474790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:36.494114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:36.494621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:36.495095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:36.495821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:36.496290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:36.496723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:36.661534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:36.670369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df1daec9-57f8-48a0-b07f-9b657fe063f3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1689 microversion: 2.1 time: 0.200432 Oct 10 11:19:36.675735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3010/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:36 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:37.696733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:19:37.697444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:19:37.704649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:37.705159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:37.705612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:37.706325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:37.706793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:37.707260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:37.728777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:19:37.876639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:19:37.887557 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9eec85d-0f21-423f-9278-03dd0be7af20 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1682 microversion: 2.1 time: 0.195394 Oct 10 11:19:37.888315 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3114/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:19:37 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:19:39.692827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "name": "network-vif-plugged", "status": "completed", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:19:39.702451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:19:39.702934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:19:39.703391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:19:39.720663 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] Creating event network-vif-plugged:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:19:39.726187 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-109be1d1-ada6-40c1-a304-67a88272223d req-31e0a966-4b75-41c0-b4e5-79da5b2c3686 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244237 Oct 10 11:19:39.727037 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3011/6125] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:02.098487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:02.103721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:02.106671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=34 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:02.107492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:02.114134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:02.114774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:02.115150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:02.115901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:02.116381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:02.117257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:02.180766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1c34f9e-27fa-4d6a-9a59-573d688d8f98 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action" status: 200 len: 63198 microversion: 2.1 time: 0.085676 Oct 10 11:20:02.182949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3115/6126] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:20:02 2022] POST /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f/action => generated 63198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:20:08.567336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:08.568080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:08.573535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:08.574272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:08.582642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:08.583252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:08.583688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:08.584469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:08.584927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:08.585396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:08.724912 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7094c33-8217-4112-bcaa-6f2422acb0b7 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1833 microversion: 2.1 time: 0.159685 Oct 10 11:20:08.725792 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3012/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:08 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1833 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:09.908263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:09.909202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:09.917838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:09.918345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:09.918800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:09.919914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:09.920329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:09.920774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:09.949928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:20:10.038762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2756f487-dc77-468c-a12a-4c1b3889626b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 204 len: 0 microversion: 2.1 time: 0.134289 Oct 10 11:20:10.039769 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3116/6128] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:20:09 2022] DELETE /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:20:10.051712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:10.052468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:10.060554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:10.061453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:10.062093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:10.063262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:10.064075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:10.064863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:10.084127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:10.095175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:10.095936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:10.096644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:10.108794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] Creating event network-changed:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:20:10.114543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5971eebc-c325-4e00-b9bb-9fd9177962e8 req-c12e02d2-3515-4b48-b707-99445a56ef1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208410 Oct 10 11:20:10.115451 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3013/6129] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:10.208545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:10.217386 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-122432d4-b03d-4cad-b26a-8ff4b16aeae1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1688 microversion: 2.1 time: 0.172261 Oct 10 11:20:10.217966 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3117/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:10 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:20:11.242413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:11.244706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:11.252306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:11.252794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:11.253297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:11.254187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:11.254647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:11.255094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:11.426938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:11.437256 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-182f0940-1693-4257-9a06-9ede825c461e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1688 microversion: 2.1 time: 0.199036 Oct 10 11:20:11.437846 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3014/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:11 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:20:12.003214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09404e1-4a93-4086-9f84-ef19b2ee629f", "name": "network-vif-deleted", "tag": "daea89b6-c105-44c9-bc91-3f695fb3178c"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:12.015519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:12.016034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:12.016488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:12.033136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] Creating event network-vif-deleted:daea89b6-c105-44c9-bc91-3f695fb3178c for instance c09404e1-4a93-4086-9f84-ef19b2ee629f on n-h1-860687-2 Oct 10 11:20:12.038399 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1c586451-eadc-4604-a348-3b66e4d855a1 req-e688ba00-efe2-4628-bd0e-06763047c4ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039261 Oct 10 11:20:12.039084 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3118/6132] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:12.463251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:12.464069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:12.472571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:12.473073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:12.474016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:12.474749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:12.475290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:12.475730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:12.518049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:12.518528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:12.519105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:12.519716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lazy-loading 'fault' on Instance uuid c09404e1-4a93-4086-9f84-ef19b2ee629f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:20:12.570441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:12.581175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b867644b-48ec-4de1-a8cf-0c3ebbb27f9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 200 len: 1356 microversion: 2.1 time: 0.123514 Oct 10 11:20:12.582161 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3015/6133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:12 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 1356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:13.607196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:13.607930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: c09404e1-4a93-4086-9f84-ef19b2ee629f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:13.614211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:13.614718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:13.615212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:13.615933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:13.616411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:13.616861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:13.632333 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] HTTP exception thrown: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Request method failure captured: Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f HTTP/1.1 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_7BjWrQtnk0VmWOwDWpSOEGZYin8R-sdrxgCrPN2aOTZ_i6XNa1S_JyARJZNFDlvM1DztiCMiSKU3VQIIpSkOzI7sYaqVIqTmdQGkQ82s6jJUqdISKf4fdhEOtmR2m__AyWTZaKEl5cTdbEhTU5RPIZQk2RWrm-VoglyEKYGhKnk4o Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54da2131a9b342e1a6f07e885362d9cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54da2131a9b342e1a6f07e885362d9cc"}]}] Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 41d437cade74442790b99ce41ef0fd87 Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c09404e1-4a93-4086-9f84-ef19b2ee629f'} Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:20:13.634150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Returning 404 to user: Instance c09404e1-4a93-4086-9f84-ef19b2ee629f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6f729341-d19a-496d-bcb8-96607065f1d1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f" status: 404 len: 111 microversion: 2.1 time: 0.034585 Oct 10 11:20:13.639549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3119/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:13 2022] GET /compute/v2.1/servers/c09404e1-4a93-4086-9f84-ef19b2ee629f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:20:17.417827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85d00ea1-0c17-44a2-b0f1-edee31030855 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '.version_select at 0x7f677ca290d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:17.441848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85d00ea1-0c17-44a2-b0f1-edee31030855 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-253801551" status: 202 len: 0 microversion: 2.1 time: 0.027874 Oct 10 11:20:17.443819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3016/6135] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 11:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-253801551 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:20:17.484828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ebf1c206-2fad-4ffc-85b5-b59c9680e726 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: .version_select at 0x7f677c8a9a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-615520955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLystU32Z6huR1Gs61BQex7hd1vzRShCMBM7wz+piFFhAKIcgfPippLAO+5oWv5MUHEB58rAf8YUFX3FfC9Cup7LKA6EJm916XMprbVvOYuIbDBLT7wPk25c2sxvxnGjA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:17.502001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ebf1c206-2fad-4ffc-85b5-b59c9680e726 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:20:17.508272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ebf1c206-2fad-4ffc-85b5-b59c9680e726 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:20:17.534471 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ebf1c206-2fad-4ffc-85b5-b59c9680e726 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053660 Oct 10 11:20:17.535096 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3120/6136] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:20:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:20:23.718035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:23.729507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-678350945", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "32d38dcc-2f6d-48cb-8871-c776d5440168"}], "key_name": "tempest-TestNetworkAdvancedServerOps-615520955", "security_groups": [{"name": "tempest-secgroup-smoke-1807369635"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:23.888195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] validate_networks() for [('32d38dcc-2f6d-48cb-8871-c776d5440168', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:20:24.535051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:20:24.535470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:20:24.535958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:20:24.536429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:20:24.536855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:20:24.551259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:24.552045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:24.552699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:24.553639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:24.554109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:24.554544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:24.588920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:20:24.600667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:20:24.646367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:20:24.653171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:20:24.729867 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33318c03-84bf-4072-a6e0-0cc24099635a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.016144 Oct 10 11:20:24.730708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3017/6137] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:20:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:20:24.746033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-931a2602-8d7c-4015-a16d-bcc23bc8e92e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:24.747179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-931a2602-8d7c-4015-a16d-bcc23bc8e92e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:24.777013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:24.887413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-931a2602-8d7c-4015-a16d-bcc23bc8e92e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:24.897226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-931a2602-8d7c-4015-a16d-bcc23bc8e92e tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1265 microversion: 2.1 time: 0.157372 Oct 10 11:20:24.898229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3121/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:24 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:25.922517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eda58c76-742a-416c-95d1-ab5e2a4273b6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:25.931998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eda58c76-742a-416c-95d1-ab5e2a4273b6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:26.005329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eda58c76-742a-416c-95d1-ab5e2a4273b6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:26.013974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eda58c76-742a-416c-95d1-ab5e2a4273b6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1265 microversion: 2.1 time: 0.095567 Oct 10 11:20:26.015085 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3018/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:25 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:27.037906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-564e09f1-2f81-4536-92ff-877a2a4c2bf0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:27.038537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-564e09f1-2f81-4536-92ff-877a2a4c2bf0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:27.104983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-564e09f1-2f81-4536-92ff-877a2a4c2bf0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:27.112572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-564e09f1-2f81-4536-92ff-877a2a4c2bf0 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1265 microversion: 2.1 time: 0.078522 Oct 10 11:20:27.119233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3122/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:27 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:28.140592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:28.141797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:28.169794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:28.170587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:28.172523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:28.174729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:28.176366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:28.176729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:28.260875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:28.269870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9b71ace-28f8-4ea7-a5a5-05f8e266688d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1323 microversion: 2.1 time: 0.133653 Oct 10 11:20:28.271135 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3019/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:28 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1323 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:29.295707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:29.296476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:29.308286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:29.308903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:29.309438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:29.310252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:29.310930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:29.311577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:29.470470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:29.479034 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d63964c-69e3-469f-a227-875c5b4ef5b1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.187888 Oct 10 11:20:29.479642 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3123/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:29 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:29.562672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:29.581284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:29.582296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:29.583017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:29.597699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] Creating event network-changed:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h1-860687-2 Oct 10 11:20:29.604145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3d9182df-578b-4890-b560-54039b60233c req-90d2f965-c032-4320-b8cb-71855a0f152e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045518 Oct 10 11:20:29.604910 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3020/6143] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:30.502056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:30.502748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:30.510256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:30.510760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:30.511260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:30.511975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:30.512450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:30.512895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:30.650914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:30.658843 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6b860ce-f6a6-419e-9565-33dd2afb57fd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.160603 Oct 10 11:20:30.659382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3124/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:30 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:31.684307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:31.685013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:31.691398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:31.691916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:31.692353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:31.693310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:31.694175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:31.694739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:31.827386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:31.836550 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0aa096fb-5276-4cc5-82d6-93d2e48f4e9f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.158216 Oct 10 11:20:31.843169 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3021/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:31 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:32.859609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:32.860742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:32.862960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:32.879155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:32.879696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:32.880146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:32.880883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:32.881357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:32.881800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:33.042908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:33.051111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ff3df5bb-b094-4276-ad30-4513f43c9aac tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.196121 Oct 10 11:20:33.051701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3125/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:32 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:34.074559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:34.075815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:34.087918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:34.088450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:34.089321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:34.091167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:34.092204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:34.093005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:34.250332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:34.258869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c50e689-08b6-4ec9-8f9e-7afc88e2b0af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.188339 Oct 10 11:20:34.259485 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3022/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:34 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:35.282304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:35.282933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:35.290785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:35.291331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:35.291792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:35.292515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:35.293095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:35.293547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:35.463800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:35.471887 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-74fbd2d2-7114-4b17-83a8-05095a4db8a1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.193959 Oct 10 11:20:35.472474 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3126/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:35 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:35.755697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "name": "network-vif-plugged", "status": "completed", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:35.770023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:35.774575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:35.775390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:35.776352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:35.797109 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] Creating event network-vif-plugged:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h1-860687-2 Oct 10 11:20:35.804355 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-469341b6-e2d0-46da-b75b-f2d1198acede req-003dc350-41f3-4695-8998-fce79fbf39cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053958 Oct 10 11:20:35.805457 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3023/6149] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:36.496080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:36.497378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:36.505141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:36.505681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:36.506136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:36.507265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:36.507743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:36.508465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:36.675445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:36.684392 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0a5802f1-58fb-423c-830c-89618119d27a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1391 microversion: 2.1 time: 0.192177 Oct 10 11:20:36.691050 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3127/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:36 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:37.707314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:37.713769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:37.714551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:37.721974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:37.722464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:37.722902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:37.723911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:37.724373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:37.724801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:37.866517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:37.875623 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff99a525-bd19-4839-864b-b7796f490d50 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1563 microversion: 2.1 time: 0.169411 Oct 10 11:20:37.887417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3024/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:37 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:37.899632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:37.900241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:37.901946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=8 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:37.908142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:37.908651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:37.909112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:37.910016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:37.910346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:37.910741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:38.049339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:38.057769 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4b9b8b1-0c28-47a5-8934-0e8c246bbe0c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1563 microversion: 2.1 time: 0.162741 Oct 10 11:20:38.058473 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3128/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:37 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:39.946396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:39.947028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:39.953480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:39.956448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:39.957150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:39.957786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:39.958498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:39.959146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:39.959945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:39.979402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:39.992031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:40.001957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:40.002810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:40.037891 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] Creating event network-changed:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h1-860687-2 Oct 10 11:20:40.050718 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-94648460-c65c-493a-b40e-32677adb12d0 req-d23b2fb0-0b90-403d-89e7-1b02347f1571 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076663 Oct 10 11:20:40.054383 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3129/6153] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:40.163510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:40.176193 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3445a63c-8664-4037-877e-4576b12c3000 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1563 microversion: 2.1 time: 0.233016 Oct 10 11:20:40.177104 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3025/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:39 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:43.938319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:43.938912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:43.946643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:43.947184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:43.947669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:43.948379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:43.948844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:43.949284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:43.974731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:20:44.088669 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a17eafc-15ef-4fb4-a6d6-1cf63eb4d02b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 204 len: 0 microversion: 2.1 time: 0.154285 Oct 10 11:20:44.090908 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3130/6155] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:20:43 2022] DELETE /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:20:44.099972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:44.100721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:44.108820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:44.109429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:44.110101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:44.110893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:44.111456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:44.111999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:44.274977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:44.285352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f9fd851-7584-4cce-959c-4009d73823bd tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1578 microversion: 2.1 time: 0.190187 Oct 10 11:20:44.286177 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3026/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:44 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:45.310771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:45.311413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:45.318275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:45.318779 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:45.319253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:45.319986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:45.320450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:45.321503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:45.469294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:45.477548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aeaa9bf2-5e72-4b33-9054-ad6ac19b579e tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1578 microversion: 2.1 time: 0.171281 Oct 10 11:20:45.478143 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3131/6157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:45 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:46.480781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf6fe0d-fbc3-4f3e-9bfd-02257698551d", "name": "network-vif-deleted", "tag": "9aa37b65-91e4-48db-8b56-e3a202d4b806"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:46.492316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:46.493600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:46.495680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:46.503427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:46.504073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:46.513693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:46.514479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:46.515142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:46.516057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:46.516731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:46.517340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:46.517474 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] Creating event network-vif-deleted:9aa37b65-91e4-48db-8b56-e3a202d4b806 for instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d on n-h2-860687-2 Oct 10 11:20:46.528137 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-660f0565-e908-4ee9-b9e2-d0bdec8b60e9 req-b58df122-721a-46a6-a0e7-08e4a0251abb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051158 Oct 10 11:20:46.528766 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3027/6158] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:46.680446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:46.690796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7d04e785-0de6-4dd2-859f-43f455b65797 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1225 microversion: 2.1 time: 0.193598 Oct 10 11:20:46.693237 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3132/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:46 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:47.716891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:47.717612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:47.726250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:47.726791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:47.728010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:47.728688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:47.729222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:47.729567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:47.830926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:47.842394 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af9e8347-4a28-41f5-b896-0d3fe90eef3d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1225 microversion: 2.1 time: 0.130828 Oct 10 11:20:47.848495 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3028/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:47 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:48.874850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:48.875498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:48.882674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:48.884030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:48.884611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:48.885112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:48.885585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:48.886158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:48.957755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:48.967368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f942fcc6-3c5f-4942-aff3-611af28cdf0b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1225 microversion: 2.1 time: 0.096872 Oct 10 11:20:48.968222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3133/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:48 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:49.990452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:49.991813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:50.001238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:50.002060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:50.003217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:50.004170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:50.004833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:50.005816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:50.103416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:50.114202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b26cf6c-8533-4840-8dc1-2bbeeec10ec5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1225 microversion: 2.1 time: 0.128193 Oct 10 11:20:50.115945 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3029/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:49 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:51.138301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:51.138923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:51.146360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:51.147189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:51.147827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:51.148791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:51.150024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:51.150644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:51.632619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:51.647942 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bef11cc3-122e-4193-b96c-84c20600cda2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 200 len: 1225 microversion: 2.1 time: 0.513449 Oct 10 11:20:51.648996 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3134/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:51 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 1225 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:52.677026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:52.682701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:52.692007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:52.692896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:52.694329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:52.695936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:52.697007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:52.697810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:52.715974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d HTTP/1.1 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'baf6fe0d-fbc3-4f3e-9bfd-02257698551d'} Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:20:52.718248 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:20:52.723546 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:20:52.725344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:20:52.726230 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05685e14-1f25-4ec7-8871-629dae90379d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 404 len: 111 microversion: 2.1 time: 0.054836 Oct 10 11:20:52.727993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3030/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:52 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:20:52.904156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-581618362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-775495568", "security_groups": [{"name": "tempest-secgroup-smoke-1217491596"}], "block_device_mapping_v2": [{"uuid": "7eb1a8e9-8f6f-4f30-ba6a-e18de7d703f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:53.042727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:20:53.661405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:20:53.661944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:20:53.662537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:20:53.663131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:20:53.663667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:20:53.674371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:53.675410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:53.675879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:53.677098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:53.677776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:53.678465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:53.707146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:20:53.714506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:20:53.810670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:20:53.812912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7eb1a8e9-8f6f-4f30-ba6a-e18de7d703f8',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:20:54.031445 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5c45d96-9649-4b76-a9a0-176144ef34c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.132371 Oct 10 11:20:54.033741 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3135/6165] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:20:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:20:54.044411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c46ac11e-2316-454b-9aaf-7e255c502777 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:54.045880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c46ac11e-2316-454b-9aaf-7e255c502777 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:54.130978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c46ac11e-2316-454b-9aaf-7e255c502777 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:54.147951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c46ac11e-2316-454b-9aaf-7e255c502777 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1093 microversion: 2.1 time: 0.107938 Oct 10 11:20:54.149158 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3031/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:54 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:55.174283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:55.174924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:55.181563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.182309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.182933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.183849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.184477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.185138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.210219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:55.303443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:55.312776 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-216400a6-e625-4980-93af-df1dffbada65 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1191 microversion: 2.1 time: 0.145149 Oct 10 11:20:55.313680 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3136/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:55 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:55.501379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:55.504583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:55.511999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.512490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.512922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.513862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.514646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.515130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.518064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=59 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:20:55.546657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:20:55.694497 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48f45742-255a-4321-8d39-89f0f8a022d4 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 204 len: 0 microversion: 2.1 time: 0.522740 Oct 10 11:20:55.695302 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3032/6168] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:20:55 2022] DELETE /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:20:55.704905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:55.706581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:55.717283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.717809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.718269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.719075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:55.719553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:55.724463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:55.906625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:55.916569 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4daff5f-23ef-4d2a-9de5-ebc4ed83afdb tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1731 microversion: 2.1 time: 0.216063 Oct 10 11:20:55.917169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3137/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:55 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:56.341126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:56.341836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:56.373386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:56.373900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:56.382242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:56.383591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:56.384072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:56.384508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:56.541995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:56.551751 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-525642ea-b141-44f1-8f18-d5440893bc08 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1209 microversion: 2.1 time: 0.215426 Oct 10 11:20:56.554319 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3033/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:56 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1209 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:56.941753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:56.942381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:56.951168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:56.952358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:56.952989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:56.953922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:56.954574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:56.955483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:57.144390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:57.157296 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c083aa5c-ba4e-4c08-80fe-2b0acfb468be tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1731 microversion: 2.1 time: 0.219294 Oct 10 11:20:57.158553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3138/6171] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:56 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:57.583872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:57.589860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:57.621217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:57.627170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:57.628564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:57.631633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:57.636971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:57.641330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:57.892372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:57.918245 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee0b2588-88f0-4c7a-a153-2cf975c3204f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1209 microversion: 2.1 time: 0.342818 Oct 10 11:20:57.920215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3034/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:57 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1209 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:58.183156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:58.183789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:58.203313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:58.210009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:58.215169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:58.218504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:58.219130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:58.219672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:58.727111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:58.738528 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be699211-8cbe-4062-b943-800aba263e46 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1731 microversion: 2.1 time: 0.560452 Oct 10 11:20:58.742035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3139/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:58 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1731 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:58.957352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:58.958625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:58.978952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:58.980343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:58.982130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:58.984419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:58.985607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:58.986980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:59.265400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cf562b-c500-48e3-888b-53a4854fb676", "name": "network-vif-deleted", "tag": "bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:20:59.299993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:59.303204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:59.310580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:59.355945 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] Creating event network-vif-deleted:bcfc0ee4-cfa9-4ef2-80e5-71f5eee33ee7 for instance d8cf562b-c500-48e3-888b-53a4854fb676 on n-h2-860687-2 Oct 10 11:20:59.368559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9f470564-e1da-4cce-a269-243ecc028987 req-34a4bb80-5922-44d4-a4aa-e1b3ed377161 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108167 Oct 10 11:20:59.370672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3140/6174] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:20:59.627123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:20:59.647142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93ca0ac3-6b24-47da-a6c8-7330ce6ab7f5 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1277 microversion: 2.1 time: 0.683540 Oct 10 11:20:59.649063 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3035/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:58 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1277 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:20:59.766882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:20:59.767658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:20:59.784943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:59.788576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:59.793457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:59.796492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:59.797231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:59.797892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:59.933296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:20:59.934218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:20:59.935939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:20:59.937669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lazy-loading 'fault' on Instance uuid d8cf562b-c500-48e3-888b-53a4854fb676 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:21:00.138167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0d502eb15e4edf8ff82b32307f5c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5b3774dae74613a69cb5036316a57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:00.149542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46dbae32-620a-4df7-b8ff-a4f8514f577c tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 200 len: 1388 microversion: 2.1 time: 0.386430 Oct 10 11:21:00.150775 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3141/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:20:59 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 1388 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:00.676516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:00.677140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:00.693556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:00.694793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:00.695723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:00.698832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:00.699661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:00.700351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:00.999506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:01.012097 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b91e43f4-1c85-4b7d-bccd-e395f32d3a2c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1277 microversion: 2.1 time: 0.339667 Oct 10 11:21:01.013291 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3036/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:00 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1277 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:01.173629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:01.175343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:01.202664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:01.213497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:01.216984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:01.221875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:01.222505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:01.229039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:01.270542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] HTTP exception thrown: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Request method failure captured: Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 HTTP/1.1 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_7LT2VDphIWqHpo7VpkqKHIt3mlu27ezyYw11RFAvZ5xB9YAwMyY2G8y9RISQhDJA1RQ7PphbeANiT_Nx451cLQk6Ue9sXaDHlpwh_jdLWyVzqxCoQRGTUs31MvIXCKyHDPlMr582SG3zKKIWm16e_thki80gQmi7EnRrdyinorWfQ Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f5b3774dae74613a69cb5036316a57c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f5b3774dae74613a69cb5036316a57c"}]}] Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestServerBasicOps-552988639 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3b0d502eb15e4edf8ff82b32307f5c0f Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd8cf562b-c500-48e3-888b-53a4854fb676'} Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:01.274039 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Returning 404 to user: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:21:01.278798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-05f481ff-7ba1-4168-b60c-1dca9f3c78e8 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 404 len: 111 microversion: 2.1 time: 0.108867 Oct 10 11:21:01.288535 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3142/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:01 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:21:01.443563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97800d5-df8e-4c73-9eb5-fccee050936c", "tag": "b6775852-79a5-4af6-8125-2096cbc00d07"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:01.444701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:01.448285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:01.462463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:01.464397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:01.465043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:01.469285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:01.470060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:01.471531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:01.472474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:01.477850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:01.478623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:01.491042 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] Creating event network-changed:b6775852-79a5-4af6-8125-2096cbc00d07 for instance b97800d5-df8e-4c73-9eb5-fccee050936c on n-h1-860687-2 Oct 10 11:21:01.509095 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c5e9b3ba-4ca2-4c9c-bbf2-200acc3d869f req-95fce076-886a-4bf3-b33f-4c771827c321 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069074 Oct 10 11:21:01.510557 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3037/6179] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:01.605122 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b241b203-f09c-4481-90bd-80fe474de924 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action" status: 200 len: 24562 microversion: 2.1 time: 0.163739 Oct 10 11:21:01.608931 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3143/6180] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:21:01 2022] POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action => generated 24562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:21:02.035762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:02.037269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:02.046080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:02.047216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:02.047846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:02.048754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:02.049376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:02.049971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:02.297063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:02.311137 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35bb22d4-67ba-4fe6-9ab4-f3ed3f66472d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1277 microversion: 2.1 time: 0.279625 Oct 10 11:21:02.320556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3038/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:02 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:02.967148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:02.968361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:02.978935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:02.988128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:02.988840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:02.989315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:02.990264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:02.990964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:02.992748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:03.014899 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] HTTP exception thrown: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Request method failure captured: Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 HTTP/1.1 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_7LT2VDphIWqHpo7VpkqKHIt3mlu27ezyYw11RFAvZ5xB9YAwMyY2G8y9RISQhDJA1RQ7PphbeANiT_Nx451cLQk6Ue9sXaDHlpwh_jdLWyVzqxCoQRGTUs31MvIXCKyHDPlMr582SG3zKKIWm16e_thki80gQmi7EnRrdyinorWfQ Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f5b3774dae74613a69cb5036316a57c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f5b3774dae74613a69cb5036316a57c"}]}] Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 3b0d502eb15e4edf8ff82b32307f5c0f Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'd8cf562b-c500-48e3-888b-53a4854fb676'} Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:21:03.016883 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Returning 404 to user: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-778f25f4-c130-4ed7-83fc-564495c843af tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 404 len: 111 microversion: 2.1 time: 0.056386 Oct 10 11:21:03.022245 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3144/6182] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:21:02 2022] DELETE /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:21:03.029189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:03.029857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] [instance: d8cf562b-c500-48e3-888b-53a4854fb676] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:03.036320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:03.036951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:03.037250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:03.037965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:03.038434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:03.038882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:03.059567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] HTTP exception thrown: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Request method failure captured: Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 HTTP/1.1 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_7LT2VDphIWqHpo7VpkqKHIt3mlu27ezyYw11RFAvZ5xB9YAwMyY2G8y9RISQhDJA1RQ7PphbeANiT_Nx451cLQk6Ue9sXaDHlpwh_jdLWyVzqxCoQRGTUs31MvIXCKyHDPlMr582SG3zKKIWm16e_thki80gQmi7EnRrdyinorWfQ Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6f5b3774dae74613a69cb5036316a57c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6f5b3774dae74613a69cb5036316a57c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6f5b3774dae74613a69cb5036316a57c"}]}] Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 6f5b3774dae74613a69cb5036316a57c Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestServerBasicOps-552988639 Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 3b0d502eb15e4edf8ff82b32307f5c0f Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestServerBasicOps-552988639-project Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd8cf562b-c500-48e3-888b-53a4854fb676'} Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:03.061409 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Returning 404 to user: Instance d8cf562b-c500-48e3-888b-53a4854fb676 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d51351e2-a590-40b0-9c94-656817b557f3 tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676" status: 404 len: 111 microversion: 2.1 time: 0.039647 Oct 10 11:21:03.068154 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3039/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:03 2022] GET /compute/v2.1/servers/d8cf562b-c500-48e3-888b-53a4854fb676 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:21:03.264908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99e61405-b18a-4a7d-a7d9-e556d4df644e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] Calling method '.version_select at 0x7f6777500700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:03.301969 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-99e61405-b18a-4a7d-a7d9-e556d4df644e tempest-TestServerBasicOps-552988639 tempest-TestServerBasicOps-552988639-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-331791270" status: 202 len: 0 microversion: 2.1 time: 0.040469 Oct 10 11:21:03.302641 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3145/6184] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 11:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-331791270 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:21:03.347597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:03.348554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:03.356057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:03.356556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:03.357003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:03.357953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:03.358419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:03.358983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:03.522438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:03.530761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d85d3a2-5297-4745-ba97-f043da16a1a8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1277 microversion: 2.1 time: 0.187111 Oct 10 11:21:03.543808 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3040/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:03 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:04.566621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:04.567434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:04.573627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:04.574663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:04.587965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:04.588576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:04.589277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:04.590188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:04.591034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:04.592777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:04.769192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:04.780023 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da66c15d-0a23-4616-87f5-71b127777d49 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.217945 Oct 10 11:21:04.783171 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3146/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:04 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:05.805862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:05.807640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:05.810910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:05.821800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:05.822310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:05.823338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:05.824382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:05.825041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:05.825657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:06.569646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:06.595035 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8576cd04-3e65-456d-8014-aa394754b64c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.795505 Oct 10 11:21:06.596201 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3041/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:05 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:07.619827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:07.621744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:07.632195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:07.633265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:07.634151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:07.635598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:07.637685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:07.638590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:07.848863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:07.859357 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6cddbf9-0311-42ae-85e9-e989cff3e5ac tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.245329 Oct 10 11:21:07.860995 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3147/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:07 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:08.883497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:08.884111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:08.891043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:08.891519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:08.892068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:08.893172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:08.893633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:08.894059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:09.040868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:09.049367 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0724fae-e074-4a28-a31b-a675d9dd3ab1 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.170176 Oct 10 11:21:09.050204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3042/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:08 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:10.074977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:10.075887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:10.084146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:10.084646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:10.085097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:10.085882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:10.087097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:10.087881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:10.241888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:10.250252 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-07e94832-d948-4192-a567-e07301e4aeaa tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.181070 Oct 10 11:21:10.250842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3148/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:10 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:11.273212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:11.274457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:11.277391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:11.284975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:11.285757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:11.286197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:11.286914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:11.287397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:11.287957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:11.484464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:11.493629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9ab7616-75b0-40ca-a461-bd851920ea80 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.224498 Oct 10 11:21:11.494504 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3043/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:11 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:12.516739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:12.518075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:12.525996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:12.526505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:12.526971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:12.527701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:12.528171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:12.528615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:12.691892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:12.706506 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22310c57-a38f-493c-a9f3-97f93dc96533 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.194540 Oct 10 11:21:12.707919 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3149/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:12 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:12.721875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:12.723043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:12.732474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:12.733177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:12.733890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:12.734779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:12.735429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:12.736864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:12.903344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:12.911821 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c485db53-1918-410e-92b4-6f1c704789a2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1681 microversion: 2.1 time: 0.194123 Oct 10 11:21:12.923717 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3044/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:12 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:13.035917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:13.038922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:13.045317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.045824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.046291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.047061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.047540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.048049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.102654 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2fae7d28-bd38-4b0f-8988-c555af0f2297 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action" status: 200 len: 32634 microversion: 2.1 time: 0.070412 Oct 10 11:21:13.103380 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3150/6194] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:21:13 2022] POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:21:13.280046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:13.280681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:13.287741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.288235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.288687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.289510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.290082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.290680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.519093 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f96d1045-af45-4463-b10b-5437a8d89a5a tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1832 microversion: 2.1 time: 0.242856 Oct 10 11:21:13.520225 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3045/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:13 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1832 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:13.555877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:13.559113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:13.566783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.567734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.568010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.568912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.569546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.570190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.600289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lazy-loading 'flavor' on Instance uuid 9992b4aa-e945-4304-a23c-c0f44bfacecb {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:21:13.614544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Going to try to live migrate instance to another host {{(pid=128800) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 11:21:13.735913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:13.735913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:13.751732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.752664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.753344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:13.754652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:13.755367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:13.756043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:14.008792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:14.017573 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22333a1c-0c71-4472-91b9-a95145aa5c88 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.291533 Oct 10 11:21:14.019045 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3046/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:13 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:14.036477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97800d5-df8e-4c73-9eb5-fccee050936c", "name": "network-vif-plugged", "status": "completed", "tag": "b6775852-79a5-4af6-8125-2096cbc00d07"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:14.049135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:14.050143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:14.050841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:14.068727 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] Creating event network-vif-plugged:b6775852-79a5-4af6-8125-2096cbc00d07 for instance b97800d5-df8e-4c73-9eb5-fccee050936c on n-h1-860687-2 Oct 10 11:21:14.076135 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-12b3c1ac-6c69-4896-9926-3f7fe8a2fb54 req-bf5e8d47-7d89-4a31-9a5f-75acf056b3e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046793 Oct 10 11:21:14.077164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3047/6197] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:21:15.052019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:15.054358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:15.065565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:15.066575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:15.067400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:15.068904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:15.069840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:15.071250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:15.406712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:15.434541 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec6c6071-bfac-4852-bbda-bd1467b02ca6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1265 microversion: 2.1 time: 0.393368 Oct 10 11:21:15.436634 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3048/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:15 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1265 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:15.817760 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f64f0d33-776d-48ac-b297-2f3a930c198e tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action" status: 202 len: 0 microversion: 2.1 time: 2.266549 Oct 10 11:21:15.826595 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3151/6199] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:21:13 2022] POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action => generated 0 bytes in 2276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:21:15.829341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:15.829970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:15.840172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:15.840944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:15.841596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:15.842519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:15.843351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:15.844014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:15.858291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:16.165255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:16.192175 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ce3f756-d42d-4eb5-93c7-09385e526feb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.367000 Oct 10 11:21:16.195096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3049/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:15 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:16.813165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:16.813866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:16.828212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:16.831957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:16.832645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:16.835198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:16.836052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:16.836712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:17.140364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:17.152750 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-170e24e7-813e-4456-9a44-01d9e96676a6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1452 microversion: 2.1 time: 0.694033 Oct 10 11:21:17.172621 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3152/6201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:16 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1452 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:17.178899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:17.179913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:17.187590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:17.188876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:17.189323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:17.197421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:17.198424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:17.199085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:17.221628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:17.222557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:17.235554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:17.236402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:17.237350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:17.238287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:17.242059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:17.242763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:17.988098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:17.997277 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27522ef2-4bfa-4f53-a403-8b351f63088f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1452 microversion: 2.1 time: 0.822515 Oct 10 11:21:18.021005 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3050/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:17 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1452 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:18.037816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "name": "network-vif-unplugged", "status": "completed", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:18.066545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:18.067064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:18.077155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:18.097233 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] Creating event network-vif-unplugged:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h1-860687-2 Oct 10 11:21:18.106498 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ad4ea524-bb9c-49e1-ae60-f88e837b5547 req-88665a0b-042e-4151-9164-1b2ab18f712d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081304 Oct 10 11:21:18.108420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:18.109029 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3051/6203] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:18.124029 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f7045620-89cf-4e51-82f9-f6596874a6a4 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.907174 Oct 10 11:21:18.124620 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3153/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:17 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:21:19.160108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:19.165541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:19.172297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:19.173227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:19.173904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:19.175079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:19.175768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:19.176455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:19.404298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:19.415377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35d9f9b3-34c3-4c17-8b06-04c1923e82fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.268755 Oct 10 11:21:19.421724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3052/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:19 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:20.446780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:20.448381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:20.453767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:20.466989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:20.469369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:20.470010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:20.471052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:20.471780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:20.472877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:20.479975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:20.480729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:20.481382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:20.497326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:20.503327 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] Creating event network-changed:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h1-860687-2 Oct 10 11:21:20.510700 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f4b2a532-80f9-4482-9340-1817aa94f484 req-f77f352f-0d8d-4da3-b7d2-233234e90232 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065253 Oct 10 11:21:20.511598 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3053/6206] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:20.841084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:20.854684 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a4305d8-df88-4c4d-9850-260152ef3656 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.412818 Oct 10 11:21:20.860464 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3154/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:20 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:21.885725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:21.886499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:21.905124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:21.906879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:21.907536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:21.908286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:21.908759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:21.911604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:22.217826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:22.243255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-653d1d4f-3062-4d3b-a2b9-d5eec9f8e33a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.362392 Oct 10 11:21:22.253164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3054/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:21 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:22.619214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97800d5-df8e-4c73-9eb5-fccee050936c", "tag": "b6775852-79a5-4af6-8125-2096cbc00d07"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:22.640669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:22.641824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:22.642373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:22.707825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] Creating event network-changed:b6775852-79a5-4af6-8125-2096cbc00d07 for instance b97800d5-df8e-4c73-9eb5-fccee050936c on n-h1-860687-2 Oct 10 11:21:22.751675 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5af36825-878f-4f3c-a37e-e56475b8557e req-c40848f5-fe84-4f9a-b7d3-e41ece09dc38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117323 Oct 10 11:21:22.756092 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3155/6209] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:23.281417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:23.283116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:23.303133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:23.306093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:23.308299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:23.310238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:23.312878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:23.318418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:23.767409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:23.777285 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa044ab3-ec16-47b5-8ede-e8cf377468cf tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.505938 Oct 10 11:21:23.781026 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3055/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:23 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:24.809074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:24.810578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:24.823740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:24.824416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:24.824697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:24.832512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:24.833580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:24.834645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:25.130393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:25.158381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ad77e78-96d6-494b-b4a2-7ebaf1fd26e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1691 microversion: 2.1 time: 0.355243 Oct 10 11:21:25.160577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3156/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:24 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1691 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:26.186335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:26.187753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:26.200932 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:26.207791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:26.208724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:26.210008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:26.211503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:26.215241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:27.208811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:27.226558 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-866843ca-df3f-41ef-9e99-16196d441659 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1681 microversion: 2.1 time: 1.045307 Oct 10 11:21:27.229329 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3056/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:26 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1681 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:27.254495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:27.256253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:27.265851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:27.266788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:27.267514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:27.268491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:27.269143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:27.269781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:27.545159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aeceb961-361c-4f8f-83e3-4d9c9af34d28 tempest-TestNetworkAdvancedServerOps-1728857376 tempest-TestNetworkAdvancedServerOps-1728857376-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1832 microversion: 2.1 time: 0.295642 Oct 10 11:21:27.547284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3157/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:27 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1832 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:27.573858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:27.574875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:27.582842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:27.583616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:27.584671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:27.585753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:27.586445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:27.587202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:27.869703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:27.890865 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbb2ed94-a68c-4ba8-9139-de65d03556ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1681 microversion: 2.1 time: 0.321563 Oct 10 11:21:27.903512 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3057/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:27 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:28.603771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:28.605526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:28.606034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:28.606493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:28.608028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:28.608520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:28.608962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:28.650212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8b688fa-14d9-4479-99e1-8ad326bf5459 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.199366 Oct 10 11:21:28.651169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3158/6215] 10.222.0.16 () {58 vars in 1185 bytes} [Mon Oct 10 11:21:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:28.778718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-116273656", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "availability_zone": "nova:n-h2-860687-2", "networks": [{"uuid": "7895c65a-87a6-42c0-8ce5-6f212df8ec25"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:28.846860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] validate_networks() for [('7895c65a-87a6-42c0-8ce5-6f212df8ec25', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:21:29.292118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:21:29.292555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:21:29.293040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:21:29.293459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:21:29.293883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:21:29.304698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:29.305191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:29.305642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:29.306374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:29.306837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:29.308076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:29.330194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Getting quotas for project 99b40bce1ab446868c089b7c334e8a59. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:21:29.336829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Getting quotas for user 38b69184fe8b4e6fb6540abf5b9dd58d and project 99b40bce1ab446868c089b7c334e8a59. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:21:29.350551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:21:29.353550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:21:29.419730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a72a451c-f23d-4b48-a6ac-033455645f06 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643959 Oct 10 11:21:29.419961 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3058/6216] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:21:29.430985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-64c59943-2b12-4d09-80ee-f1d104b717b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:29.432068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-64c59943-2b12-4d09-80ee-f1d104b717b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:29.517115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-64c59943-2b12-4d09-80ee-f1d104b717b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1328 microversion: 2.1 time: 0.090101 Oct 10 11:21:29.517901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3159/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:29 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:30.022509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:30.026224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:30.036580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:30.037256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:30.037933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:30.039281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:30.040260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:30.040965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:30.096335 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03e7fe48-9628-4e21-84c0-83b25b97a3fb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action" status: 200 len: 38638 microversion: 2.1 time: 0.077585 Oct 10 11:21:30.105348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3059/6218] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:21:30 2022] POST /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb/action => generated 38638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 11:21:30.546626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:30.547891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:30.559710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:30.560362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:30.560821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:30.561662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:30.562139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:30.562577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:30.636969 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ea5e02f0-fc2d-4915-a27d-eada4028e78a tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1415 microversion: 2.1 time: 0.099521 Oct 10 11:21:30.637583 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3160/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:30 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1415 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:31.662508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:31.664395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:31.671941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:31.672433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:31.672873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:31.673791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:31.674246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:31.674671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:31.769219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:31.769733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:31.779254 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c24c0020-50fe-42ae-af14-edbdcab31cf7 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1421 microversion: 2.1 time: 0.121558 Oct 10 11:21:31.785490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:31.786345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3060/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:31 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:31.791977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:31.792730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:31.793366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:31.794260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:31.794884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:31.795501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:31.822025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:31.822803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:31.823427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:31.838218 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] Creating event network-changed:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h2-860687-2 Oct 10 11:21:31.841718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:21:31.845400 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d5e1b4f9-0525-4dbc-9989-d63ebdd00f3f req-7ac006e3-9e79-4e1a-a1fb-d139e3a069af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057582 Oct 10 11:21:31.846175 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3061/6221] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:31.978960 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0efc6521-c942-433c-b927-4b44a71cd8dd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 204 len: 0 microversion: 2.1 time: 0.213190 Oct 10 11:21:31.980193 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3161/6222] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:21:31 2022] DELETE /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 11:21:31.990476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:31.991263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:32.004497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:32.005003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:32.005445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:32.009918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:32.010850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:32.019839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:32.631143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:32.651997 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09223064-7ea6-4b96-9cae-f0f628ffdbf8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1687 microversion: 2.1 time: 0.666964 Oct 10 11:21:32.655657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3062/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:31 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1687 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:32.812577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:32.813582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:32.820332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:32.820848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:32.821310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:32.822041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:32.822513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:32.822963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:33.085930 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1d75071-392b-4029-9b28-bf4ced00b686 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.277300 Oct 10 11:21:33.100715 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3162/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:32 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:33.684715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:33.688027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:33.706522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:33.707445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:33.708352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:33.710105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:33.711842 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:33.712794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:33.833781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:33.845494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80ebfc21-bd2b-41c7-8380-7225a2ac28ce tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 200 len: 1350 microversion: 2.1 time: 0.167824 Oct 10 11:21:33.846819 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3063/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:33 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 1350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:33.882049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9992b4aa-e945-4304-a23c-c0f44bfacecb", "name": "network-vif-deleted", "tag": "5f59ead9-c44b-46a1-a595-c9b46ed219d4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:33.900601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:33.904457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:33.905187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:33.905843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:33.922868 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] Creating event network-vif-deleted:5f59ead9-c44b-46a1-a595-c9b46ed219d4 for instance 9992b4aa-e945-4304-a23c-c0f44bfacecb on n-h2-860687-2 Oct 10 11:21:33.932085 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c7029e4a-ffb7-4db4-95cd-216ef77f560c req-777cf8e0-50d7-457d-a9e9-2328109506e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055689 Oct 10 11:21:33.933963 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3163/6226] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:34.113167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:34.113813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:34.124879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:34.125408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:34.125892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:34.126601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:34.127083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:34.127530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:34.380942 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2107322b-f39a-48f6-80c7-077ac6c85b3f tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.268114 Oct 10 11:21:34.382807 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3064/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:34 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:34.873793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:34.874612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: 9992b4aa-e945-4304-a23c-c0f44bfacecb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:34.881921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:34.883265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:34.883861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:34.884441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:34.884914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:34.885371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:34.901686 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] HTTP exception thrown: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Request method failure captured: Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb HTTP/1.1 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_7BjWrQtnk0VmWOwDWpSOEGZYin8R-sdrxgCrPN2aOTZ_i6XNa1S_JyARJZNFDlvM1DztiCMiSKU3VQIIpSkOzI7sYaqVIqTmdQGkQ82s6jJUqdISKf4fdhEOtmR2m__AyWTZaKEl5cTdbEhTU5RPIZQk2RWrm-VoglyEKYGhKnk4o Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54da2131a9b342e1a6f07e885362d9cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54da2131a9b342e1a6f07e885362d9cc"}]}] Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 41d437cade74442790b99ce41ef0fd87 Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '9992b4aa-e945-4304-a23c-c0f44bfacecb'} Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:34.903574 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Returning 404 to user: Instance 9992b4aa-e945-4304-a23c-c0f44bfacecb could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-64f87c11-4ffc-4264-900d-2257f69b7827 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb" status: 404 len: 111 microversion: 2.1 time: 0.036560 Oct 10 11:21:34.909028 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3164/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:34 2022] GET /compute/v2.1/servers/9992b4aa-e945-4304-a23c-c0f44bfacecb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:21:35.406099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:35.407962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:35.416559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:35.417046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:35.417481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:35.418191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:35.418776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:35.419639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:35.656643 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48f8f2bd-f6a9-4199-a5af-098617cd7d43 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.255164 Oct 10 11:21:35.657778 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3065/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:35 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:35.953770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0ab072-ea19-4ae1-b10c-892235b2c108", "tag": "2e3f6826-ee3c-4342-bed5-d2e350e2cf8e"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:35.966716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:35.967327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:35.967929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:35.979375 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] Creating event network-changed:2e3f6826-ee3c-4342-bed5-d2e350e2cf8e for instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 on n-h2-860687-2 Oct 10 11:21:35.984730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6cc9d1dc-3640-4049-9c7d-3eca1439a8e6 req-6cff1de9-342c-408d-836f-bb3ff35f44f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034416 Oct 10 11:21:35.985577 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3165/6230] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:36.681716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:36.682956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:36.702342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:36.702864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:36.704154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:36.704901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:36.706482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:36.711686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:36.953503 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be5dff42-da83-48bc-b05a-7704b57ca035 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.275723 Oct 10 11:21:36.955856 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3066/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:36 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:37.979911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:37.981271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:37.988431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:37.989232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:37.989883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:37.990798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:37.992093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:37.992875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:38.290927 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fa73d116-afb3-4d52-b2bd-ad88a05523ac tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.316348 Oct 10 11:21:38.297160 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3166/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:37 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:39.047971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a23ec7a-9d9c-47a4-83ce-aa0e4515153c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '.version_select at 0x7f677cffb670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:39.081415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a23ec7a-9d9c-47a4-83ce-aa0e4515153c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-615520955" status: 202 len: 0 microversion: 2.1 time: 0.038913 Oct 10 11:21:39.082315 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3067/6233] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 11:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-615520955 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:21:39.113014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-01a8bc60-ed6e-4e07-a5b9-c0905a1ffa51 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: .version_select at 0x7f6777995ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1230291677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkSLtVzOWcowQB2EKpNdHyPEKO5R+NhVPHgb2/3Ku56wpmtBtw/8Zei/cMrJX93z0AAeT2rxt1vOXGneIemQ+YtvUHUNz1tpq5stiLVN1X6abYC8FOtGCTxcMPbW2pJLQ=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:39.123672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:39.136483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-01a8bc60-ed6e-4e07-a5b9-c0905a1ffa51 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:21:39.153341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-01a8bc60-ed6e-4e07-a5b9-c0905a1ffa51 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:21:39.185280 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-01a8bc60-ed6e-4e07-a5b9-c0905a1ffa51 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.076257 Oct 10 11:21:39.186090 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3167/6234] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:21:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:39.321942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:39.332354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:39.333366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:39.334269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0ab072-ea19-4ae1-b10c-892235b2c108", "name": "network-vif-plugged", "status": "completed", "tag": "2e3f6826-ee3c-4342-bed5-d2e350e2cf8e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:39.351638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:39.355215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:39.355918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:39.356847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:39.360948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:39.361438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:39.372279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:39.377217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:39.383884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:39.384503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:39.415673 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] Creating event network-vif-plugged:2e3f6826-ee3c-4342-bed5-d2e350e2cf8e for instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 on n-h2-860687-2 Oct 10 11:21:39.423604 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-109b4945-91d7-4784-8c4a-edb47e9d7def req-14bf0c0c-9f74-4a93-b10b-1c69121bb6af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104643 Oct 10 11:21:39.424236 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3068/6235] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:21:39.649392 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2931a784-36fb-4926-8a9b-baa87bf9942d tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1463 microversion: 2.1 time: 0.329436 Oct 10 11:21:39.650209 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3168/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:39 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1463 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:40.674873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:40.677108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:40.687514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:40.688202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:40.688896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:40.689831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:40.690443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:40.691204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:40.892796 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5be1e49-c956-4318-9335-39b0fd48e143 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1647 microversion: 2.1 time: 0.222182 Oct 10 11:21:40.895357 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3069/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:40 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1647 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:40.917918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:40.919278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:40.927203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:40.927762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:40.928962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:40.929698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:40.930291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:40.930975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:41.067103 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7bdcee7b-dcd0-4969-a38f-f71f1e28cf54 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1647 microversion: 2.1 time: 0.153409 Oct 10 11:21:41.067797 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3169/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:40 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1647 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:41.091773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:41.092518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:41.099860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:41.100871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:41.102059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:41.103392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:41.104177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:41.104882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:41.122174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:41.267393 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c78a692b-f1ee-4a7a-b340-52687243a2c5 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1647 microversion: 2.1 time: 0.179274 Oct 10 11:21:41.271042 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3070/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:41 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1647 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:41.338829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-628909400", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "availability_zone": "nova:n-h1-860687-2", "networks": [{"uuid": "7895c65a-87a6-42c0-8ce5-6f212df8ec25"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:41.419587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] validate_networks() for [('7895c65a-87a6-42c0-8ce5-6f212df8ec25', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:21:41.849225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:21:41.849809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:21:41.850372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:21:41.851475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:21:41.852168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:21:41.861917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:41.862450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:41.863169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:41.863960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:41.864440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:41.864897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:41.896086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Getting quotas for project 99b40bce1ab446868c089b7c334e8a59. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:21:41.903534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Getting quotas for user 38b69184fe8b4e6fb6540abf5b9dd58d and project 99b40bce1ab446868c089b7c334e8a59. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:21:41.918399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:21:41.921636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:21:41.973554 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-716fbdbb-bbbf-4262-900d-21b360330766 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639359 Oct 10 11:21:41.974231 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3170/6240] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:21:41.986522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1e90812-bcc8-4526-b8b5-eb59af82ba6b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:41.987314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1e90812-bcc8-4526-b8b5-eb59af82ba6b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:41.990437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:42.082528 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1e90812-bcc8-4526-b8b5-eb59af82ba6b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1328 microversion: 2.1 time: 0.100272 Oct 10 11:21:42.083501 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3071/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:41 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:43.111184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:43.113183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:43.123348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:43.124154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:43.124768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:43.125768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:43.126741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:43.127594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:43.230497 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac6c1d4e-d799-4b82-a2bb-89c2fa69d57e tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1415 microversion: 2.1 time: 0.125926 Oct 10 11:21:43.238418 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3171/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:43 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1415 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:44.260918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:44.261615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:44.279532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:44.282837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:44.285379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:44.286349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:44.286844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:44.290283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:44.648113 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6693a5e8-615c-405f-883b-6db346ecc946 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.391355 Oct 10 11:21:44.650081 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3072/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:44 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:45.437744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a01e247-30ff-4de8-af48-9b3966b08014", "tag": "cc678a29-9026-42cf-9fb2-46c0d09d7d49"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:45.477787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:45.478650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:45.479157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:45.506537 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] Creating event network-changed:cc678a29-9026-42cf-9fb2-46c0d09d7d49 for instance 2a01e247-30ff-4de8-af48-9b3966b08014 on n-h1-860687-2 Oct 10 11:21:45.516140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bc8728d9-3e58-422c-ab8a-9c967d641432 req-17994a91-6c63-4d51-896c-f1c1579c5b36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086452 Oct 10 11:21:45.517779 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3172/6244] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:45.674167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:45.675499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:45.697725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:45.699171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:45.699804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:45.701927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:45.703245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:45.703977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:45.995572 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40d54b03-67bd-44fe-af0e-3d64803b9df9 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.325113 Oct 10 11:21:45.997173 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3073/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:45 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:47.029643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-626305961", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "62186090-bcb1-404e-8ae1-c76266e2d96b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1230291677", "security_groups": [{"name": "tempest-secgroup-smoke-778733182"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:47.032049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:47.032763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:47.049474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:47.052382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:47.053047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:47.054489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:47.054967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:47.055534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:47.244934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] validate_networks() for [('62186090-bcb1-404e-8ae1-c76266e2d96b', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:21:47.344832 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-52c2e821-decd-4105-931b-10a120823e58 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.323436 Oct 10 11:21:47.377132 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3173/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:47 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:47.792781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:21:47.793654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:21:47.794349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:21:47.795114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:21:47.795896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:21:47.810344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:47.811290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:47.811848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:47.813049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:47.813575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:47.814286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:47.836265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:21:47.842935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Getting quotas for user 41d437cade74442790b99ce41ef0fd87 and project 54da2131a9b342e1a6f07e885362d9cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:21:47.858616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:21:47.861194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:21:47.940516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ae329a5-6312-40ec-85ba-839412e68477 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914829 Oct 10 11:21:47.941684 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3074/6247] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:21:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:21:47.954251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a5efcc2-d8ed-4d0c-b912-b31aeb9c72c1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:47.955164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a5efcc2-d8ed-4d0c-b912-b31aeb9c72c1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:48.048543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6a5efcc2-d8ed-4d0c-b912-b31aeb9c72c1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:48.063261 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a5efcc2-d8ed-4d0c-b912-b31aeb9c72c1 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1266 microversion: 2.1 time: 0.113503 Oct 10 11:21:48.066568 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3174/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:47 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:48.384952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:48.385591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:48.420169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:48.420834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:48.422480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:48.425037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:48.425603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:48.426116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:48.627166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e483fd1-5c65-4fa9-9e87-d7ac55fb36b3 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.258010 Oct 10 11:21:48.628307 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3075/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:48 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:49.095186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:49.096499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:49.104737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:49.105254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:49.106040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:49.106787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:49.107294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:49.107747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:49.191729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:49.200906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-86c50732-41fd-4bc7-9e4a-b48b7ccc8c6a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1318 microversion: 2.1 time: 0.109824 Oct 10 11:21:49.224432 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3175/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:49 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:49.653102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:49.654389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:49.661554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:49.662365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:49.663080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:49.664287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:49.664955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:49.665840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:49.860343 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2b61fc3-7e34-48e0-bdb9-d413845a9009 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.211054 Oct 10 11:21:49.861198 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3076/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:49 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:50.237699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:50.238242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:50.247666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:50.248177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:50.248838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:50.250419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:50.254811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:50.255810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:50.515090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:50.524655 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b786622d-2b4e-496c-9ed9-ca199b3b60e2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.294901 Oct 10 11:21:50.525253 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3176/6252] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:50 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:50.884304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:50.887881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:50.896546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:50.898026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:50.899495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:50.900490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:50.901129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:50.901729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:51.109678 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0486257f-4f02-437a-91f3-2b12789dbc96 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.229601 Oct 10 11:21:51.111033 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3077/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:50 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:51.537963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:51.552080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:51.552838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:51.561604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:51.567218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:51.567926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:51.568629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:51.570160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:51.571082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:51.571717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:51.572365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:51.575614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:51.588681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:51.591279 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] Creating event network-changed:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:21:51.596609 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fc8d6d8d-e3e0-454f-83ab-7bddee4cbe6b req-9f1b8403-ec72-45ed-9d42-40797bd5a926 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066051 Oct 10 11:21:51.597718 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3177/6254] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:51.745519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:51.753932 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baaba01c-e378-44b7-b28e-a920beb5e08a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.205619 Oct 10 11:21:51.754522 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3078/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:51 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:52.032465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:52.036946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a01e247-30ff-4de8-af48-9b3966b08014", "name": "network-vif-plugged", "status": "completed", "tag": "cc678a29-9026-42cf-9fb2-46c0d09d7d49"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:52.049488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:52.050105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:52.050640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:52.063606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] Creating event network-vif-plugged:cc678a29-9026-42cf-9fb2-46c0d09d7d49 for instance 2a01e247-30ff-4de8-af48-9b3966b08014 on n-h1-860687-2 Oct 10 11:21:52.068547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-30490495-7b43-4bb0-b13c-7c598ea9e49d req-b6155502-7baa-4723-b03c-a66e2867a50d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037204 Oct 10 11:21:52.069436 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3178/6256] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:52.134081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:52.135470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:52.145202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:52.145700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:52.146281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:52.147214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:52.148642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:52.149263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:52.311346 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe5e4d15-7527-4714-bc4e-63e19ba65e81 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1463 microversion: 2.1 time: 0.180960 Oct 10 11:21:52.312194 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3079/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:52 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:52.781652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:52.782575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:52.789639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:52.790145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:52.790612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:52.791327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:52.791796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:52.792234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:52.932008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:52.940696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70979090-3de7-4df4-a192-de472ed6b7bb tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.164652 Oct 10 11:21:52.941405 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3179/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:52 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:53.339702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.340993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.348475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.348967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.349655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.350363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.350904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.351634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.480610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb3e0389-ae0b-4f4a-8234-edb385903278 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1648 microversion: 2.1 time: 0.145383 Oct 10 11:21:53.481185 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3080/6259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:53 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1648 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:53.502555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.503312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.510456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.510957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.511463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.512163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.512629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.513067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.645660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-617ca807-048d-42a5-a599-575ff7bc64a6 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1648 microversion: 2.1 time: 0.146760 Oct 10 11:21:53.646236 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3180/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:53 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1648 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:53.669388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.670114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.676045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.676526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.676962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.677644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.678101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.678522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.802904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-feacb8db-0dd1-4337-bfed-3714fafdd438 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1648 microversion: 2.1 time: 0.137108 Oct 10 11:21:53.817132 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3081/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:53 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1648 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:53.825754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.826268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.833387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.833887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.834338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.835733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.836283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.836724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.861806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:21:53.941976 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-06a75a67-74bc-4543-a9d1-9c44a572a6ef tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 204 len: 0 microversion: 2.1 time: 0.119726 Oct 10 11:21:53.944929 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3181/6262] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:21:53 2022] DELETE /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:21:53.952924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.953658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.961043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.961442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.961945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.962703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.963258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.963779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.966781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:53.967631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:53.973475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.974155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.974689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:53.976114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:53.976803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:53.977306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:54.165148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:54.173314 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a515f785-7985-430f-94f8-e3f8ba9a9073 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.211317 Oct 10 11:21:54.173890 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3182/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:53 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:21:54.175021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e0f78c3-07d9-4cf3-9112-d56dacde8960 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1654 microversion: 2.1 time: 0.225787 Oct 10 11:21:54.175688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3082/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:53 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1654 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:55.197760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:55.198377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:55.198753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:55.198887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:55.205265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:55.205424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:55.205749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:55.206161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:55.206443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:55.206621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:55.207163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:55.207367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:55.207615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:55.207838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:55.208039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:55.208284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:55.416704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:55.432548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03f3ea71-3d02-434b-955c-6cfb0b5600b3 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.238434 Oct 10 11:21:55.433602 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3183/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:55 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:55.494390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3a3cdf1-93fa-4f3e-a93a-ba2cf7509990 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 200 len: 1654 microversion: 2.1 time: 0.298074 Oct 10 11:21:55.498621 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3083/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:55 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 1654 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:21:55.789453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a01e247-30ff-4de8-af48-9b3966b08014", "name": "network-vif-deleted", "tag": "cc678a29-9026-42cf-9fb2-46c0d09d7d49"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:55.811657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:55.812165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:55.814345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:55.852216 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] Creating event network-vif-deleted:cc678a29-9026-42cf-9fb2-46c0d09d7d49 for instance 2a01e247-30ff-4de8-af48-9b3966b08014 on n-h1-860687-2 Oct 10 11:21:55.865532 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-339c2698-4b4c-4301-a9d9-d8fcd598a665 req-831a701d-c37f-40de-acb2-625755ba95cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082267 Oct 10 11:21:55.868142 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3184/6267] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:56.457190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:56.457812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:56.464517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.465004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.465520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.466261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.466724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.467187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.525316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:56.526410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 2a01e247-30ff-4de8-af48-9b3966b08014] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:56.548646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.548646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.548646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.548646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.548646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.549451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.568148 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] HTTP exception thrown: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Request method failure captured: Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 HTTP/1.1 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAA4EwbKnIg-RTVp83JpZbqQo9aM0IW8xrmixfLAIqCAKb9uVRTqJU53GO1TjzcRCb5Z23fv1nQNu455LkVkqzBFbh60FtoCUe-OPIDvwMyLo64XoUaOP7AFwrg_FKns9lcq_kTTg5Sf3EunPwJ_uOUvYTvERIeWg729a9Jm4A6y2ys Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 99b40bce1ab446868c089b7c334e8a59 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestServerMultinode-325951447 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99b40bce1ab446868c089b7c334e8a59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99b40bce1ab446868c089b7c334e8a59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99b40bce1ab446868c089b7c334e8a59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99b40bce1ab446868c089b7c334e8a59"}]}] Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestServerMultinode-325951447 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 99b40bce1ab446868c089b7c334e8a59 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestServerMultinode-325951447 Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestServerMultinode-325951447-project-admin Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 38b69184fe8b4e6fb6540abf5b9dd58d Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestServerMultinode-325951447-project-admin Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '2a01e247-30ff-4de8-af48-9b3966b08014'} Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:21:56.571773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:21:56.577965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Returning 404 to user: Instance 2a01e247-30ff-4de8-af48-9b3966b08014 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:21:56.579084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2c3ed58c-b073-47b7-9e0e-f2572a98a018 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014" status: 404 len: 111 microversion: 2.1 time: 0.058608 Oct 10 11:21:56.580261 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3185/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:56 2022] GET /compute/v2.1/servers/2a01e247-30ff-4de8-af48-9b3966b08014 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:21:56.590089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:56.590800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:56.598560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.599227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.599808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.601206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.601787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.602447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.635109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:21:56.671622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:56.680306 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0472d6c3-bb04-4a8b-acc9-acc1af3044ec tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.227315 Oct 10 11:21:56.681214 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3084/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:56 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:21:56.734647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ca8cd891-596c-499c-98ff-a6c43b6bf144 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 204 len: 0 microversion: 2.1 time: 0.149517 Oct 10 11:21:56.735728 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3186/6270] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:21:56 2022] DELETE /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:21:56.744965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:56.745736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:56.752592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.753085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.753593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.754377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:56.754839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:56.755390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:56.906045 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ad84efe-31d3-43d6-b4f6-b7144537a063 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1653 microversion: 2.1 time: 0.165251 Oct 10 11:21:56.906724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3085/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:56 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:21:57.384533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "name": "network-vif-plugged", "status": "completed", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:57.395993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:57.396696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:57.397242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:57.411726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] Creating event network-vif-plugged:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:21:57.419166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b765f01d-6c4d-4928-a5a7-566025bf73a7 req-2cdc9cb6-3fb3-4538-912f-ed314f913d15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 Oct 10 11:21:57.420188 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3187/6272] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:57.707658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:57.708411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:57.723989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:57.724723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:57.725174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:57.726630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:57.727479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:57.728046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:57.825886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:57.853823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:57.885572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:57.894373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12f4d86e-19a9-49b1-a0e3-59e068b2eec2 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.192940 Oct 10 11:21:57.895168 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3086/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:57 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:57.932877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:57.933741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:57.941026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:57.941663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:57.942288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:57.943252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:57.944007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:57.945088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:58.053161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=14 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:21:58.073805 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ccabd30-1157-42c3-b48d-512672ccefe1 tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1653 microversion: 2.1 time: 0.146429 Oct 10 11:21:58.074467 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3188/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:57 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:58.624837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0ab072-ea19-4ae1-b10c-892235b2c108", "name": "network-vif-deleted", "tag": "2e3f6826-ee3c-4342-bed5-d2e350e2cf8e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:21:58.636808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:58.637558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:58.637969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:58.651520 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] Creating event network-vif-deleted:2e3f6826-ee3c-4342-bed5-d2e350e2cf8e for instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 on n-h2-860687-2 Oct 10 11:21:58.657313 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e30fd964-eb05-4832-9caa-2d4c9a1a725b req-12bc6ae6-be8b-44e4-927d-a62c30825354 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036735 Oct 10 11:21:58.657926 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3087/6275] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:21:58.919182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:58.919806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:58.934596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:58.935319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:58.935569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:58.936515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:58.937150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:58.937768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:59.096924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:21:59.098449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:21:59.099348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:21:59.106501 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-093e2806-b543-47de-ae66-3c94bb87867c tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1391 microversion: 2.1 time: 0.191234 Oct 10 11:21:59.107312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:59.107802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:59.108238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:59.108936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:59.109403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:59.109813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:59.118836 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3189/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:58 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:21:59.140487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:21:59.140965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:21:59.141400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:21:59.141844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lazy-loading 'fault' on Instance uuid 3f0ab072-ea19-4ae1-b10c-892235b2c108 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:21:59.190119 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5eccb8ca-a8d6-46c4-820f-d866dd7ad82c tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 200 len: 1453 microversion: 2.1 time: 0.095957 Oct 10 11:21:59.190694 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3088/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:21:59 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:22:00.130049 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:00.130716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:00.138037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.138550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.139030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.139980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.140657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.140657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.213048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:00.213787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] [instance: 3f0ab072-ea19-4ae1-b10c-892235b2c108] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:00.220806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.221380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.222377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.222687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.223248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.224054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.227423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:22:00.240730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] HTTP exception thrown: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Request method failure captured: Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 HTTP/1.1 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAA4EwbKnIg-RTVp83JpZbqQo9aM0IW8xrmixfLAIqCAKb9uVRTqJU53GO1TjzcRCb5Z23fv1nQNu455LkVkqzBFbh60FtoCUe-OPIDvwMyLo64XoUaOP7AFwrg_FKns9lcq_kTTg5Sf3EunPwJ_uOUvYTvERIeWg729a9Jm4A6y2ys Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 99b40bce1ab446868c089b7c334e8a59 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestServerMultinode-325951447 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99b40bce1ab446868c089b7c334e8a59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_99b40bce1ab446868c089b7c334e8a59", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/99b40bce1ab446868c089b7c334e8a59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/99b40bce1ab446868c089b7c334e8a59"}]}] Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestServerMultinode-325951447 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 99b40bce1ab446868c089b7c334e8a59 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestServerMultinode-325951447 Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestServerMultinode-325951447-project-admin Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 38b69184fe8b4e6fb6540abf5b9dd58d Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestServerMultinode-325951447-project-admin Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '3f0ab072-ea19-4ae1-b10c-892235b2c108'} Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:22:00.242967 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] Returning 404 to user: Instance 3f0ab072-ea19-4ae1-b10c-892235b2c108 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-243a10b1-ea7a-4a90-82d2-65b79e08a91b tempest-TestServerMultinode-325951447 tempest-TestServerMultinode-325951447-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108" status: 404 len: 111 microversion: 2.1 time: 0.035260 Oct 10 11:22:00.247577 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3089/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:00 2022] GET /compute/v2.1/servers/3f0ab072-ea19-4ae1-b10c-892235b2c108 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:22:00.290802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:00.299626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0e2ac20-339a-4478-8133-c52e2578fa2f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1564 microversion: 2.1 time: 0.173579 Oct 10 11:22:00.301264 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3190/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:00 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:00.322583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:00.323235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:00.329273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.329759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.330190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.331152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:00.331624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:00.332032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:00.813846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:00.823416 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6f8ecbf-9d3f-4781-af2e-ede8e61002af tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1564 microversion: 2.1 time: 0.505095 Oct 10 11:22:00.823994 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3090/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:00 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1564 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:02.910428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:02.911224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:02.915565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:22:02.932482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:02.934669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:02.935390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:02.935755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:02.936353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:02.936567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:02.939644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:02.940140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:02.941780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:02.961078 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] Creating event network-changed:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:22:02.977534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cd21ec94-4d65-482b-8539-c9dfd7a69da9 req-5b7a7eac-321f-4db3-9177-16ec88f8310b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066100 Oct 10 11:22:02.978291 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3091/6281] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:22:03.308454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:03.318928 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ee7c384a-7ef1-4932-b861-3500e5523008 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1564 microversion: 2.1 time: 0.411566 Oct 10 11:22:03.340879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3191/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:02 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1564 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:23.765148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:22:23.767495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:23.769885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:22:23.770543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:22:23.777012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:23.777510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:23.777953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:23.778655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:23.779169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:23.779600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:23.833959 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b6269f0-46a0-4e80-83bb-1515225e77ea tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action" status: 200 len: 24574 microversion: 2.1 time: 0.073053 Oct 10 11:22:23.840980 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3092/6283] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:22:23 2022] POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:22:30.280944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:22:30.283894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:30.286409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:22:30.287196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:22:30.294551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.295095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.295561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.296297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.296884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.297211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.381521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:22:30.382052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:22:30.382570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:22:30.383016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:22:30.383476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:22:30.448013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:30.454421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.454930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.455416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.456142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.457212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.457663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.485573 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8269dbba-96f3-4da0-8baa-27870ef60378 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action" status: 202 len: 1138 microversion: 2.1 time: 0.208756 Oct 10 11:22:30.499033 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3192/6284] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:22:30 2022] POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action => generated 1138 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 11:22:30.506189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:30.506929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:30.514530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.515052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.515473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.516380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:30.517012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:30.517448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:30.918655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:30.926659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca3eee07-c189-4976-b183-16b3c2704600 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.424717 Oct 10 11:22:30.927255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3093/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:30 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:31.952300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:31.953161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:31.961698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:31.962211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:31.962674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:31.963435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:31.963917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:31.964365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:32.165531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:32.173624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2c152a5-9923-4314-b4f8-d7878f0f172a tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.225294 Oct 10 11:22:32.174215 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3193/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:31 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:33.198340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:33.198922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:33.210246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:33.211043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:33.211775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:33.212833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:33.213621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:33.214065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:33.364089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:33.372699 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a78ec63b-7dda-4bdb-97e3-95e1153f99d8 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.179083 Oct 10 11:22:33.373292 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3094/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:33 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:34.397902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:34.398543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:34.405520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:34.406038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:34.406499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:34.407252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:34.407730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:34.408204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:34.545496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:34.553696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6756dfa-6ed1-46f3-811b-94211c912538 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.160212 Oct 10 11:22:34.554385 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3194/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:34 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:35.577705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:35.578228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:35.586596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:35.587132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:35.587569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:35.588264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:35.588753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:35.589202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:35.726645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:35.735627 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccd4ac8b-f152-4fef-a8ca-96312017bb1f tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.161861 Oct 10 11:22:35.736241 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3095/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:35 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:36.760473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:36.761359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:36.768965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:36.769583 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:36.769925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:36.770656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:36.771321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:36.771770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:36.907410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:36.915862 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a1a2d32-3bd3-4299-9f31-5b56173e7566 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.160007 Oct 10 11:22:36.916530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3195/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:36 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:37.939763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:37.940393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:37.947886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:37.948377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:37.948826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:37.949512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:37.949968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:37.950396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:38.084650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:38.092514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58c0456b-907d-43c8-b36d-f70f1fae1703 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.156676 Oct 10 11:22:38.093089 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3096/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:37 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:39.115701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:39.116896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:39.124431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:39.124939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:39.125390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:39.126219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:39.126689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:39.127309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:39.264002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:39.271872 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0fa7ff86-d5c0-4a50-aa53-27a27e497b88 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.160160 Oct 10 11:22:39.272452 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3196/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:39 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:40.296348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:40.297012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:40.303966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:40.304604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:40.304889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:40.305590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:40.306055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:40.306486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:40.437304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:40.445670 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b0c1016-1971-42ec-9641-599b97a4e498 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.153504 Oct 10 11:22:40.446245 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3097/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:40 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:41.469709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:41.470332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:41.477751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:41.478329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:41.478787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:41.479682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:41.480153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:41.480594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:41.617064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:41.624967 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-591c8ef3-7c01-45ad-a648-d607cacb7140 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1692 microversion: 2.1 time: 0.159164 Oct 10 11:22:41.625549 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3197/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:41 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:42.649109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:42.649724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:42.656729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:42.657218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:42.657657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:42.658357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:42.658821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:42.659279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:42.800143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:42.808457 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b7cdd63-fd08-4b8e-9a02-9a65dbce97cd tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1698 microversion: 2.1 time: 0.163951 Oct 10 11:22:42.809030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3098/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:42 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:43.833123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:43.833810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:43.841382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:43.841934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:43.842420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:43.843206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:43.843713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:43.844185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:43.996447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:44.005243 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6917b3bb-0242-4ec9-bc70-f71d1922796b tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1698 microversion: 2.1 time: 0.176595 Oct 10 11:22:44.005935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3198/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:43 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:45.028810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:22:45.029530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:22:45.036487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:45.037075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:45.037748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:45.038453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:45.038899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:45.039374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:45.173952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:22:45.183074 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99d289d4-3562-47de-be34-4408c34869e6 tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1683 microversion: 2.1 time: 0.158082 Oct 10 11:22:45.195302 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3099/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:22:45 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:22:45.602199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "name": "network-vif-plugged", "status": "completed", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:22:45.613584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:22:45.614087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:22:45.614538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:22:45.626246 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] Creating event network-vif-plugged:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:22:45.632146 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-14783ead-f444-456f-a730-cb25788f5d1d req-9259a2fd-38d3-4d58-9110-83d0fa393360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Oct 10 11:22:45.632764 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3199/6298] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:01.994678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-34150526", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-775495568", "security_groups": [{"name": "tempest-secgroup-smoke-1217491596"}], "block_device_mapping_v2": [{"uuid": "cce8da7c-560e-42b8-9eaf-b6795b60dbf6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0607eeb7-42d0-41f6-af80-78018e6f2889"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:02.005906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:02.006592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=46 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:02.130905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] validate_networks() for [('0607eeb7-42d0-41f6-af80-78018e6f2889', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:23:02.527839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:23:02.528499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:23:02.528973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:23:02.529646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:23:02.530068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:23:02.541294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:02.541794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:02.542407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:02.543399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:02.543868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:02.544301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:02.569685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:23:02.576849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Getting quotas for user 83b67f46cbe44352aa36e836d183b9ec and project 4155fbce24db4258aa18393e94f94693. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:23:02.647576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:23:02.650348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cce8da7c-560e-42b8-9eaf-b6795b60dbf6',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:23:02.797311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bccd702a-f86a-4dc2-b0ef-d9d1c9b6714f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.806652 Oct 10 11:23:02.798362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3100/6299] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:23:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:23:02.817083 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfe4221c-11d5-42fe-a043-98b7700cdcc7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:02.819838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfe4221c-11d5-42fe-a043-98b7700cdcc7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:02.826798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=20 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:02.827854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:02.895763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cfe4221c-11d5-42fe-a043-98b7700cdcc7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:02.907647 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cfe4221c-11d5-42fe-a043-98b7700cdcc7 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1092 microversion: 2.1 time: 0.101992 Oct 10 11:23:02.914396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3200/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:02 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1092 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:03.932381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:03.933542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:03.944781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:03.945547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:03.946202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:03.947160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:03.947846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:03.948411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:04.017358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:04.032824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-853119c0-2bbc-46a8-8d9e-1ce61a11bdc6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1198 microversion: 2.1 time: 0.104873 Oct 10 11:23:04.046218 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3101/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:03 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:05.057180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:05.057993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:05.065979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:05.066642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:05.067243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:05.068073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:05.068781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:05.069573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:05.215345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:05.224435 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3050faf2-b933-430d-812c-d6c987837d6c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.172135 Oct 10 11:23:05.225358 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3201/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:05 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:05.600067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d82ccb-66a6-424b-a42a-cef9e59f4f65", "tag": "e650a65a-de47-4fa9-b103-338436f757e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:05.612168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:05.612688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:05.613128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:05.625516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] Creating event network-changed:e650a65a-de47-4fa9-b103-338436f757e2 for instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 on n-h2-860687-2 Oct 10 11:23:05.630415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-869f39bf-b49e-498f-a30b-26ae7f1c94f3 req-cce5242c-f6d3-436f-b12b-35e03d17f6e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125566 Oct 10 11:23:05.631219 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3102/6303] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:06.248230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:06.249477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:06.256754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:06.257262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:06.257915 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:06.258919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:06.259695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:06.260140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:06.411422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:06.420303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0ef93f21-8aa7-4354-80c2-217e3cd81a34 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.175949 Oct 10 11:23:06.420993 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3202/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:06 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:07.444629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:07.445245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:07.451480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:07.451962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:07.452397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:07.453080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:07.453540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:07.453962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:07.589942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:07.597783 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31e3e317-0bb7-426d-9317-6b92909794c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.158369 Oct 10 11:23:07.598352 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3103/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:07 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:08.183743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7cb705ca-f2c7-41df-ae62-b0468f3e8c94 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Action: 'create', calling method: .version_select at 0x7f677c0b68b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-109345337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIKjfK77U/mVjrxALk1yVqIPfdOLF6cxgqrLyAq/bsTTb3VbNSyfilW4dlj8pGUFNy/oXGK0uK/2uBH555icwNVJ8t/uCeis0bw2mS4dbhs93+Kcz45NnAhtDxZQEGQDQ=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:08.202552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7cb705ca-f2c7-41df-ae62-b0468f3e8c94 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Getting quotas for project 9ff5fa0d71cb435ea219c8a2af7291de. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:23:08.208952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7cb705ca-f2c7-41df-ae62-b0468f3e8c94 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Getting quotas for user bff979e767bd41fea936197e83a31229 and project 9ff5fa0d71cb435ea219c8a2af7291de. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:23:08.236722 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7cb705ca-f2c7-41df-ae62-b0468f3e8c94 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.056890 Oct 10 11:23:08.237233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3203/6306] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:23:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:08.622117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:08.622860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:08.630150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:08.630558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:08.631337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:08.632184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:08.632888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:08.633580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:08.795782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:08.807492 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27e91f8d-e366-4a16-b765-d416dc0319e2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.190124 Oct 10 11:23:08.808552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3104/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:08 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:23:09.455205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1099262756", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "445bc9e6-db34-4b5e-9caf-6e30fecb9d19", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-109345337", "security_groups": [{"name": "tempest-secgroup-smoke-879838231"}], "networks": [{"uuid": "92ac1fa7-d67e-41c5-a789-892ba785e5a3"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:09.575976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] validate_networks() for [('92ac1fa7-d67e-41c5-a789-892ba785e5a3', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:23:09.834213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:09.835808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:09.843108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:09.843598 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:09.844176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:09.844874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:09.845522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:09.845953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:10.050379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:23:10.050880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:23:10.051503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:23:10.051987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:23:10.052427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:23:10.063900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:10.064816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:10.065277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:10.066162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:10.066616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:10.067348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:10.067582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:10.077248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20783e2f-a360-42d7-9dc1-b5544c657215 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.247132 Oct 10 11:23:10.077825 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3105/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:09 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:23:10.087313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Getting quotas for project 9ff5fa0d71cb435ea219c8a2af7291de. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:23:10.093146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Getting quotas for user bff979e767bd41fea936197e83a31229 and project 9ff5fa0d71cb435ea219c8a2af7291de. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:23:10.161364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:23:10.163686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='445bc9e6-db34-4b5e-9caf-6e30fecb9d19',volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:23:10.300990 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58cfee70-52f8-40bf-bfa6-3c8a671f7231 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.850671 Oct 10 11:23:10.301629 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3204/6309] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:23:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:23:10.314956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86467c4b-3df7-49f3-b4eb-a56c7548ef85 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:10.315931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86467c4b-3df7-49f3-b4eb-a56c7548ef85 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:10.385279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86467c4b-3df7-49f3-b4eb-a56c7548ef85 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:10.393907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86467c4b-3df7-49f3-b4eb-a56c7548ef85 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1098 microversion: 2.1 time: 0.083926 Oct 10 11:23:10.394840 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3106/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:10 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1098 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:11.104450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:11.105185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:11.112211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:11.112792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:11.113331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:11.114044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:11.114548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:11.115014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:11.256668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:11.265602 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dcfa2cb5-8883-4708-9848-1f437564e321 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1276 microversion: 2.1 time: 0.166483 Oct 10 11:23:11.266215 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3205/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:11 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:11.417819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:11.419174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:11.427402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:11.428171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:11.429031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:11.430367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:11.431284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:11.431838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:11.507586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:11.516665 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e986cbd-e886-4b6c-988d-ef2557c9d4e7 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1214 microversion: 2.1 time: 0.103453 Oct 10 11:23:11.517429 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3107/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:11 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:12.289867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:12.290501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:12.297486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:12.297987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:12.298440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:12.299346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:12.300086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:12.300732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:12.458363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:12.467143 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f99e0082-4e8c-4d82-a923-247d323fb231 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.181247 Oct 10 11:23:12.467975 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3206/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:12 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:12.541856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:12.543300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:12.550392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:12.551164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:12.551821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:12.552721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:12.553372 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:12.554005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:12.559509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:12.704752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:12.713858 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ace2559-9be6-47da-ba2c-8770cc709ce0 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1281 microversion: 2.1 time: 0.176027 Oct 10 11:23:12.714465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3108/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:12 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:12.891935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:12.915089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:12.915600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:12.916059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:12.927529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] Creating event network-changed:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:23:12.933325 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fe15fec7-b963-4054-ad52-72b7c4b4d4e1 req-9b7b4f28-ab62-4467-be45-9d9fb7b2ee16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050818 Oct 10 11:23:12.933959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3207/6315] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:13.492762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:13.493437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:13.499720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:13.500360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:13.500939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:13.501769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:13.502328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:13.502909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:13.640073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:13.648014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b35eeb8-fcb9-4698-8261-36bf73df0515 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.159202 Oct 10 11:23:13.659644 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3109/6316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:13 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:13.737612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:13.738334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:13.744938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:13.745373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:13.745826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:13.746709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:13.747230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:13.747674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:13.888949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:13.896953 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5219b777-9fdd-45b0-ae59-33024dc6e944 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1281 microversion: 2.1 time: 0.164378 Oct 10 11:23:13.897528 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3208/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:13 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:14.671553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:14.672170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:14.680823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:14.681307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:14.681745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:14.682441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:14.682897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:14.683343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:14.822435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:14.830494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e7f1d5f-4415-44b1-bff7-caa7f212cc17 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.162990 Oct 10 11:23:14.831091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3110/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:14 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:14.920976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:14.921487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:14.928383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:14.928880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:14.929323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:14.930657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:14.931151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:14.931590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:15.070653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:15.078420 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1171a48b-0097-4e22-b860-05b7f5b2108d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1281 microversion: 2.1 time: 0.161408 Oct 10 11:23:15.079021 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3209/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:14 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:15.853456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:15.854197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:15.861126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:15.861614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:15.862056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:15.862747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:15.863238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:15.863670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:15.999394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:16.007365 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2dff003-e152-46cc-86d0-449e23449b48 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.157961 Oct 10 11:23:16.008996 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3111/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:15 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:16.101634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:16.102282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:16.109221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:16.109720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:16.110168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:16.110877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:16.111414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:16.111861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:16.255379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:16.264489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b54fedf4-2927-4495-a6c0-75c285e1fb37 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1281 microversion: 2.1 time: 0.166740 Oct 10 11:23:16.265086 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3210/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:16 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:17.030885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:17.031527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:17.038630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:17.039145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:17.039583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:17.040268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:17.040723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:17.041147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:17.177652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:17.185972 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31eafa60-a8f0-493c-9f28-1c26f0a670da tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.158971 Oct 10 11:23:17.186557 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3112/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:17 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:17.288106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:17.288686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:17.296096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:17.296601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:17.297056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:17.297768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:17.298251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:17.298697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:17.430541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:17.438822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7db25bc9-b535-4759-9d71-2a4a706e3ed1 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.154601 Oct 10 11:23:17.439448 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3211/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:17 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:18.208603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:18.209252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:18.216901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:18.217389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:18.217830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:18.218525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:18.218989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:18.219449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:18.349048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:18.357060 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-986529e7-9ce8-44f0-a80c-d4624a560ad9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.152607 Oct 10 11:23:18.357646 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3113/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:18 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:18.461937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:18.462509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:18.469527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:18.470038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:18.470503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:18.471253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:18.471737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:18.472187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:18.608305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:18.617765 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9ca441c-1b44-4cae-8b7d-086c91a77e7e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.159236 Oct 10 11:23:18.618359 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3212/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:18 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:19.380454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:19.381085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:19.388117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:19.388615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:19.389062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:19.389769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:19.390233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:19.390667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:19.523855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:19.531708 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65072b73-e58c-4d4f-80ab-3fab0abbaa1c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.155208 Oct 10 11:23:19.532326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3114/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:19 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:19.641535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:19.642172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:19.649027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:19.650291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:19.650758 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:19.651495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:19.651976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:19.652429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:19.789315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:19.797499 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a6eb5cd-0079-486d-bdb6-a711cc65dd04 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.159944 Oct 10 11:23:19.798081 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3213/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:19 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:20.554075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:20.554691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:20.557521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:20.562982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:20.563496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:20.563941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:20.564628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:20.565087 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:20.565516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:20.695479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:20.703337 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-498e48b0-416f-4166-81dc-2e7cc23d5894 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.153087 Oct 10 11:23:20.703858 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3115/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:20 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:20.821443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:20.822339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:20.824269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:20.825067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:20.832262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:20.832770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:20.833229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:20.833954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:20.834426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:20.834869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:20.966648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:20.974530 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80f6d5dc-4f4a-45aa-bef5-17220f4d3657 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.157135 Oct 10 11:23:20.975310 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3214/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:20 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:21.728876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:21.729519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:21.736421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:21.737043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:21.737750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:21.738451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:21.738913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:21.739369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:21.811182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d82ccb-66a6-424b-a42a-cef9e59f4f65", "name": "network-vif-plugged", "status": "completed", "tag": "e650a65a-de47-4fa9-b103-338436f757e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:21.821431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:21.822091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:21.822675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:21.834933 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] Creating event network-vif-plugged:e650a65a-de47-4fa9-b103-338436f757e2 for instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 on n-h2-860687-2 Oct 10 11:23:21.841992 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-388be9bc-e2cb-4718-851c-ed80ab0156d4 req-37257029-e317-4b84-946f-43a9a9085c29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034817 Oct 10 11:23:21.842810 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3215/6330] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:21.890472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:21.899200 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3566a610-7452-4f16-a0c9-fb2980411658 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.175335 Oct 10 11:23:21.900378 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3116/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:21 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:21.998778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:21.999545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:22.005940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:22.006456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:22.006911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:22.007697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:22.008175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:22.008620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:22.142768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:22.150831 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8faf5dad-c6dc-4025-ba19-5d0238637431 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.156351 Oct 10 11:23:22.151472 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3216/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:21 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:22.923136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:22.923756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:22.930861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:22.931480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:22.931925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:22.932616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:22.933083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:22.933510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:23.074063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:23.082068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d04eecfe-da2b-4bb1-a711-fedeb540118c tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1264 microversion: 2.1 time: 0.162654 Oct 10 11:23:23.082640 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3117/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:22 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:23.173316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:23.173910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:23.180721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:23.181220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:23.181670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:23.182371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:23.182838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:23.183306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:23.311547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:23.319284 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8b6cf431-f633-40aa-b742-0470c98f9717 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.149895 Oct 10 11:23:23.319857 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3217/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:23 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:24.106189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:24.106801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:24.113821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.114308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.114863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.115671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.116129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.116554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.257088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:24.261216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:24.266482 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9aea23c-4c7a-4205-ab28-bcf01b301fb3 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1451 microversion: 2.1 time: 0.164827 Oct 10 11:23:24.267099 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3118/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:24 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:24.290045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:24.290679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:24.297614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.298123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.298578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.299322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.299799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.300347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.341924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:24.342534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:24.348645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.349161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.349600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.350299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:24.350761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:24.351223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:24.488469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:24.498035 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7fddde55-27c5-4bb4-9eb0-f4a88afb2f52 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1451 microversion: 2.1 time: 0.212392 Oct 10 11:23:24.498713 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3218/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:24 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1451 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:23:24.519296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:24.528263 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13db0c99-a5af-4ae0-9ba9-cce3482c4a96 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.190348 Oct 10 11:23:24.529060 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3119/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:24 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:23:25.551986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:25.552533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:25.560139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:25.560646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:25.561092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:25.561814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:25.562278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:25.562715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:25.943355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:25.951979 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc866b8a-79a0-4b12-92c1-f271166f9718 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.403951 Oct 10 11:23:25.952555 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3219/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:25 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:26.216446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "name": "network-vif-plugged", "status": "completed", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:26.230004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:26.230508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:26.230947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:26.246795 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] Creating event network-vif-plugged:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:23:26.252519 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-188aef00-82aa-4e84-ae00-a9f6182284d9 req-1d891fe8-b35b-48a0-b97e-7ea7dfcc5f1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043021 Oct 10 11:23:26.253141 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3120/6339] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:26.507159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d82ccb-66a6-424b-a42a-cef9e59f4f65", "tag": "e650a65a-de47-4fa9-b103-338436f757e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:26.516489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:26.516980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:26.517422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:26.528958 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] Creating event network-changed:e650a65a-de47-4fa9-b103-338436f757e2 for instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 on n-h2-860687-2 Oct 10 11:23:26.533784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-de2c1254-2df0-4c69-bff6-f00ed55e8957 req-3f62fcf4-9aac-4e83-a0f7-49ef2c8705c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Oct 10 11:23:26.534389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3220/6340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:26.975944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:26.976644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:26.982984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:26.983500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:26.983934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:26.984621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:26.985073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:26.985493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:27.130967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:27.139550 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-775bf2ee-f09c-44b1-bb06-e22bfdb866a3 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1269 microversion: 2.1 time: 0.167788 Oct 10 11:23:27.140124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3121/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:26 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:28.164321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:28.165155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:28.171480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:28.171968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:28.172431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:28.173142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:28.173617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:28.174063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:28.178188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=100 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:28.315911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:28.324666 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72d2148d-47a7-4762-8226-940d04481dc8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1458 microversion: 2.1 time: 0.165570 Oct 10 11:23:28.325245 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3221/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:28 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1458 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:23:28.347176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:23:28.347819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:23:28.354622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:28.355141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:28.355580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:28.356271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:28.356724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:28.357148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:28.489144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:23:28.497866 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4edea8ad-b5a4-446d-8aac-b1741ae54e21 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1458 microversion: 2.1 time: 0.154599 Oct 10 11:23:28.498926 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3122/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:23:28 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1458 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:23:30.191832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:30.202604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:30.203153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:30.203653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:30.215896 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] Creating event network-changed:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:23:30.221105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-5e5c8186-b9dc-40bd-8b8c-620dc9512930 req-f8364d11-2018-4bfc-aa19-4014c8c73047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032914 Oct 10 11:23:30.221885 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3222/6344] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:23:32.236490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}, {"name": "network-changed", "server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:23:32.243543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:23:32.249395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:23:32.249880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:23:32.250319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:23:32.261803 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Creating event network-changed:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:23:32.262321 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] Creating event network-changed:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:23:32.267417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-548bd096-b871-4110-a65e-002597d17b43 req-6c42fc5c-de3e-4af2-a7a4-66fba0d9f76f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034593 Oct 10 11:23:32.268013 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3123/6345] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:05.146547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:05.147673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:05.148124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:05.148493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:05.152812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:05.153527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:05.153671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:05.162029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:05.163023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:05.163536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:05.164301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:05.164495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:05.164784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:05.165021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:05.165200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:05.165480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:05.176970 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] Creating event network-changed:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:24:05.182352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-640b80b0-384f-4533-a43c-c3d2e2266757 req-f0011032-1b45-419a-87dc-238b2b896db8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038329 Oct 10 11:24:05.183528 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3124/6346] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:05.197348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:24:05.287502 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfdcf953-ca80-4afe-98f3-348945c90a03 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 204 len: 0 microversion: 2.1 time: 0.145255 Oct 10 11:24:05.288344 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3223/6347] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:24:05 2022] DELETE /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:24:05.297106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:05.297811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:05.304954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:05.305445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:05.305882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:05.306576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:05.307064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:05.307495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:05.448271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:05.456082 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-865c89b7-9aec-4b81-a0da-9cc0e8dbb5a4 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1583 microversion: 2.1 time: 0.163218 Oct 10 11:24:05.456662 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3125/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:05 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1583 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:06.481179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:06.481962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:06.489808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:06.490335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:06.490810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:06.491573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:06.492107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:06.492560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:06.632433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:06.640529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36abe71a-2e5a-4308-a5e2-ac0cb4a82a7a tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1583 microversion: 2.1 time: 0.163840 Oct 10 11:24:06.641104 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3224/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:06 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1583 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:07.284914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0651cb3-086f-497f-aa39-f643bf7aa151", "name": "network-vif-deleted", "tag": "9b3b86ff-5403-4f70-9801-6040ff1ccb59"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:07.298140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:07.298629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:07.299094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:07.312557 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] Creating event network-vif-deleted:9b3b86ff-5403-4f70-9801-6040ff1ccb59 for instance e0651cb3-086f-497f-aa39-f643bf7aa151 on n-h1-860687-2 Oct 10 11:24:07.318493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-47f9a889-4a51-4331-b42a-6d6ea0861be4 req-60965e70-5fb4-4d2c-8744-fb77f527b2ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Oct 10 11:24:07.319156 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3126/6350] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:07.664888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:07.666256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:07.674430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:07.676119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:07.676953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:07.678078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:07.678776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:07.679543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:07.757392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:07.765476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-46ef9a82-aa62-4539-8168-51579499f2e6 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1229 microversion: 2.1 time: 0.105235 Oct 10 11:24:07.766055 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3225/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:07 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:08.790665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:08.792633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:08.799548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:08.800027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:08.800461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:08.801855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:08.802314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:08.802737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:08.869963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:08.877899 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98730c4d-15bc-44b4-8ebd-7744e9eaa71e tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1229 microversion: 2.1 time: 0.092936 Oct 10 11:24:08.878463 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3127/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:08 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:09.901472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:09.902113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:09.909241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:09.909748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:09.910206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:09.910940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:09.911471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:09.911924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:09.978910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:09.986973 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72c3a4f5-b5cd-4294-9b5c-09d1c5fda0b8 tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1229 microversion: 2.1 time: 0.089337 Oct 10 11:24:09.987573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3226/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:09 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:11.012453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:11.012975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:11.021093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:11.021579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:11.022103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:11.022795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:11.023277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:11.023709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:11.087511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff979e767bd41fea936197e83a31229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff5fa0d71cb435ea219c8a2af7291de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:11.095950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3df75858-14f8-4bce-bce8-f1d8f4dfb84b tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 200 len: 1229 microversion: 2.1 time: 0.087695 Oct 10 11:24:11.096519 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3128/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:11 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:12.120454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:12.121223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] [instance: e0651cb3-086f-497f-aa39-f643bf7aa151] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:12.128919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:12.130006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:12.130492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:12.131333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:12.131833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:12.132278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:12.145964 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] HTTP exception thrown: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Request method failure captured: Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 HTTP/1.1 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAAUvL_eKXYJvD4ukF_5rM3cZ0_65Q-f2M9L0rRt8GpQUTgexLbXvL-vPUnOKVOZSgunB6w63FBDruGxb4rC1QuyA-57kSDKYM_BXiaTxrA6Kb7g-L4TdV3nzZpdaKtuPAtS3-4c-yIX-j5qdcnX9pDMKRl-npT5Q6DgZX4oE5RcBxo Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 9ff5fa0d71cb435ea219c8a2af7291de Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBackupRestore-365506481 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ff5fa0d71cb435ea219c8a2af7291de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ff5fa0d71cb435ea219c8a2af7291de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ff5fa0d71cb435ea219c8a2af7291de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ff5fa0d71cb435ea219c8a2af7291de"}]}] Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBackupRestore-365506481 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 9ff5fa0d71cb435ea219c8a2af7291de Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBackupRestore-365506481 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBackupRestore-365506481-project Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: bff979e767bd41fea936197e83a31229 Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBackupRestore-365506481-project Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e0651cb3-086f-497f-aa39-f643bf7aa151'} Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:24:12.147594 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Returning 404 to user: Instance e0651cb3-086f-497f-aa39-f643bf7aa151 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc6f8cf5-b2a0-4e3b-9d21-d986ed21d9ac tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151" status: 404 len: 111 microversion: 2.1 time: 0.032837 Oct 10 11:24:12.151806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3227/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:12 2022] GET /compute/v2.1/servers/e0651cb3-086f-497f-aa39-f643bf7aa151 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:24:12.310205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3989678-9cbf-45ff-aad7-fdf7655b366d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] Calling method '.version_select at 0x7f6777854820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:12.331608 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3989678-9cbf-45ff-aad7-fdf7655b366d tempest-TestVolumeBackupRestore-365506481 tempest-TestVolumeBackupRestore-365506481-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-109345337" status: 202 len: 0 microversion: 2.1 time: 0.026287 Oct 10 11:24:12.332697 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3129/6356] 10.222.0.16 () {58 vars in 1266 bytes} [Mon Oct 10 11:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-109345337 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:24:45.816313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:45.818431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:45.820928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:45.821589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:45.827855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:45.828352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:45.828802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:45.829507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:45.829974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:45.830417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:45.890187 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-efccbacb-02ec-4449-9026-eb9858fe43ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action" status: 200 len: 40146 microversion: 2.1 time: 0.078054 Oct 10 11:24:45.890877 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3228/6357] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:24:45 2022] POST /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93/action => generated 40146 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:24:46.786373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:46.787738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:24:46.792786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:46.793286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:46.793391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:46.802542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:46.803266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:46.803711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:46.804409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:46.805074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:46.805501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:46.805624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:46.806081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:46.806607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:46.819545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] Creating event network-changed:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:24:46.825381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-0f667db6-afed-4074-b399-bdc9e5f082d7 req-ef647df5-31fe-4cc5-8221-5c12a6e67e3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 Oct 10 11:24:46.826081 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3229/6358] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:46.833527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:24:46.923186 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed49a75d-61c3-4501-8bf3-552396c675ef tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 204 len: 0 microversion: 2.1 time: 0.138933 Oct 10 11:24:46.924499 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3130/6359] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:24:46 2022] DELETE /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:24:46.934971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:46.935727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:46.942126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:46.942679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:46.943209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:46.943929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:46.944410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:46.944861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:47.086324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:47.094585 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-837eba5d-59b9-4626-8443-578d668bdece tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1689 microversion: 2.1 time: 0.164508 Oct 10 11:24:47.095205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3230/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:46 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:48.120032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:48.121045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:48.127785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:48.128278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:48.128715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:48.129409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:48.129859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:48.130972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:48.266939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d437cade74442790b99ce41ef0fd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54da2131a9b342e1a6f07e885362d9cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:48.275946 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02961eee-7248-49e0-acf4-cbb71e35e5db tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 200 len: 1689 microversion: 2.1 time: 0.160202 Oct 10 11:24:48.276533 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3131/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:48 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:48.843245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4334dcf-297a-4c56-8690-52c8865e9d93", "name": "network-vif-deleted", "tag": "bfde19b0-4ba2-405d-bb3a-6ec582e55e18"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:48.856659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:48.857156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:48.857601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:48.869123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] Creating event network-vif-deleted:bfde19b0-4ba2-405d-bb3a-6ec582e55e18 for instance b4334dcf-297a-4c56-8690-52c8865e9d93 on n-h2-860687-2 Oct 10 11:24:48.874156 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d8d509bd-6e36-4bc2-b30a-07757ea64e2e req-2812a84c-fb22-406a-bf6a-1432c6a3ff7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035530 Oct 10 11:24:48.874743 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3231/6362] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:49.299691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:49.300232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] [instance: b4334dcf-297a-4c56-8690-52c8865e9d93] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:49.308405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:49.308901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:49.309345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:49.310079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:49.310543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:49.310974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:49.325631 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] HTTP exception thrown: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Request method failure captured: Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 HTTP/1.1 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_7BjWrQtnk0VmWOwDWpSOEGZYin8R-sdrxgCrPN2aOTZ_i6XNa1S_JyARJZNFDlvM1DztiCMiSKU3VQIIpSkOzI7sYaqVIqTmdQGkQ82s6jJUqdISKf4fdhEOtmR2m__AyWTZaKEl5cTdbEhTU5RPIZQk2RWrm-VoglyEKYGhKnk4o Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_54da2131a9b342e1a6f07e885362d9cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/54da2131a9b342e1a6f07e885362d9cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/54da2131a9b342e1a6f07e885362d9cc"}]}] Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 54da2131a9b342e1a6f07e885362d9cc Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1718154756 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 41d437cade74442790b99ce41ef0fd87 Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1718154756-project Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b4334dcf-297a-4c56-8690-52c8865e9d93'} Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:24:49.327350 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Returning 404 to user: Instance b4334dcf-297a-4c56-8690-52c8865e9d93 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a75c697c-4240-4afb-b377-a620c8719f7d tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93" status: 404 len: 111 microversion: 2.1 time: 0.033150 Oct 10 11:24:49.333215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3132/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:49 2022] GET /compute/v2.1/servers/b4334dcf-297a-4c56-8690-52c8865e9d93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:24:52.560536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-20eb1afd-2bc4-4791-9a28-d4dc3d0c2fcc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] Calling method '.version_select at 0x7f677772c940>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:52.606751 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-20eb1afd-2bc4-4791-9a28-d4dc3d0c2fcc tempest-TestNetworkAdvancedServerOps-1718154756 tempest-TestNetworkAdvancedServerOps-1718154756-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1230291677" status: 202 len: 0 microversion: 2.1 time: 0.050376 Oct 10 11:24:52.611154 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3232/6364] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Oct 10 11:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1230291677 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:24:54.815432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:54.815989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:54.825037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d82ccb-66a6-424b-a42a-cef9e59f4f65", "tag": "e650a65a-de47-4fa9-b103-338436f757e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:54.836607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:54.836824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:54.837159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:54.837277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:54.837609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:54.837828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:54.838623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:54.839216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:54.839701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:54.849664 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] Creating event network-changed:e650a65a-de47-4fa9-b103-338436f757e2 for instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 on n-h2-860687-2 Oct 10 11:24:54.855184 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d0ee9a32-22f6-4464-acd7-8ac67454d242 req-f50ed8f2-cea6-4a92-939f-b571fc0c1b23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034732 Oct 10 11:24:54.855806 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3233/6365] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:54.868955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:24:54.968239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3d1bf6e-ea59-42c5-aec0-aa48798eff2b tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 204 len: 0 microversion: 2.1 time: 0.156791 Oct 10 11:24:54.969187 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3133/6366] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:24:54 2022] DELETE /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:24:54.978804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:54.979561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:54.986014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:54.986709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:54.987202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:54.987927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:54.988404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:54.988848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:55.135777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:55.144110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1fd1031-f601-434c-ab52-02cb5b913de4 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1576 microversion: 2.1 time: 0.169909 Oct 10 11:24:55.144707 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3234/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:54 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:56.169043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:56.169848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:56.176637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:56.177173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:56.177641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:56.178357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:56.178823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:56.179282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:56.318838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:56.327124 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54ea8d54-0d79-4101-9fb0-9e4c37829f67 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1576 microversion: 2.1 time: 0.162395 Oct 10 11:24:56.327688 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3134/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:56 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:56.896701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d82ccb-66a6-424b-a42a-cef9e59f4f65", "name": "network-vif-deleted", "tag": "e650a65a-de47-4fa9-b103-338436f757e2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:24:56.910402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:56.910894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:56.912078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:56.926402 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] Creating event network-vif-deleted:e650a65a-de47-4fa9-b103-338436f757e2 for instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 on n-h2-860687-2 Oct 10 11:24:56.932123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f5cf8171-13ed-4eeb-8039-ef65076447b2 req-2653768f-b0df-4b41-817c-4ade66429001 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040054 Oct 10 11:24:56.932724 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3235/6369] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:24:57.351140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:57.351877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:57.360000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:57.360582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:57.361128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:57.362427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:57.362888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:57.363338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:57.427906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:57.435947 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-811f754d-bfe3-4d8c-bfee-b28b1350cbb8 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1223 microversion: 2.1 time: 0.089628 Oct 10 11:24:57.436525 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3135/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:57 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:58.460638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:58.461403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:58.468778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:58.469292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:58.469755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:58.470490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:58.471030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:58.471485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:58.538605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:58.546852 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f357ff61-d29a-483b-8c18-af72caab44c2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1223 microversion: 2.1 time: 0.090979 Oct 10 11:24:58.547488 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3236/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:58 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:24:59.571299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:24:59.571927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:24:59.578865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:59.579311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:59.579759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:59.580459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:24:59.580926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:24:59.581359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:24:59.646388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:24:59.654413 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69c6ba44-e98f-4926-af8b-15eff92f6976 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1223 microversion: 2.1 time: 0.087903 Oct 10 11:24:59.654989 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3136/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:24:59 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:00.677856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:00.678433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:00.685283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:00.685780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:00.686224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:00.686927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:00.687418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:00.687867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:00.749537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:00.757982 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ac619e2-e456-4571-98e3-a6dbf79d4470 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 200 len: 1223 microversion: 2.1 time: 0.084154 Oct 10 11:25:00.758573 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3237/6373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:00 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:01.781466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:01.782682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: 65d82ccb-66a6-424b-a42a-cef9e59f4f65] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:01.790165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:01.790653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:01.791126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:01.791839 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:01.792290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:01.792712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:01.805895 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 HTTP/1.1 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '65d82ccb-66a6-424b-a42a-cef9e59f4f65'} Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:01.807562 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance 65d82ccb-66a6-424b-a42a-cef9e59f4f65 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ea700c4-c9b2-48d0-a114-44ac6f82c129 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65" status: 404 len: 111 microversion: 2.1 time: 0.031463 Oct 10 11:25:01.811650 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3137/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:01 2022] GET /compute/v2.1/servers/65d82ccb-66a6-424b-a42a-cef9e59f4f65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:25:08.029903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:08.030427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:08.032245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97800d5-df8e-4c73-9eb5-fccee050936c", "tag": "b6775852-79a5-4af6-8125-2096cbc00d07"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:08.038693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:08.039722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:08.040400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:08.041142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:08.041624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:08.042073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:08.043634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:08.044266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:08.044875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:08.056922 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] Creating event network-changed:b6775852-79a5-4af6-8125-2096cbc00d07 for instance b97800d5-df8e-4c73-9eb5-fccee050936c on n-h1-860687-2 Oct 10 11:25:08.062540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ca911dd-8e81-4045-9af5-152252624287 req-b4e69da2-012d-4eed-8861-539af2fddf8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Oct 10 11:25:08.063740 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3138/6375] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:08.069204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:25:08.159806 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a05b98f4-c064-40fe-9639-3f8eac87c791 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 204 len: 0 microversion: 2.1 time: 0.133800 Oct 10 11:25:08.161516 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3238/6376] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:25:08 2022] DELETE /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:25:08.170066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:08.170764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:08.177511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:08.177996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:08.178429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:08.179147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:08.179603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:08.180026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:08.319702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:08.327434 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24a0d677-5b49-43eb-a737-d76bdeed9ea9 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1577 microversion: 2.1 time: 0.161505 Oct 10 11:25:08.328193 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3139/6377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:08 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:09.352487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:09.353301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:09.360287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:09.360787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:09.361246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:09.361968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:09.362442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:09.362885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:09.498441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:09.506766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29c1479c-894e-4f6a-b474-3ec744213544 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1577 microversion: 2.1 time: 0.159109 Oct 10 11:25:09.507401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3239/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:09 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:10.114859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97800d5-df8e-4c73-9eb5-fccee050936c", "name": "network-vif-deleted", "tag": "b6775852-79a5-4af6-8125-2096cbc00d07"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:10.125433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:10.125921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:10.126355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:10.138109 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] Creating event network-vif-deleted:b6775852-79a5-4af6-8125-2096cbc00d07 for instance b97800d5-df8e-4c73-9eb5-fccee050936c on n-h1-860687-2 Oct 10 11:25:10.142918 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-46548862-dd4f-4d7c-9c23-cf13f345c9fb req-f1087831-9241-4309-ba31-2e483a3d1d11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031929 Oct 10 11:25:10.143565 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3140/6379] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:10.530667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:10.531410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:10.539364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:10.539867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:10.540318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:10.541048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:10.541519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:10.541956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:10.604575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:10.612492 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f9903fce-4cc4-4733-9a28-90a1bc73cfd6 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1224 microversion: 2.1 time: 0.086622 Oct 10 11:25:10.613058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3240/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:10 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:11.636719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:11.637421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:11.643779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:11.644268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:11.644709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:11.645929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:11.646484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:11.646919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:11.715098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:11.726006 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbed9498-a856-4cdb-8cd6-cf9e6ad27f78 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1224 microversion: 2.1 time: 0.094208 Oct 10 11:25:11.726650 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3141/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:11 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:12.749461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:12.750125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:12.757392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:12.757954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:12.758414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:12.759161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:12.759640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:12.760116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:12.823433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:12.831532 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5388cbf6-9619-4cf1-955e-2e018435f682 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1224 microversion: 2.1 time: 0.085963 Oct 10 11:25:12.832111 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3241/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:12 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:13.855453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:13.856075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:13.863347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:13.864338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:13.864800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:13.865480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:13.865939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:13.866364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:13.931725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b67f46cbe44352aa36e836d183b9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4155fbce24db4258aa18393e94f94693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:13.939629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68bf83db-e107-4e00-9b3f-c5efdddf5532 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 200 len: 1224 microversion: 2.1 time: 0.088194 Oct 10 11:25:13.940199 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3142/6383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:13 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:14.962715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:14.963296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: b97800d5-df8e-4c73-9eb5-fccee050936c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:14.970203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:14.970712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:14.971264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:14.971980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:14.972460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:14.972906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:14.986797 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c HTTP/1.1 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b97800d5-df8e-4c73-9eb5-fccee050936c'} Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:14.988488 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance b97800d5-df8e-4c73-9eb5-fccee050936c could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c057855-42c9-40ef-aaad-e0b7b9ac687f tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c" status: 404 len: 111 microversion: 2.1 time: 0.031932 Oct 10 11:25:14.993543 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3242/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:14 2022] GET /compute/v2.1/servers/b97800d5-df8e-4c73-9eb5-fccee050936c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:25:15.735124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:15.735632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:15.742458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:15.742943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:15.743418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:15.744112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:15.744572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:15.745006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:15.758545 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d HTTP/1.1 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'baf6fe0d-fbc3-4f3e-9bfd-02257698551d'} Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:25:15.760232 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d92e1c67-1d69-4f82-bd7d-e9934b28968d tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 404 len: 111 microversion: 2.1 time: 0.030422 Oct 10 11:25:15.764091 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3143/6385] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:25:15 2022] DELETE /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:25:15.770675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:15.771458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] [instance: baf6fe0d-fbc3-4f3e-9bfd-02257698551d] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:15.777465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:15.777964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:15.778412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:15.779137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:15.779609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:15.780047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:15.793493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] HTTP exception thrown: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Request method failure captured: Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d HTTP/1.1 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjQ_3EZWEBnHKj3RA6oXVUA_R2Ft6BU00spo8q56wfKp9QPqmLexgk-X2rNkayFDq1MGr1-YNaeomhbVzQsIOFQ5qNYRXMizk5CIp-BFeB7u11ZgCeSs5DH0tVqvye5ho7eG5OGpjNeMJdKuqrrThTPW4XBf9naftPi9Cn0q0yCUETTrY Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4155fbce24db4258aa18393e94f94693", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4155fbce24db4258aa18393e94f94693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4155fbce24db4258aa18393e94f94693"}]}] Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 4155fbce24db4258aa18393e94f94693 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestVolumeBootPattern-1225074085 Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 83b67f46cbe44352aa36e836d183b9ec Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestVolumeBootPattern-1225074085-project Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'baf6fe0d-fbc3-4f3e-9bfd-02257698551d'} Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:15.795038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Returning 404 to user: Instance baf6fe0d-fbc3-4f3e-9bfd-02257698551d could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-529f88b6-2f54-40ab-8449-a6202a5f7bd2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d" status: 404 len: 111 microversion: 2.1 time: 0.030159 Oct 10 11:25:15.798811 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3243/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:15 2022] GET /compute/v2.1/servers/baf6fe0d-fbc3-4f3e-9bfd-02257698551d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:25:19.208703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22bec128-0016-4c59-8934-9af794d52ae2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] Calling method '.version_select at 0x7f677caa0b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:19.217493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:19.234743 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22bec128-0016-4c59-8934-9af794d52ae2 tempest-TestVolumeBootPattern-1225074085 tempest-TestVolumeBootPattern-1225074085-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-775495568" status: 202 len: 0 microversion: 2.1 time: 0.030501 Oct 10 11:25:19.247840 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3144/6387] 10.222.0.16 () {58 vars in 1260 bytes} [Mon Oct 10 11:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-775495568 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:25:37.467968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:37.468712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:37.581017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1401881327", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:37.634335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] validate_networks() for None {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:25:37.905756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:25:37.906202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:25:37.906695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:25:37.907154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:25:37.907592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:25:37.917062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:37.917565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:37.918025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:37.918775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:37.919285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:37.919736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:37.936671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Getting quotas for project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:25:37.942020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Getting quotas for user 8de141202e1c4e359095898564f49609 and project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:25:37.956287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:25:37.960259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:25:38.004122 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e87e7db9-4f98-4926-93ca-ad4fa54a91c1 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541221 Oct 10 11:25:38.005328 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3244/6388] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:25:38.015393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:38.016259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:38.022613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fac20862-d1d9-487d-a57b-3a236ae1b01f tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:38.023262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fac20862-d1d9-487d-a57b-3a236ae1b01f tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:38.087179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fac20862-d1d9-487d-a57b-3a236ae1b01f tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:38.096982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fac20862-d1d9-487d-a57b-3a236ae1b01f tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1222 microversion: 2.1 time: 0.082906 Oct 10 11:25:38.097860 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3145/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:38 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:39.127822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-748b2002-b591-4621-84d9-1b3236246307 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:39.128451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-748b2002-b591-4621-84d9-1b3236246307 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:39.181565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-748b2002-b591-4621-84d9-1b3236246307 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:39.188431 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-748b2002-b591-4621-84d9-1b3236246307 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1222 microversion: 2.1 time: 0.064503 Oct 10 11:25:39.188997 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3245/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:39 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:40.211809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae411c7c-764c-43c4-9b08-abcaef8c6cb4 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:40.212424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae411c7c-764c-43c4-9b08-abcaef8c6cb4 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:40.266946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae411c7c-764c-43c4-9b08-abcaef8c6cb4 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:40.273788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae411c7c-764c-43c4-9b08-abcaef8c6cb4 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1222 microversion: 2.1 time: 0.066218 Oct 10 11:25:40.274545 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3146/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:40 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:41.297909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-132c91fb-7a4b-477b-b675-c8a3c20b1946 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:41.298559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-132c91fb-7a4b-477b-b675-c8a3c20b1946 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:41.359410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-132c91fb-7a4b-477b-b675-c8a3c20b1946 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:41.367777 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-132c91fb-7a4b-477b-b675-c8a3c20b1946 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1222 microversion: 2.1 time: 0.073750 Oct 10 11:25:41.368530 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3246/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:41 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:42.391858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:42.392477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:42.400173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:42.400666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:42.401110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:42.401804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:42.402264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:42.402692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:42.462558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:42.470205 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d4401b8-fce2-4aff-aac1-08343eaec365 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1226 microversion: 2.1 time: 0.082248 Oct 10 11:25:42.470775 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3147/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:42 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:43.493859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:43.494659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:43.502235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:43.502743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:43.503232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:43.503955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:43.504467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:43.505408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:43.573874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:43.581781 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0931cd29-ec81-45b8-8ea8-36cff729463d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1280 microversion: 2.1 time: 0.091792 Oct 10 11:25:43.582374 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3247/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:43 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:44.570650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3d9221-f6f9-495d-94b3-f050b4f0f0a8", "tag": "d55bde3d-8a8d-48c3-ae9a-c369a45fc556"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:44.588643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:44.589126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:44.589564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:44.603066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] Creating event network-changed:d55bde3d-8a8d-48c3-ae9a-c369a45fc556 for instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 on n-h2-860687-2 Oct 10 11:25:44.606365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:44.607041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:44.608968 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bff063a3-7020-4b46-a3da-067a98c4ce86 req-43d2b556-5f32-4f65-a6dd-56a1f4daece3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046103 Oct 10 11:25:44.609585 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3148/6395] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:44.614226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:44.614871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:44.615304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:44.616206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:44.616545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:44.616986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:44.756608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:44.764696 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4565892-398f-4aa6-b13f-f1a7f2b16b4d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1322 microversion: 2.1 time: 0.162577 Oct 10 11:25:44.765283 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3248/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:44 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:45.790035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:45.790659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:45.797599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:45.798113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:45.798865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:45.799251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:45.799703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:45.800124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:45.932551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:45.941022 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a39741af-3b9d-4eae-ac7a-318dc73cee00 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1322 microversion: 2.1 time: 0.156375 Oct 10 11:25:45.941595 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3149/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:45 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:46.964157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:46.964819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:46.971767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:46.972263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:46.972709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:46.973458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:46.973922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:46.974359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:47.108174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:47.116195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-656701c5-0379-4f6e-a103-d9628b6e21e7 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1322 microversion: 2.1 time: 0.155905 Oct 10 11:25:47.116772 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3249/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:46 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:48.138467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:48.139119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:48.146365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:48.146851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:48.147313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:48.148009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:48.148466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:48.148893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:48.277957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:48.285543 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb722875-deb5-4510-b628-89532383582d tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1322 microversion: 2.1 time: 0.151031 Oct 10 11:25:48.286362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3150/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:48 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:48.523352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:48.588796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3d9221-f6f9-495d-94b3-f050b4f0f0a8", "name": "network-vif-plugged", "status": "completed", "tag": "d55bde3d-8a8d-48c3-ae9a-c369a45fc556"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:48.598370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:48.599508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:48.600509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:48.611710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] Creating event network-vif-plugged:d55bde3d-8a8d-48c3-ae9a-c369a45fc556 for instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 on n-h2-860687-2 Oct 10 11:25:48.617306 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a9e9b208-ec76-4258-835e-86842f976e52 req-a4bb4a96-d4ef-4cee-9162-f7f0709adc17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098433 Oct 10 11:25:48.617893 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3250/6400] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:49.308786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:49.309343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:49.315949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:49.316443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:49.316893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:49.318170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:49.319140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:49.319577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:49.450194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:49.458116 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab0a55e4-1580-4979-8e97-c18b47b287c2 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1322 microversion: 2.1 time: 0.153178 Oct 10 11:25:49.459327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3151/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:49 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:50.483167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:50.483802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:50.490047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:50.490543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:50.491006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:50.491721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:50.492188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:50.492627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:50.623257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:50.631582 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4ec8e12-76d0-486c-a3cf-3d5f84d11775 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1472 microversion: 2.1 time: 0.153656 Oct 10 11:25:50.632212 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3251/6402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:50 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:50.657039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:25:50.711509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-993e3f37-2d44-406e-bfb4-4feb2d85876b tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '.version_select at 0x7f6777854b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:50.779990 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-993e3f37-2d44-406e-bfb4-4feb2d85876b tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/021827842ddb42958415f56f3d1729e9" status: 200 len: 371 microversion: 2.1 time: 0.127564 Oct 10 11:25:50.780560 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3152/6403] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 11:25:50 2022] GET /compute/v2.1/os-quota-sets/021827842ddb42958415f56f3d1729e9 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:50.794101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9631eb6f-c795-4a4a-9ad3-80c92e817e5a tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2097958531", "id": 692682739, "os-flavor-access:is_public": "True"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:50.812297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9631eb6f-c795-4a4a-9ad3-80c92e817e5a tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023067 Oct 10 11:25:50.812883 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3252/6404] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:25:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:50.825025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "692682739"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:50.827321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:50.833693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:50.834234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:50.834675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:50.835410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:50.835908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:50.836335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.020342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a5bf5722e0ae4a28ac725a769e5bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021827842ddb42958415f56f3d1729e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:51.028454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2097958531 {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:25:51.035269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.035749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.036300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.037728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.038179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.038599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.060265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Getting quotas for project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:25:51.065287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Getting quotas for user 8de141202e1c4e359095898564f49609 and project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:25:51.077318 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] ram quota exceeded for 021827842ddb42958415f56f3d1729e9, tried to resize instance. Oct 10 11:25:51.077854 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Request method failure captured: Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action HTTP/1.1 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 38 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAEx9kqq7ymkmKfjXSv2Bh6c_3rlbqffjHNJG54VbLQj8kjpmHedbaIK6qa7AkSONwQ_uCvMyVwE1rrqZfMYyyxUAOcxJ7obMvbQYqDHbIOTCv1WhviNuY2Nxw2gelx8fJMbnjUdvUwcseIWF64ql9_hFlFfR8H1Jg7ymn5dzQgmE0M Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 021827842ddb42958415f56f3d1729e9 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Role: admin,member,reader Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: admin,member,reader Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021827842ddb42958415f56f3d1729e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_021827842ddb42958415f56f3d1729e9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021827842ddb42958415f56f3d1729e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/021827842ddb42958415f56f3d1729e9"}]}] Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 021827842ddb42958415f56f3d1729e9 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1267030911-project-admin Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: a5bf5722e0ae4a28ac725a769e5bf278 Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1267030911-project-admin Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: {"resize": {"flavorRef": "692682739"}} Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7d3d9221-f6f9-495d-94b3-f050b4f0f0a8', 'body': {'resize': {'flavorRef': '692682739'}}} Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.085531 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fea2eda-cf59-4477-a9a7-a738b8a206de tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action" status: 403 len: 118 microversion: 2.1 time: 0.265980 Oct 10 11:25:51.090719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3153/6405] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:25:50 2022] POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action => generated 118 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:25:51.101058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1f6556ad-b04d-4006-85ad-4f921e6932c0 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.117710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1f6556ad-b04d-4006-85ad-4f921e6932c0 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/692682739" status: 202 len: 0 microversion: 2.1 time: 0.022488 Oct 10 11:25:51.118531 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3253/6406] 10.222.0.16 () {58 vars in 1158 bytes} [Mon Oct 10 11:25:51 2022] DELETE /compute/v2.1/flavors/692682739 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:25:51.126481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-506cff7b-e868-4e3a-aa2b-074683f72c67 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.146574 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-506cff7b-e868-4e3a-aa2b-074683f72c67 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023705 Oct 10 11:25:51.147158 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3154/6407] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 11:25:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:51.167771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26f01ad4-d8f9-4574-a420-0cde119d2070 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '.version_select at 0x7f6777aa8550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.238046 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26f01ad4-d8f9-4574-a420-0cde119d2070 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/021827842ddb42958415f56f3d1729e9" status: 200 len: 371 microversion: 2.1 time: 0.073870 Oct 10 11:25:51.238611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3254/6408] 10.222.0.16 () {58 vars in 1242 bytes} [Mon Oct 10 11:25:51 2022] GET /compute/v2.1/os-quota-sets/021827842ddb42958415f56f3d1729e9 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:51.250349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b2ed61c-48fe-48f4-9239-30c33e1d410a tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1065883734", "id": 1134130922, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:51.267887 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b2ed61c-48fe-48f4-9239-30c33e1d410a tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021320 Oct 10 11:25:51.268447 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3155/6409] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:25:51 2022] POST /compute/v2.1/flavors => generated 437 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:51.281260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1134130922"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:51.283638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:51.290562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.291173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.291637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.292352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.292846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.293295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.381593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a5bf5722e0ae4a28ac725a769e5bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021827842ddb42958415f56f3d1729e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:51.387868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1065883734 {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:25:51.396412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.396916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.397369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.398122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.398630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.399094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.421079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Getting quotas for project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:25:51.426097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Getting quotas for user 8de141202e1c4e359095898564f49609 and project 200a16bcf0044cfc84c3f876086a1ea1. Resources: {'ram', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:25:51.440632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.compute.api [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] cores quota exceeded for 021827842ddb42958415f56f3d1729e9, tried to resize instance. Oct 10 11:25:51.441190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Request method failure captured: Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action HTTP/1.1 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 39 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAEx9kqq7ymkmKfjXSv2Bh6c_3rlbqffjHNJG54VbLQj8kjpmHedbaIK6qa7AkSONwQ_uCvMyVwE1rrqZfMYyyxUAOcxJ7obMvbQYqDHbIOTCv1WhviNuY2Nxw2gelx8fJMbnjUdvUwcseIWF64ql9_hFlFfR8H1Jg7ymn5dzQgmE0M Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 021827842ddb42958415f56f3d1729e9 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Role: admin,member,reader Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: admin,member,reader Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021827842ddb42958415f56f3d1729e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_021827842ddb42958415f56f3d1729e9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/021827842ddb42958415f56f3d1729e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/021827842ddb42958415f56f3d1729e9"}]}] Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 021827842ddb42958415f56f3d1729e9 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1267030911 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-1267030911-project-admin Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: a5bf5722e0ae4a28ac725a769e5bf278 Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1267030911-project-admin Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: {"resize": {"flavorRef": "1134130922"}} Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7d3d9221-f6f9-495d-94b3-f050b4f0f0a8', 'body': {'resize': {'flavorRef': '1134130922'}}} Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.444038 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73f40fc9-143a-4bb3-bcc1-aa3b064be958 tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action" status: 403 len: 113 microversion: 2.1 time: 0.168091 Oct 10 11:25:51.447726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3255/6410] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:25:51 2022] POST /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:25:51.454776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ab26b62-3b1f-4d47-814c-b2299854792b tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.472937 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ab26b62-3b1f-4d47-814c-b2299854792b tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1134130922" status: 202 len: 0 microversion: 2.1 time: 0.022004 Oct 10 11:25:51.473506 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3156/6411] 10.222.0.16 () {58 vars in 1161 bytes} [Mon Oct 10 11:25:51 2022] DELETE /compute/v2.1/flavors/1134130922 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:25:51.481410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1d63c36e-eda1-4b68-9540-2505c9a3139f tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.502060 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1d63c36e-eda1-4b68-9540-2505c9a3139f tempest-ServersAdminNegativeTestJSON-1267030911 tempest-ServersAdminNegativeTestJSON-1267030911-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024199 Oct 10 11:25:51.502706 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3256/6412] 10.222.0.16 () {58 vars in 1146 bytes} [Mon Oct 10 11:25:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:51.524063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.524644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:51.530651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.531166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.531603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.532283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.532737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.533157 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.557482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:25:51.635267 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ff82bf6-a310-44e5-8818-8db327ba338c tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 204 len: 0 microversion: 2.1 time: 0.115403 Oct 10 11:25:51.635897 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3157/6413] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:25:51 2022] DELETE /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:25:51.644374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:51.645043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:51.651974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.652482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.652943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.653658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:51.654140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:51.654588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:51.784519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:51.792525 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-794080da-bf10-42ee-af19-e05b4e5f5c72 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1478 microversion: 2.1 time: 0.152081 Oct 10 11:25:51.793103 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3257/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:51 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1478 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:25:52.817250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:52.819141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:52.825947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:52.826432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:52.826867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:52.827599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:52.828052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:52.828475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:52.963320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:52.971139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81c585cd-434f-44ac-af71-ae1c2098342e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1478 microversion: 2.1 time: 0.159192 Oct 10 11:25:52.972001 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3158/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:52 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:53.394280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3d9221-f6f9-495d-94b3-f050b4f0f0a8", "name": "network-vif-deleted", "tag": "d55bde3d-8a8d-48c3-ae9a-c369a45fc556"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:25:53.406661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:53.407941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:53.407941 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:53.421575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] Creating event network-vif-deleted:d55bde3d-8a8d-48c3-ae9a-c369a45fc556 for instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 on n-h2-860687-2 Oct 10 11:25:53.426431 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bee51516-8d5d-4ae7-8129-dcf139374886 req-eb583157-4e80-46fb-8aa4-f50a03877b3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035816 Oct 10 11:25:53.427603 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3258/6416] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:25:53.995082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:53.995634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:54.002570 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:54.003097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:54.003561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:54.004282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:54.004740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:54.005458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:54.039622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:54.040240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:54.040801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:54.041385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lazy-loading 'fault' on Instance uuid 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:25:54.085289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de141202e1c4e359095898564f49609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200a16bcf0044cfc84c3f876086a1ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:25:54.093122 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93e7329d-6694-4786-b4df-079094d0076e tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 200 len: 1312 microversion: 2.1 time: 0.102005 Oct 10 11:25:54.093699 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3159/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:53 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:25:55.119319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:25:55.120036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] [instance: 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:25:55.126224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:55.126730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:55.127238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:55.127951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:25:55.128424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:25:55.128862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:25:55.143355 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] HTTP exception thrown: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Request method failure captured: Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 HTTP/1.1 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAEwNo10zMk2QBMoZfHKyH2dndEKUmMWFUTRZIQpNt2HJfhotAhnlDYPKB4wNtQsLNkNQbUgnpvpExCsjrB7Nz8WS00uHpVGzqphJgkQzaicuwNPHedQnr3NX-dWsL-3mN37J7XYLxqElckWKu_apbglrbddzZT5RqUtKK16818dNDo Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 200a16bcf0044cfc84c3f876086a1ea1 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-753059808 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/200a16bcf0044cfc84c3f876086a1ea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_200a16bcf0044cfc84c3f876086a1ea1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/200a16bcf0044cfc84c3f876086a1ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/200a16bcf0044cfc84c3f876086a1ea1"}]}] Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersAdminNegativeTestJSON-753059808 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 200a16bcf0044cfc84c3f876086a1ea1 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-753059808 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersAdminNegativeTestJSON-753059808-project Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 8de141202e1c4e359095898564f49609 Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersAdminNegativeTestJSON-753059808-project Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '7d3d9221-f6f9-495d-94b3-f050b4f0f0a8'} Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:55.145005 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] Returning 404 to user: Instance 7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-579dd395-b9ce-47b6-84c9-ea0b97bb5726 tempest-ServersAdminNegativeTestJSON-753059808 tempest-ServersAdminNegativeTestJSON-753059808-project] 10.222.0.16 "GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8" status: 404 len: 111 microversion: 2.1 time: 0.033226 Oct 10 11:25:55.148901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3259/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:25:55 2022] GET /compute/v2.1/servers/7d3d9221-f6f9-495d-94b3-f050b4f0f0a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:26:01.218369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:01.219290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:01.338949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-285473879", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "c985ed02-30d8-449d-aeb0-ef3ed05b7b86"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:01.397819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] validate_networks() for [('c985ed02-30d8-449d-aeb0-ef3ed05b7b86', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:26:01.771307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:26:01.771734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:26:01.772210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:26:01.772621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:26:01.773034 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:26:01.781905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:01.782389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:01.782827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:01.783602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:01.784062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:01.784492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:01.801248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Getting quotas for project 95ae51d4eb82467f84aad9f1ebe68ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:26:01.807480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Getting quotas for user 7a95306837694d838102d6ac6e9ec048 and project 95ae51d4eb82467f84aad9f1ebe68ab9. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:26:01.820383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:26:01.822674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:26:01.866771 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:26:02.880706 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40564. Oct 10 11:26:02.885057 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5d8b81a-830b-4ae6-9bad-207f76ab76e0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672162 Oct 10 11:26:02.885780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3160/6419] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:26:02.897665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e8d380c4-0124-4cfa-ad25-542b7d0560f1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:02.898374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e8d380c4-0124-4cfa-ad25-542b7d0560f1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:02.901310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:02.902693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:02.955685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e8d380c4-0124-4cfa-ad25-542b7d0560f1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:02.964130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e8d380c4-0124-4cfa-ad25-542b7d0560f1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1214 microversion: 2.1 time: 0.071000 Oct 10 11:26:02.964709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3260/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:02 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:03.987858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2cc4eda-1b5e-4786-8fb2-b86aa51e5eb2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:03.989146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2cc4eda-1b5e-4786-8fb2-b86aa51e5eb2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:04.043018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2cc4eda-1b5e-4786-8fb2-b86aa51e5eb2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:04.050213 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2cc4eda-1b5e-4786-8fb2-b86aa51e5eb2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1214 microversion: 2.1 time: 0.067027 Oct 10 11:26:04.050736 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3161/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:03 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:05.074380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5396de54-decb-40bd-8370-fe58b2daba1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:05.075016 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5396de54-decb-40bd-8370-fe58b2daba1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:05.130615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5396de54-decb-40bd-8370-fe58b2daba1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:05.134290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=51 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:05.139102 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5396de54-decb-40bd-8370-fe58b2daba1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1214 microversion: 2.1 time: 0.069364 Oct 10 11:26:05.139766 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3261/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:05 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:06.164102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8886212a-3b2c-4a8e-b896-5830d3c3620e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:06.164749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8886212a-3b2c-4a8e-b896-5830d3c3620e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:06.225302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8886212a-3b2c-4a8e-b896-5830d3c3620e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:06.232390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8886212a-3b2c-4a8e-b896-5830d3c3620e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1214 microversion: 2.1 time: 0.072963 Oct 10 11:26:06.232963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3162/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:06 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:07.256493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:07.257130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:07.263738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:07.264241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:07.264698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:07.265410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:07.265885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:07.266330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:07.326152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:07.334533 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e521203d-5780-44c1-9366-97df25b2ef5b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1218 microversion: 2.1 time: 0.082343 Oct 10 11:26:07.335119 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3262/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:07 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:08.358040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:08.358843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:08.361281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:08.367465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:08.367960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:08.368400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:08.369102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:08.369555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:08.369981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:08.374925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:08.438042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:08.446396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-550b5f96-da6e-4491-963b-f90e2fe91aef tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1272 microversion: 2.1 time: 0.092592 Oct 10 11:26:08.447111 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3163/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:08 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:09.469890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:09.470633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:09.473851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:09.479419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:09.479934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:09.480398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:09.481128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:09.481607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:09.482055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:09.548849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:09.560629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:09.561540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:09.562234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:09.580868 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] Creating event network-changed:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h2-860687-2 Oct 10 11:26:09.587939 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f6ce96dd-ab78-428b-bd5c-f1f95d4c886b req-d911bd03-6ced-400f-92ef-e0c4a52bb402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044479 Oct 10 11:26:09.588992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3164/6426] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:26:09.623831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:09.632610 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8797f80d-34b0-410f-a2ef-823f5b82999e tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.166472 Oct 10 11:26:09.633018 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3263/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:09 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:10.656342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:10.657211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:10.664379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:10.664867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:10.665309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:10.665996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:10.666457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:10.666885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:10.803579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:10.811338 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e770d53-030f-40da-8e10-9ef62d8b294f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.160004 Oct 10 11:26:10.812213 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3165/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:10 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:11.834005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:11.834900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:11.841875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:11.842380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:11.842839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:11.843582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:11.844062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:11.844508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:11.973238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:11.981813 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-062de19d-8c87-4584-91ba-acf9d5f57090 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.151973 Oct 10 11:26:11.982390 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3264/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:11 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:13.004676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:13.005285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:13.008998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:13.014429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:13.014917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:13.015393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:13.016081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:13.016539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:13.016965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:13.146806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:13.154625 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a085541-d3d2-4d11-b498-9f54d8afb080 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.153793 Oct 10 11:26:13.155232 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3166/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:12 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:14.178088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:14.178629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:14.185561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:14.186054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:14.186503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:14.187236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:14.187709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:14.188146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:14.315899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:14.324515 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-407e266e-4e35-48dd-891b-aa0a65d2d7e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.150435 Oct 10 11:26:14.325080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3265/6431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:14 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:14.648686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "name": "network-vif-plugged", "status": "completed", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:14.660417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:14.660907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:14.661343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:14.673579 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] Creating event network-vif-plugged:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h2-860687-2 Oct 10 11:26:14.679879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-af747090-4e1c-4a3f-8288-0698639c5f0b req-cde392cf-c82d-42f8-bf7b-767809c59d13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035007 Oct 10 11:26:14.680643 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3167/6432] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:26:15.347108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:15.347747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:15.349604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:15.356924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:15.357211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:15.357666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:15.358386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:15.358860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:15.359327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:15.492976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:15.500624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a4c5d44-6619-451f-9e3e-1b9e8be28313 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1314 microversion: 2.1 time: 0.157475 Oct 10 11:26:15.501414 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3266/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:15 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:16.524974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:16.525665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:16.528847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:16.534453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.534934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.535392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:16.536075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.536530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.536954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:16.665992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:16.673762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bcb3c89-2368-4098-8b21-dc4d159e9fc2 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1501 microversion: 2.1 time: 0.153790 Oct 10 11:26:16.674337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3168/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:16 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:16.696108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:16.698373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:16.705215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.705717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.706176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:16.706889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.707399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.708106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:16.737081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:16.742509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Old instance type m1.heat2, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:26:16.749097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:26:16.749539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:26:16.750035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:26:16.750471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:26:16.750903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:26:16.815974 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc8e6d8f-c4bc-49c3-b100-c4b21ae72a5a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "POST /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3/action" status: 202 len: 0 microversion: 2.1 time: 0.123738 Oct 10 11:26:16.816544 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3267/6435] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:26:16 2022] POST /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:26:16.825196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:16.826213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:16.832178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.832665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.833352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:16.834536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:16.835023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:16.835441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:17.004691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:17.013190 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5ff4672-c03c-4923-b5ca-1f333cbad97f tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1510 microversion: 2.1 time: 0.192089 Oct 10 11:26:17.013787 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3169/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:16 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:26:18.037912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:18.038558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:18.045517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:18.046033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:18.046496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:18.047246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:18.047730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:18.048183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:18.184682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:18.192393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d8bfdc38-ea58-4085-9a9b-9af484f0952d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1510 microversion: 2.1 time: 0.159860 Oct 10 11:26:18.192962 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3268/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:18 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:19.215787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:19.216406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:19.223317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:19.223835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:19.224273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:19.224968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:19.225459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:19.225891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:19.357278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:19.367409 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a98e94fb-61cb-4bcf-a9f7-757034359988 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.155493 Oct 10 11:26:19.367997 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3170/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:19 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:20.392811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:20.393443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:20.400837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:20.401340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:20.401794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:20.402502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:20.402976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:20.403441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:20.533126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:20.541591 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8bf7d099-69a1-461a-98cd-633f1d65db1a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.152738 Oct 10 11:26:20.542164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3269/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:20 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:21.564819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:21.565439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:21.573383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:21.573872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:21.574320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:21.575031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:21.575494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:21.575920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:21.709691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:21.717507 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3b93136-3c62-4abb-9c63-be55d2db7a10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.156668 Oct 10 11:26:21.718096 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3171/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:21 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:22.741194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:22.741824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:22.748796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:22.749300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:22.749757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:22.750464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:22.750942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:22.751417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:22.879927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:22.888159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a5d4e10e-656d-478b-961d-d404aa70481d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.150958 Oct 10 11:26:22.888959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3270/6441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:22 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:23.912424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:23.913099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:23.919951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:23.920435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:23.920869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:23.921549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:23.922000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:23.922426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:24.058094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:24.065728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-396720ef-b32a-4d30-b422-f10d930d0b8b tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.157680 Oct 10 11:26:24.066299 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3172/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:23 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:25.088813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:25.089437 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:25.096316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:25.096812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:25.097270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:25.097960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:25.098426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:25.098862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:25.234907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:25.243453 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6655f64a-3564-4b09-b706-a584701db212 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.158581 Oct 10 11:26:25.244027 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3271/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:25 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:26.265748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:26.266354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:26.273290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:26.273775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:26.274207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:26.274888 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:26.275368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:26.275794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:26.404086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:26.411906 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d323c33-91ae-45e2-8424-0fa42138a63c tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.150055 Oct 10 11:26:26.412473 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3173/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:26 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:27.434870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:27.435526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:27.443012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:27.443523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:27.444698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:27.445413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:27.445883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:27.446326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:27.576559 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:27.585107 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97b89e59-08f6-4b22-b06f-6dc049fb4b28 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.153589 Oct 10 11:26:27.585657 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3272/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:27 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:28.607763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:28.608373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:28.615671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:28.616352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:28.616794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:28.617480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:28.617934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:28.618363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:28.746906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:28.754730 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2819b54d-f0e1-4b97-ba70-1e3d620c3472 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.150854 Oct 10 11:26:28.755339 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3174/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:28 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:29.777629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:29.778158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:29.784857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:29.785354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:29.785801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:29.786499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:29.786974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:29.787928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:29.920725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:29.929274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-22d1f9cc-3229-4fb5-a86e-eefc1860f724 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.154733 Oct 10 11:26:29.929860 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3273/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:29 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:30.952391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:30.953011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:30.960860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:30.961350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:30.961793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:30.962485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:30.962945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:30.963399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:31.090316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:31.098039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c79de6e-10f3-4a99-a31f-0ed2d933c734 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.149558 Oct 10 11:26:31.098615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3175/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:30 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:32.120198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:32.120838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:32.127764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:32.128272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:32.128739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:32.129452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:32.129931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:32.130378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:32.263588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:32.271246 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a26c8efc-bcc5-4425-b1ff-8ef670482c52 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.154963 Oct 10 11:26:32.271854 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3274/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:32 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:26:33.294890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:33.295538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:33.302297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:33.302774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:33.303376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:33.304177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:33.304632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:33.305058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:33.433205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:33.440841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ddb4f54-3895-49b0-8402-929d9c23a1b1 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.149830 Oct 10 11:26:33.441409 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3176/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:33 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:34.465111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:34.465743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:34.472590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:34.473093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:34.473548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:34.474254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:34.474726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:34.475826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:34.604316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:34.612014 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-63092daa-1a1c-4e2a-a07e-306b19d3bbcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.150902 Oct 10 11:26:34.612583 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3275/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:34 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:35.634648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:35.635249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:35.642150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:35.642631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:35.643093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:35.643782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:35.644237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:35.644659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:35.775354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:35.783108 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e7e09ba-31a3-4d48-8066-ab70485a1448 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.152439 Oct 10 11:26:35.783680 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3177/6452] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:35 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:36.806865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:36.807536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:36.814013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:36.814514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:36.814961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:36.815685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:36.816158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:36.816599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:36.944768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:36.952493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c160d946-2ee0-492a-a570-b03a668bec5d tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.150730 Oct 10 11:26:36.953080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3276/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:36 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:37.975910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:37.976548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:37.983371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:37.983841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:37.984272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:37.984961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:37.985407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:37.985830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:38.128123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:38.138628 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f954fef7-94a6-4604-8a29-b34ecfb318aa tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.166739 Oct 10 11:26:38.139328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3178/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:37 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:39.164057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:39.164720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:39.171728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:39.172240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:39.172698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:39.173416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:39.173893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:39.174350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:39.178868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:39.305246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:39.313082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1092d8bd-617b-4b48-8064-e38c396149e8 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.153068 Oct 10 11:26:39.313668 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3277/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:39 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:40.337441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:40.338078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:40.340584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:40.345991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:40.346477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:40.346914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:40.347629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:40.348091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:40.348518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:40.351209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=88 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:40.479115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:40.486770 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cff3df4-4eba-42fd-9c8d-0180f3035fa0 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.154109 Oct 10 11:26:40.487368 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3179/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:40 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:41.509776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:41.510405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:41.513101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=34 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:26:41.518739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:41.519289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:41.519747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:41.520468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:41.520957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:41.521399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:41.654363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:41.662661 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc46441c-76c8-4d3f-8848-f9b53df5e2e7 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.156527 Oct 10 11:26:41.662941 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3278/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:41 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:42.685371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:42.685981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:42.692769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:42.693251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:42.693880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:42.694583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:42.695056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:42.695484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:42.830657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:42.839654 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c6158fb-f392-4002-8ee9-2decde82a657 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.158173 Oct 10 11:26:42.840223 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3180/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:42 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:43.863406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:43.864076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:43.871682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:43.872190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:43.872680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:43.873391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:43.873873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:43.874320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:44.004976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:44.013449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-29be15d8-a5ab-4a71-8c10-f4b910aaa297 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.153918 Oct 10 11:26:44.014030 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3279/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:43 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:45.038374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:45.038985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:45.045692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:45.046175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:45.046617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:45.047327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:45.047787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:45.048216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:45.178742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:45.186487 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f4ddb9a-871e-46b3-94fa-fb0d3d577d84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1515 microversion: 2.1 time: 0.152604 Oct 10 11:26:45.187079 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3181/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:45 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:46.209755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:46.210383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:46.219640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:46.220154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:46.220611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:46.221332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:46.222813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:46.222813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:46.275590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "name": "network-vif-unplugged", "status": "completed", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:46.293592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:46.294086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:46.294525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:46.317087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Creating event network-vif-unplugged:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h1-860687-2 Oct 10 11:26:46.322764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:26:46.334373 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b2db96f6-70e4-4595-8a2b-749604c6e5af req-69c06629-bc7d-42e7-a2c6-24fcb6bb2fa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062438 Oct 10 11:26:46.335272 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3182/6461] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:26:46.390643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:46.399113 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4942b892-bd41-40ad-9bdb-c3201afbc5ff tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1514 microversion: 2.1 time: 0.193468 Oct 10 11:26:46.399967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3280/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:46 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:47.423646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:47.424281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:47.430877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:47.431397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:47.431836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:47.432528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:47.432984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:47.433419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:47.563836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:47.572308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-318fd6f1-0bc2-4884-b7e4-994def475a84 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1512 microversion: 2.1 time: 0.153898 Oct 10 11:26:47.572883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3183/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:47 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:48.350923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:48.361274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:48.361764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:48.362208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:48.373615 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Creating event network-changed:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h1-860687-2 Oct 10 11:26:48.378913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:26:48.390261 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ff76189a-9e9b-4c4c-b7a6-314f492a0ce7 req-94df0da7-d981-4857-a48a-30df9203ed2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043084 Oct 10 11:26:48.390851 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3281/6464] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:26:48.596435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:48.597049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:48.605768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:48.606274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:48.607054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:48.607467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:48.607918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:48.608332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:48.767471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:48.775791 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-770f9e0c-55c1-4014-854a-1c5ab70ef004 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1512 microversion: 2.1 time: 0.183501 Oct 10 11:26:48.776373 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3184/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:48 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:49.801536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:49.802260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:49.808702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:49.809208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:49.809666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:49.810376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:49.810854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:49.811329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:49.947982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:49.955673 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-732552e7-306c-4300-8cfe-2b552222dfcd tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1509 microversion: 2.1 time: 0.159534 Oct 10 11:26:49.956258 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3282/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:49 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:49.978581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:49.979137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:49.985950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:49.986440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:49.986896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:49.987612 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:49.988074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:49.988504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:50.014608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:26:50.064522 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Found an unconfirmed migration during delete, id: 16, status: finished Oct 10 11:26:51.289177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "name": "network-vif-plugged", "status": "completed", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:51.301276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:51.301774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:51.302203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:51.314048 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] Creating event network-vif-plugged:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h1-860687-2 Oct 10 11:26:51.319968 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-75fe4212-526f-471e-a903-d9a887a19f65 req-d3c16d74-816b-484e-a01f-066ff532a6c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035500 Oct 10 11:26:51.320583 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3283/6467] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:26:51.377595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ef9a4cb-4f9f-493d-861e-77d3a19cb32a tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 204 len: 0 microversion: 2.1 time: 1.402464 Oct 10 11:26:51.378779 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3185/6468] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:26:49 2022] DELETE /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 0 bytes in 1405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:26:51.388257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:51.389050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:51.395341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:51.395839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:51.396288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:51.397963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:51.398819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:51.399397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:51.527516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:51.535433 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-776d32f7-c2ab-4511-bbd8-397282d41137 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1501 microversion: 2.1 time: 0.151413 Oct 10 11:26:51.536039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3284/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:51 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:52.560468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:52.561086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:52.567979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:52.569298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:52.569768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:52.570492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:52.570959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:52.571487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:52.704911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a95306837694d838102d6ac6e9ec048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ae51d4eb82467f84aad9f1ebe68ab9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:26:52.713924 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-699f982f-3f83-41de-9bdd-8016ad426cb4 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 200 len: 1501 microversion: 2.1 time: 0.157729 Oct 10 11:26:52.714496 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3186/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:52 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:26:53.241892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96cebfe8-5788-46a2-a881-a0ac02c28ab3", "name": "network-vif-deleted", "tag": "e2fbe04d-a068-46ab-8f96-74ae7ae465b4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:26:53.255488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.256699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.257667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.271401 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] Creating event network-vif-deleted:e2fbe04d-a068-46ab-8f96-74ae7ae465b4 for instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 on n-h1-860687-2 Oct 10 11:26:53.277249 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f7daf9a8-7027-4006-8f95-498913e1fb56 req-a7e17251-94d0-488b-9bff-deb5cbe3038f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039720 Oct 10 11:26:53.278004 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3285/6471] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:26:53.738761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:53.739484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:53.747266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.747853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.748359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.749123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.749581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.750002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.764253 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] HTTP exception thrown: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Request method failure captured: Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 HTTP/1.1 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAFJ55GY3KL2reqXgeltJpOQQUxVhAQjCiG9R7SFJdRa5Q0wOL0zki6WxaLAfHa5OC6sAVr1rWEIRSSpPe98qa0_9vcKslfcZc2bKDqgRU1Vhz6iFgyR6fU44YzyBvYeEC7B5kGDGEEmIYsM3WmYveUmRxAwa9wyUEVBvrsND7rMiyk Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95ae51d4eb82467f84aad9f1ebe68ab9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95ae51d4eb82467f84aad9f1ebe68ab9"}]}] Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7a95306837694d838102d6ac6e9ec048 Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '96cebfe8-5788-46a2-a881-a0ac02c28ab3'} Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.765895 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Returning 404 to user: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-224846d3-17c6-4496-bd14-ec6f758adbc6 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 404 len: 111 microversion: 2.1 time: 0.032511 Oct 10 11:26:53.770202 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3187/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:53 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:26:53.784022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:53.784615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:53.791385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.791909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.792354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.793053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.793521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.793959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.807683 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] HTTP exception thrown: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Request method failure captured: Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 HTTP/1.1 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAFJ55GY3KL2reqXgeltJpOQQUxVhAQjCiG9R7SFJdRa5Q0wOL0zki6WxaLAfHa5OC6sAVr1rWEIRSSpPe98qa0_9vcKslfcZc2bKDqgRU1Vhz6iFgyR6fU44YzyBvYeEC7B5kGDGEEmIYsM3WmYveUmRxAwa9wyUEVBvrsND7rMiyk Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95ae51d4eb82467f84aad9f1ebe68ab9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95ae51d4eb82467f84aad9f1ebe68ab9"}]}] Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 7a95306837694d838102d6ac6e9ec048 Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '96cebfe8-5788-46a2-a881-a0ac02c28ab3'} Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:26:53.809318 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Returning 404 to user: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80947310-8ccd-4f6a-9867-21e9bd6346bb tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 404 len: 111 microversion: 2.1 time: 0.030866 Oct 10 11:26:53.813677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3286/6473] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:26:53 2022] DELETE /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:26:53.819067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:26:53.819682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] [instance: 96cebfe8-5788-46a2-a881-a0ac02c28ab3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:26:53.825561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.826040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.826473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.827181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:26:53.827636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:26:53.828059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:26:53.841559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] HTTP exception thrown: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Request method failure captured: Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 HTTP/1.1 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAFJ55GY3KL2reqXgeltJpOQQUxVhAQjCiG9R7SFJdRa5Q0wOL0zki6WxaLAfHa5OC6sAVr1rWEIRSSpPe98qa0_9vcKslfcZc2bKDqgRU1Vhz6iFgyR6fU44YzyBvYeEC7B5kGDGEEmIYsM3WmYveUmRxAwa9wyUEVBvrsND7rMiyk Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95ae51d4eb82467f84aad9f1ebe68ab9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95ae51d4eb82467f84aad9f1ebe68ab9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95ae51d4eb82467f84aad9f1ebe68ab9"}]}] Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 95ae51d4eb82467f84aad9f1ebe68ab9 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-804601499 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 7a95306837694d838102d6ac6e9ec048 Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-804601499-project Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '96cebfe8-5788-46a2-a881-a0ac02c28ab3'} Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:26:53.843069 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] Returning 404 to user: Instance 96cebfe8-5788-46a2-a881-a0ac02c28ab3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a2391eb-c30c-4621-9439-567084ae3f10 tempest-DeleteServersTestJSON-804601499 tempest-DeleteServersTestJSON-804601499-project] 10.222.0.16 "GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3" status: 404 len: 111 microversion: 2.1 time: 0.029307 Oct 10 11:26:53.846983 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3188/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:26:53 2022] GET /compute/v2.1/servers/96cebfe8-5788-46a2-a881-a0ac02c28ab3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:27:02.477668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-312635246", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "dade1a1b-d785-4f10-9f9d-9793528a73ec"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:02.563219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] validate_networks() for [('dade1a1b-d785-4f10-9f9d-9793528a73ec', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:27:03.032020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:27:03.032633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:27:03.033278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:27:03.033849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:27:03.034281 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:27:03.047895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:03.048399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:03.048854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:03.049602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:03.050075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:03.050519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:03.067247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for project 3aa188c17f2648f78cd4452678c72c07. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:27:03.076232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for user 12192b37d6954012a0d611480ead1fc6 and project 3aa188c17f2648f78cd4452678c72c07. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:27:03.091482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:27:03.093970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:27:03.140650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc80af49-86cb-4364-afac-51cb0dd921ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839129 Oct 10 11:27:03.141294 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3287/6475] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:27:03.154653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db08fc62-4021-40c9-836b-24101a57ab9c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:03.155419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db08fc62-4021-40c9-836b-24101a57ab9c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:03.218747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db08fc62-4021-40c9-836b-24101a57ab9c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:03.229298 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db08fc62-4021-40c9-836b-24101a57ab9c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1217 microversion: 2.1 time: 0.079755 Oct 10 11:27:03.229887 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3189/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:03 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:04.253629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:04.254259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:04.261793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:04.262589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:04.262735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:04.263692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:04.264446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:04.265126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:04.346337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:04.358051 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02efe45b-bdf8-4076-86f6-adf255af5f58 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1269 microversion: 2.1 time: 0.108603 Oct 10 11:27:04.372939 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3288/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:04 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:05.384916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:05.385552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:05.391375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:05.397329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:05.398027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:05.398475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:05.399220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:05.399685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:05.400113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:05.548257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:05.558516 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4995f13-45aa-46fb-b9c3-453919e63d09 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.178359 Oct 10 11:27:05.559775 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3190/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:05 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:05.776266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:05.792671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:05.793448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:05.794088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:05.809632 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] Creating event network-changed:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h2-860687-2 Oct 10 11:27:05.814798 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f0668a75-6839-4778-80e6-091185beeb0c req-baf7adb8-4b80-4f87-be25-1c6416468935 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042382 Oct 10 11:27:05.815956 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3289/6479] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:06.583433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:06.584976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:06.592166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:06.592656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:06.593084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:06.593771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:06.594220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:06.594641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:06.732921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:06.741115 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f105172-1638-451f-a8b8-b5c5fc6bb81e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.161810 Oct 10 11:27:06.741693 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3191/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:06 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:07.765936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:07.766575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:07.772974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:07.773479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:07.773938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:07.774649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:07.775164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:07.775611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:07.909435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:07.917898 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-325c29bd-eeb0-4157-a130-8369d4cacba7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.157101 Oct 10 11:27:07.918490 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3290/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:07 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:08.941732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:08.942267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:08.948750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:08.949227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:08.949666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:08.950346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:08.950797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:08.951254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:09.079544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:09.088166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6874ba9-ec36-40d0-9350-8c9986f75244 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.150593 Oct 10 11:27:09.088737 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3192/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:08 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:10.111678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:10.112309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:10.119795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:10.120299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:10.120741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:10.121440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:10.121906 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:10.122343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:10.125027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=62 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:10.254229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:10.262233 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2e8766fb-a6a9-4246-9d45-6c3ce5895049 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.154449 Oct 10 11:27:10.262807 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3291/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:10 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:11.284999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:11.285615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:11.288320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:11.293521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:11.294009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:11.294445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:11.295170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:11.295629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:11.296056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:11.430501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:11.438130 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e0c8aee-a47b-46d1-b264-ac7941d8988b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.157047 Oct 10 11:27:11.438949 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3193/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:11 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:12.462380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:12.463474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:12.466377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:12.471872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:12.472374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:12.472825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:12.473530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:12.473995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:12.474432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:12.606458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:12.614140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfa50f9d-d6ff-469d-a001-9976b16b4e66 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.156526 Oct 10 11:27:12.614707 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3292/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:12 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:12.928337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:12.939571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:12.940329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:12.940769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:12.952514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] Creating event network-vif-plugged:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h2-860687-2 Oct 10 11:27:12.957502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3cc8475e-17e7-413b-9aa7-5b67b010f0a8 req-5b32c3c0-bf03-4363-a849-675bfdb9baa1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Oct 10 11:27:12.958393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3194/6486] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:13.636944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:13.637556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:13.640527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:13.641200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:13.646585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:13.647118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:13.647576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:13.648895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:13.649366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:13.649812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:13.785546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:13.793350 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e4d33a0b-9d18-4e60-9bf3-cd826f85ff93 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1317 microversion: 2.1 time: 0.160613 Oct 10 11:27:13.793924 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3293/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:13 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:14.814054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:14.819231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:14.819963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:14.826391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:14.826877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:14.827347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:14.828035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:14.828494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:14.828943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:14.955659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:14.964374 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb1368d1-f5fc-460c-8e93-216606a730cb tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1507 microversion: 2.1 time: 0.151395 Oct 10 11:27:14.964963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3195/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:14 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:14.986610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:14.987270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:14.993943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:14.994451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:14.994910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:14.995652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:14.996127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:14.996576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.128141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:15.135936 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b93f604a-3bc3-4d69-836d-1408ee4a6c5a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1507 microversion: 2.1 time: 0.153052 Oct 10 11:27:15.136515 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3294/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:14 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:15.158156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:15.160607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:15.167487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.167981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.168420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.169117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.169579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.170018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.234747 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3c3bbf0-881f-4284-9b66-b53afe7616b3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "PUT /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1079 microversion: 2.1 time: 0.080365 Oct 10 11:27:15.235423 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3196/6490] 10.222.0.16 () {60 vars in 1256 bytes} [Mon Oct 10 11:27:15 2022] PUT /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:15.254348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:15.254977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:15.261788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.262292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.262747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.263482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.263951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.264393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.394786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:15.403280 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f86d0148-d1a5-4c19-a320-8704d0874f6e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1505 microversion: 2.1 time: 0.152762 Oct 10 11:27:15.403863 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3295/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:15 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:15.425022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:15.425870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:15.432200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.432684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.433117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.433805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.434263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.434684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.567804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:15.576741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe6b0947-c6d0-4b88-876d-2f7c0bab25f6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1505 microversion: 2.1 time: 0.155601 Oct 10 11:27:15.577332 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3197/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:15 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:15.599544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:15.601764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:15.607837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.608339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.608797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.609501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.609975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.610417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.641346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:15.646712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:27:15.654146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:27:15.654581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:27:15.655099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:27:15.655533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:27:15.655958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:27:15.718194 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0f4e1b39-c2e7-47b7-8184-891222ad159f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.122551 Oct 10 11:27:15.718863 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3296/6493] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:27:15 2022] POST /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:27:15.727717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:15.728358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:15.734269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.734755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.735235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.735913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:15.736362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:15.736786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:15.895500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:15.903560 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91f9179d-2bcd-43c4-885d-cf1e38ca4f67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1516 microversion: 2.1 time: 0.180409 Oct 10 11:27:15.904132 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3198/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:15 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:16.927355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:16.928233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:16.936353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:16.936861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:16.937427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:16.938209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:16.938682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:16.939167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:17.072646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:17.095818 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1063c60a-22d1-47af-8d25-9b4e3c246396 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1516 microversion: 2.1 time: 0.172374 Oct 10 11:27:17.096412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3297/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:16 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:18.118243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:18.118852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:18.125658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:18.126135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:18.126568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:18.127270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:18.127721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:18.128139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:18.255850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:18.264323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-382cf8d2-a4ad-49e9-ba13-220342a11638 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.150037 Oct 10 11:27:18.264902 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3199/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:18 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:19.288806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:19.289612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:19.296151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:19.296645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:19.297094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:19.297785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:19.298251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:19.298687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:19.439197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:19.447044 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8736a2ab-7d75-45f2-8f78-5f603d33635d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.162790 Oct 10 11:27:19.447617 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3298/6497] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:19 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:20.471243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:20.471855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:20.478666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:20.479180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:20.479618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:20.480299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:20.480759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:20.481177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:20.608428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:20.616108 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d329756e-38df-4450-8e89-8a5d77743ed1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.148818 Oct 10 11:27:20.617628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3200/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:20 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:21.641449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:21.641976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:21.649785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:21.650288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:21.650745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:21.651500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:21.651976 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:21.652417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:21.784923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:21.792821 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-71c659e8-c610-42a5-b071-f3280fad4e2f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.155485 Oct 10 11:27:21.793406 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3299/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:21 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:22.816385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:22.817015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:22.824140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:22.824631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:22.825109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:22.826096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:22.826681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:22.827271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:22.955328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:22.963345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46486b86-a773-4cc2-ae96-fa9f6ed4dd22 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.150871 Oct 10 11:27:22.963918 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3201/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:22 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:23.986614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:23.987294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:23.994472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:23.994979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:23.995460 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:23.996173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:23.996648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:23.997092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:24.125690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:24.133790 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f6831833-51da-482b-a3a2-b6e71dc58952 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.151074 Oct 10 11:27:24.134353 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3300/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:23 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:25.157323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:25.157937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:25.165544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:25.166027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:25.166469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:25.167192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:25.167654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:25.168078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:25.299495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:25.308079 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-194ed5ff-3ecb-4cc6-993e-8cc719a0292e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.154637 Oct 10 11:27:25.308657 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3202/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:25 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:26.331471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:26.332100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:26.339319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:26.339816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:26.340270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:26.340970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:26.341434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:26.342308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:26.471152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:26.478814 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-486cccc3-4407-4b19-a515-06fc87e561b7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.151252 Oct 10 11:27:26.479412 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3301/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:26 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:27.501600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:27.502211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:27.509767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:27.510258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:27.510695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:27.511411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:27.511871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:27.512298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:27.644230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:27.652450 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-801a953f-5d0a-470b-8f43-373db1e2e4b0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.154735 Oct 10 11:27:27.653028 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3203/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:27 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:28.676196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:28.676826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:28.683791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:28.684284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:28.684729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:28.685434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:28.685898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:28.686335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:28.822384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:28.830041 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8809f97d-95c5-4948-9bf5-497fa9da3685 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.157892 Oct 10 11:27:28.830614 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3302/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:28 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:29.854404 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:29.855060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:29.861938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:29.862426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:29.862862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:29.863581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:29.864042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:29.864469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:29.998177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:30.005992 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d5a6a1b-e46f-4a94-8c75-734ce93f6f60 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.156240 Oct 10 11:27:30.006580 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3204/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:29 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:31.028993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:31.029624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:31.036453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:31.036948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:31.037400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:31.038684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:31.039188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:31.039629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:31.168260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:31.175932 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-04dd6adf-a7ee-4f40-a040-07ae4be6be75 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.150870 Oct 10 11:27:31.176503 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3303/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:31 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:32.200787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:32.201406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:32.208533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:32.209020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:32.209463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:32.210222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:32.210682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:32.211140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:32.395259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:32.403133 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-335d7689-0083-4c48-82ca-d11bedcf2702 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.206284 Oct 10 11:27:32.403712 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3205/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:32 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:33.425714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:33.426341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:33.429324 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:27:33.429479 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:27:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 (ip 10.222.0.16) !!! Oct 10 11:27:33.436647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:33.437147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:33.437596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:33.438303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:33.438769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:33.439239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:33.939207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:33.947068 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0d9b5c5-6376-4fba-9d8f-43e56ec15aea tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.525187 Oct 10 11:27:33.947972 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3304/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:33 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:34.970915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:34.971564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:34.979213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:34.979692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:34.980128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:34.980844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:34.981299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:34.981723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:35.000115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:35.117381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:35.125202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1b3075a-992b-46f4-834d-8e5b9911bc47 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.158501 Oct 10 11:27:35.125785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3206/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:34 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:36.149608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:36.150238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:36.156895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:36.157396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:36.157849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:36.158556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:36.159055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:36.159500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:36.295894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:36.303623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c3d5a29-d434-4070-ad65-b67a6b407882 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.158779 Oct 10 11:27:36.304201 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3305/6511] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:36 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:37.326504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:37.327160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:37.334520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:37.335012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:37.335454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:37.336280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:37.336756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:37.337188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:37.470946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:37.479424 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cec787b-529c-431b-b39a-524b30283bc9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.156718 Oct 10 11:27:37.480007 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3207/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:37 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:38.501484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:38.502111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:38.509733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:38.510234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:38.510690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:38.511444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:38.511923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:38.512369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:38.528358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:38.661679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:38.669485 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-313fdb2b-b74f-413b-bc3e-443ebbd65ff9 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.171937 Oct 10 11:27:38.670060 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3306/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:38 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:39.692757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:39.693272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:39.700784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:39.701274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:39.701712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:39.702399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:39.702856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:39.703309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:39.831465 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:39.839582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-923ad027-3cc9-454e-a30b-031983cf716d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.150939 Oct 10 11:27:39.840162 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3208/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:39 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:40.862403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:40.863044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:40.869895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:40.870390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:40.870836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:40.871565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:40.872031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:40.872468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:40.998702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:41.006442 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9e391a35-b3e4-4371-ad47-7900e3d414ec tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.147983 Oct 10 11:27:41.007035 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3307/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:40 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:42.030101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:42.030722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:42.033472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:42.038825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:42.040015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:42.040530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:42.041300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:42.041767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:42.042472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:42.174482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:42.182741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4aae5026-808c-427a-9314-827bbbc62a4b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.156517 Oct 10 11:27:42.183366 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3209/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:42 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:43.206098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:43.206740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:43.209682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:27:43.215764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:43.216266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:43.216711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:43.217409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:43.217875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:43.218312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:43.348218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:43.356543 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a6e8454-c6fc-4ee8-9864-10a592d24d28 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.154313 Oct 10 11:27:43.357150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3308/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:43 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:44.379795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:44.380406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:44.387062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:44.387546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:44.387982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:44.388664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:44.389115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:44.389533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:44.522857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:44.531166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c96f7f8-1e1c-4441-960b-4ef42eee8a53 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.155377 Oct 10 11:27:44.531733 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3210/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:44 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:45.553972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:45.554632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:45.561573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:45.562078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:45.562528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:45.563258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:45.563732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:45.564165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:45.691632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:45.699979 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44ba38f9-f45b-4f69-bee3-6e497d7fe9e0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.149999 Oct 10 11:27:45.700552 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3309/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:45 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:46.722913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:46.723577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:46.731828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:46.732311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:46.732788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:46.733480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:46.733958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:46.734385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:46.863137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:46.870958 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b31bca2-7b88-44c9-87c2-43d95a321d87 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.151922 Oct 10 11:27:46.871555 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3211/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:46 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:47.894438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:47.895081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:47.902594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:47.903131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:47.903591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:47.904298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:47.904769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:47.905213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:48.037502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:48.045757 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bef93d95-ec79-45df-98bf-6c4fe7c910c5 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.155263 Oct 10 11:27:48.046341 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3310/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:47 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:49.068505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:49.069130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:49.077099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:49.077576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:49.078009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:49.078688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:49.079183 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:49.079608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:49.209043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:49.217202 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb587f57-cf9b-4ce1-ba5d-263d70f88b6a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1521 microversion: 2.1 time: 0.152523 Oct 10 11:27:49.217782 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3212/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:49 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:49.871808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "name": "network-vif-unplugged", "status": "completed", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:49.882331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:49.882786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:49.883295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:49.896073 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Creating event network-vif-unplugged:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h1-860687-2 Oct 10 11:27:49.902189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:27:49.912943 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8da810e3-10b4-4cfb-a0f5-989ffef054ee req-99e66c7e-da84-4702-a2db-f35cdfc1a19d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045204 Oct 10 11:27:49.915496 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3311/6523] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:27:50.241548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:50.242756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:50.250678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:50.251196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:50.251631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:50.252324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:50.252776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:50.253197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:50.399392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:50.407329 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0836b4c-3c6e-42b5-8269-ec0b3472c58d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1520 microversion: 2.1 time: 0.169585 Oct 10 11:27:50.407948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3213/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:50 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:51.432116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:51.432837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:51.439113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:51.439646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:51.440103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:51.440814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:51.441284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:51.441727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:51.573837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:51.581473 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d9fa4f6b-22ed-4b21-a931-14f7957a9d04 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1518 microversion: 2.1 time: 0.154695 Oct 10 11:27:51.582043 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3312/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:51 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:51.929190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:51.940075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:51.940550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:51.940979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:51.952982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Creating event network-changed:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h1-860687-2 Oct 10 11:27:51.958437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:27:51.969338 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a66d3337-1875-4302-b213-c98c6f652d51 req-bf18ec5a-0cad-4f9f-8ebb-95bc610ec5a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043737 Oct 10 11:27:51.969919 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3214/6526] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:52.606131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:52.607023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:52.613911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.614424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.614879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:52.615630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.616105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.616719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:52.755303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:52.767241 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3bb3e60c-cca0-40c1-918d-c7c3621ac888 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1515 microversion: 2.1 time: 0.165804 Oct 10 11:27:52.768080 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3313/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:52 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:52.790702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:52.791270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:52.797438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.797920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.798352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:52.799064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.799518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.800257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:52.859117 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07d6ba5f-1e88-41fc-9dbb-7bbf0b7943fa tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0/action" status: 204 len: 0 microversion: 2.1 time: 0.072612 Oct 10 11:27:52.859784 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3215/6528] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:27:52 2022] POST /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:27:52.867953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:52.868606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:52.874960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.875863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.876412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:52.877332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:52.877803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:52.878462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:53.021174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:53.029535 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96834cae-b22d-48c2-b43c-b850706762f0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1515 microversion: 2.1 time: 0.165379 Oct 10 11:27:53.030460 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3314/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:52 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:54.054367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:54.055208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:54.061983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:54.062538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:54.063075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:54.063824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:54.064346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:54.064837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:54.202493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:54.210629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79609e96-ff1e-40b2-b515-014bfe921997 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1507 microversion: 2.1 time: 0.161297 Oct 10 11:27:54.211239 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3216/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:54 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:54.233759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:54.234389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:54.241214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:54.241695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:54.242148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:54.243612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:54.244216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:54.244662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:54.379824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:54.387822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c72d75d-e855-412a-8bb5-6c2963e0fd3b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1507 microversion: 2.1 time: 0.157901 Oct 10 11:27:54.388398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3315/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:54 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:54.413006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'create', calling method: .version_select at 0x7f677782e9d0>, body: {"keypair": {"name": "tempest-keypair-655634420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIftfP+MotdzdGeEgyUW6UXtX93EWJVEwL1dpiHWTralvpYSsOEesEfqk6HXDOWqGIxb1/iN0FQ8HhXIycc00xen5/qXKoWPqNDadyM0f7MjsDNVALVVW12SBKiVC+wFA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:54.429193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for project 3aa188c17f2648f78cd4452678c72c07. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:27:54.435463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for user 12192b37d6954012a0d611480ead1fc6 and project 3aa188c17f2648f78cd4452678c72c07. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:27:54.448836 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [21bd7560-9ba7-42e8-9028-dc838971d640] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:27:55.456895 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [21bd7560-9ba7-42e8-9028-dc838971d640] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40958. Oct 10 11:27:55.474920 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db696c6b-47fb-49bc-b94b-ee1d22becef1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.065907 Oct 10 11:27:55.475573 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3217/6532] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:27:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:55.668252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:55.683048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:55.683634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:55.684315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:55.696166 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] Creating event network-vif-plugged:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h1-860687-2 Oct 10 11:27:55.702327 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ed0607ff-4703-48bf-923d-4a78d6566a26 req-b13e09c5-ce76-4560-8ef1-ab7137d5f0d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038620 Oct 10 11:27:55.703229 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3316/6533] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:56.641331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:56.641978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:56.647949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:56.648436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:56.648895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:56.650181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:56.650643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:56.651103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:56.778182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:56.785888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d8dc197-a7cf-4ac3-bda4-ead27e663ed8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 200 len: 1507 microversion: 2.1 time: 0.149416 Oct 10 11:27:56.786462 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3218/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:56 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:56.808955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:56.809512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:56.815615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:56.816108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:56.816555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:56.817254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:56.817719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:56.818152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:56.843931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:27:56.918359 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b6412402-f648-4d28-b785-1e108fcac59e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 204 len: 0 microversion: 2.1 time: 0.113953 Oct 10 11:27:56.919053 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3317/6535] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:27:56 2022] DELETE /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:27:56.977291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-959729141", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "dade1a1b-d785-4f10-9f9d-9793528a73ec"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:57.033093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] validate_networks() for [('dade1a1b-d785-4f10-9f9d-9793528a73ec', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:27:57.404068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:27:57.404531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:27:57.405014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:27:57.405431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:27:57.405850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:27:57.414922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:57.415438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:57.415880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:57.416649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:57.417130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:57.417543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:57.435429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for project 3aa188c17f2648f78cd4452678c72c07. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:27:57.440852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Getting quotas for user 12192b37d6954012a0d611480ead1fc6 and project 3aa188c17f2648f78cd4452678c72c07. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:27:57.453985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:27:57.456320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:27:57.505888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-218a66c9-aa04-46a9-8d61-7ba37793f87c tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532364 Oct 10 11:27:57.506710 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3219/6536] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:27:57.519629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eba8bb87-26b1-4179-9756-8c5648455da8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:57.520354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eba8bb87-26b1-4179-9756-8c5648455da8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:57.579220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eba8bb87-26b1-4179-9756-8c5648455da8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:57.586494 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eba8bb87-26b1-4179-9756-8c5648455da8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1217 microversion: 2.1 time: 0.071749 Oct 10 11:27:57.587617 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3318/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:57 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:58.609739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:58.610364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:58.618660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:58.619202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:58.619664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:58.620393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:58.620856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:58.621304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:58.703608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:58.715328 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b2f2c53-bce5-431a-a5a7-ab3a391ddad3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1277 microversion: 2.1 time: 0.108865 Oct 10 11:27:58.717162 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3220/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:58 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:27:58.802757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ace18-3280-4566-b5a6-19f30cb0bdc0", "name": "network-vif-deleted", "tag": "ab7da77b-58f1-4840-be69-4f1cc02fdc02"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:27:58.816726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:58.817634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:58.818547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:58.831441 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] Creating event network-vif-deleted:ab7da77b-58f1-4840-be69-4f1cc02fdc02 for instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 on n-h1-860687-2 Oct 10 11:27:58.839587 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-41801b31-c39e-450d-9efe-66126750b283 req-eaadfba1-d861-46dd-ab2e-f55c9b318fbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040662 Oct 10 11:27:58.840661 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3319/6539] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:27:59.739703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:27:59.740586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:27:59.748742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:59.749232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:59.749679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:59.750370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:27:59.750849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:27:59.751301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:27:59.884318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:27:59.892808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab9c65fb-cc34-425c-9ea0-dc055785ee17 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1317 microversion: 2.1 time: 0.157011 Oct 10 11:27:59.893380 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3221/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:27:59 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:00.885411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:00.894829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:00.895350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:00.895796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:00.907097 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] Creating event network-changed:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h1-860687-2 Oct 10 11:28:00.911916 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fada5d24-69e7-4cf3-8d57-f097b03a9446 req-074dd02a-4f41-4ada-b0bf-4a7a78f62071 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Oct 10 11:28:00.912500 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3320/6541] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:00.917584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:00.918210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:00.925046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:00.925554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:00.925995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:00.926682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:00.927177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:00.927606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:01.057975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:01.065667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff3e8474-eaa9-4e1f-b534-9dcf949c2bce tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1317 microversion: 2.1 time: 0.153054 Oct 10 11:28:01.066231 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3222/6542] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:00 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:28:02.090909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:02.091684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:02.097901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:02.098405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:02.098870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:02.099613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:02.100080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:02.100528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:02.229611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:02.237297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ccb656a3-8858-41e0-9c65-03a15112b15a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1317 microversion: 2.1 time: 0.152246 Oct 10 11:28:02.237862 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3321/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:02 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:03.260024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:03.260629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:03.267515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:03.268024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:03.268458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:03.269139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:03.269590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:03.270008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:03.396301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:03.404265 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2fd323c-fcfa-4385-8733-da7dc025ab05 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1317 microversion: 2.1 time: 0.148315 Oct 10 11:28:03.404889 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3223/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:03 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:03.647029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "name": "network-vif-plugged", "status": "completed", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:03.658512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:03.659032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:03.659484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:03.676832 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] Creating event network-vif-plugged:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h1-860687-2 Oct 10 11:28:03.682801 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ca0bc024-f763-4ac8-a5f8-96fa0c17500d req-17a82d13-22b9-44b2-9ff5-7c24a184f59a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039582 Oct 10 11:28:03.684231 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3322/6545] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:04.427370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:04.427996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:04.435575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:04.436064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:04.436505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:04.437197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:04.437655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:04.438085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:04.442158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:04.577092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:04.585092 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ccd260e-6238-44d6-8bb9-48ae9217037e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1317 microversion: 2.1 time: 0.161613 Oct 10 11:28:04.585682 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3224/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:04 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:05.610435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:05.611179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:05.617335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.618503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.618864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.619603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.620070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.620509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.752965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:05.760752 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e0746e8-c14d-471e-a602-d4897c2801c3 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1506 microversion: 2.1 time: 0.155619 Oct 10 11:28:05.761335 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3323/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:05 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:05.783063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:05.783681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:05.790971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.791478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.791914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.792593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.793045 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.793468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.924834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:05.932542 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c273e94-c9cd-4845-a12c-9537a8602566 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1506 microversion: 2.1 time: 0.153634 Oct 10 11:28:05.933110 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3225/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:05 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:05.954277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:05.956471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:05.963494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.964010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.964467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.965176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:05.965651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:05.966096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:05.994740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:06.000154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:28:06.006608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:28:06.007078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:28:06.007572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:28:06.007999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:28:06.008426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:28:06.034881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:06.072091 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2446ade7-6f32-4a7d-9197-3530348c486b tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f/action" status: 202 len: 0 microversion: 2.1 time: 0.121825 Oct 10 11:28:06.072867 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3324/6549] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:28:05 2022] POST /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:28:06.080924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:06.081637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:06.088457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:06.089051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:06.089504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:06.090220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:06.090687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:06.091147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:06.245079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:06.252904 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c896540b-a5dc-422f-91f5-97a6d9ba6031 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1513 microversion: 2.1 time: 0.175863 Oct 10 11:28:06.253780 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3226/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:06 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:28:07.277598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:07.278171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:07.285185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:07.285686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:07.286135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:07.286838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:07.287350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:07.287788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:07.420323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:07.428571 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-967eab45-930e-4b52-88dd-56e7b1b09036 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1513 microversion: 2.1 time: 0.155099 Oct 10 11:28:07.429775 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3325/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:07 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:08.452999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:08.453613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:08.456235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:08.456894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:08.463374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:08.463860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:08.464296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:08.464978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:08.465431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:08.465851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:08.596874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:08.605416 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d7d9fdb-02d0-44ec-bbae-f646bd4f3ae6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.156482 Oct 10 11:28:08.605993 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3227/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:08 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:09.629727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:09.630358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:09.632485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:09.638792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:09.639326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:09.639785 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:09.640491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:09.640963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:09.641408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:09.768251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:09.776405 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58949cf2-8e3b-414f-91a7-2b79ce83bbb0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.150612 Oct 10 11:28:09.776983 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3326/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:09 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:10.799525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:10.800164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:10.808068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:10.808547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:10.808984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:10.809665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:10.810146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:10.810568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:10.937039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:10.944686 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1da2261-0343-4e27-a5e6-0e126645481d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.149178 Oct 10 11:28:10.945289 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3228/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:10 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:11.968442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:11.969097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:11.975939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:11.976432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:11.977667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:11.978367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:11.978831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:11.979296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:12.110227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:12.118316 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48ff804c-9ed6-40a8-ace0-5c9b70eeb0fe tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.153618 Oct 10 11:28:12.118889 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3327/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:11 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:13.141248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:13.141862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:13.144545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:13.150677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:13.151212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:13.151662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:13.152364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:13.152826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:13.153257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:13.286571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:13.294874 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0936244-41bf-4783-a89c-32e3eda5559a tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.157572 Oct 10 11:28:13.295495 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3229/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:13 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:14.317734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:14.318353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:14.321723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:14.326926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:14.327453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:14.327903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:14.328600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:14.329066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:14.329502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:14.462510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:14.470154 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-738a4720-49f2-4ba1-8385-ba534b719f91 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.156391 Oct 10 11:28:14.470725 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3328/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:14 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:15.493572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:15.494130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:15.501090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:15.501579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:15.502023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:15.502745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:15.503232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:15.503666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:15.635925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:15.643790 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fd94fe6-b2e4-4018-8d5b-e89febc8da79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.154174 Oct 10 11:28:15.644537 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3230/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:15 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:16.666355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:16.667046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:16.673942 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:16.674438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:16.674896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:16.675628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:16.676105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:16.676546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:16.809496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:16.817164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0b2b8829-027e-4204-9bb8-cb4ed8337c67 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.155408 Oct 10 11:28:16.817739 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3329/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:16 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:17.841147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:17.841803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:17.848712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:17.849185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:17.849616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:17.850297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:17.850742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:17.851215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:17.983661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:17.991258 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2526ae7-0496-469a-9aa2-251b7583f49d tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.153996 Oct 10 11:28:17.991824 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3231/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:17 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:19.014314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:19.014948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:19.021763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:19.022264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:19.022721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:19.023466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:19.024064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:19.024514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:19.156068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:19.163804 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cd75b3a3-7325-412e-8d10-9f5c95b14ad6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.153392 Oct 10 11:28:19.165405 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3330/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:19 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:20.188253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:20.188868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:20.196433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:20.196911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:20.197341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:20.198023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:20.198468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:20.198890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:20.329914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:20.338137 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a130444-2b16-42c7-b11b-3fd80ee0a0dc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.153744 Oct 10 11:28:20.338711 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3232/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:20 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:21.364753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:21.365775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:21.374158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:21.374670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:21.375178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:21.375909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:21.376405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:21.376843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:21.509222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:21.517131 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-85fbde11-23ed-41fd-9d17-5a3796c337b1 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.159240 Oct 10 11:28:21.517709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3331/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:21 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:22.541425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:22.542046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:22.548945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:22.549434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:22.549877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:22.550605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:22.551094 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:22.551526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:22.683112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:22.690807 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-826d2ef5-31bb-4928-8bf8-9d1e53f4a4df tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.154021 Oct 10 11:28:22.691409 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3233/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:22 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:23.714800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:23.715394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:23.722188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:23.722689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:23.723177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:23.723884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:23.724356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:23.724795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:23.854908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:23.862658 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-48de58b4-002c-4f59-bc40-e4f0ade9f747 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.152596 Oct 10 11:28:23.863263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3332/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:23 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:24.885767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:24.886389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:24.893309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:24.893798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:24.894246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:24.894941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:24.895431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:24.895864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:25.021863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:25.030288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9891e15-d05d-49d0-8789-aa211d9ed42f tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.148407 Oct 10 11:28:25.030853 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3234/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:24 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:26.053172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:26.053802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:26.061239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:26.061735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:26.062211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:26.062909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:26.063407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:26.063844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:26.195304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:26.203672 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f998eca5-44ee-4208-aa06-c5f10c69f0cc tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.154403 Oct 10 11:28:26.204240 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3333/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:26 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:27.225942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:27.226563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:27.234167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:27.234655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:27.235132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:27.235826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:27.236285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:27.236714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:27.365134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:27.373677 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72aa17a7-6d82-46fd-8f05-fccad850a07e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.151606 Oct 10 11:28:27.374322 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3235/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:27 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:28.397693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:28.398317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:28.405153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:28.405650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:28.406102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:28.406801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:28.407292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:28.407729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:28.539501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:28.547725 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9df9c78c-33e7-4a28-b1a5-c006107ac6f7 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.154647 Oct 10 11:28:28.548296 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3334/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:28 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:29.571722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:29.572377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:29.579261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:29.579754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:29.580194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:29.580891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:29.581349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:29.581780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:29.716389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:29.724133 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b0ccdb6-0c04-4fbc-9d7c-0245733f12a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.156949 Oct 10 11:28:29.724725 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3236/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:29 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:30.749462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:30.750013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:30.756844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:30.757344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:30.757794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:30.759202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:30.759679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:30.760120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:30.891304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:30.899110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96f1cfd1-042a-44ea-95e2-af76b513ee39 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.153603 Oct 10 11:28:30.899771 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3335/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:30 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:31.921954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:31.922594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:31.929559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:31.930033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:31.930556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:31.931354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:31.931807 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:31.932227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:32.065861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:32.074340 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fc73873-c39d-466c-b862-beb2cdb82e98 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.156425 Oct 10 11:28:32.074916 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3237/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:31 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:33.098048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:33.098686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:33.106384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:33.106890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:33.107398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:33.108108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:33.108578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:33.109022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:33.237216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:33.245414 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c03a8e21-95f2-4108-940b-5b6359292516 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.151303 Oct 10 11:28:33.245990 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3336/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:33 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:34.269309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:34.269923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:34.277407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:34.277897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:34.278343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:34.279064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:34.279530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:34.279960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:34.412438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:34.420683 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8249025f-7225-4d2d-a0ce-253002c1c881 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1518 microversion: 2.1 time: 0.155338 Oct 10 11:28:34.421255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3238/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:34 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:35.176632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "name": "network-vif-unplugged", "status": "completed", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:35.185483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:35.186062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:35.186605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:35.199370 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Creating event network-vif-unplugged:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h2-860687-2 Oct 10 11:28:35.205147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] Instance 071574b5-b9ea-4daa-850a-17a4dc34695f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:28:35.217018 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-82e34ce7-d731-469a-98b2-b4859d8c0b20 req-1f5f7cac-b66b-4e3a-b5ed-d7e95812b864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113820 Oct 10 11:28:35.217635 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3337/6575] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:35.443224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:35.443850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:35.450931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:35.451458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:35.451906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:35.452615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:35.453076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:35.453510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:35.457722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=90 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:35.597587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:35.606242 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f5d0001-00bc-4db1-8180-04c6a31bd3ae tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1517 microversion: 2.1 time: 0.166905 Oct 10 11:28:35.606947 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3239/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:35 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:36.632072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:36.632704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:36.639122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:36.639621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:36.640065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:36.640764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:36.641233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:36.641669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:36.645623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:36.777591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:36.785303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1cfcb427-89cd-45bc-9902-5d5cf9729501 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1515 microversion: 2.1 time: 0.158494 Oct 10 11:28:36.785877 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3338/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:36 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:37.244146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:37.254597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:37.255117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:37.255591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:37.268838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Creating event network-changed:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h2-860687-2 Oct 10 11:28:37.277263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] Instance 071574b5-b9ea-4daa-850a-17a4dc34695f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:28:37.292788 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a14c0c26-62b1-453a-8939-941d237a7b41 req-330593fa-6865-4603-81ea-84c9dfd57555 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052932 Oct 10 11:28:37.293414 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3240/6578] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:37.809318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:37.809869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:37.816769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:37.817267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:37.817717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:37.818423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:37.818885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:37.819346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:37.953143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:37.961220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7806d5c5-56fc-46ad-93de-cbc9a98607b8 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1512 microversion: 2.1 time: 0.156090 Oct 10 11:28:37.961795 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3339/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:37 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:37.984377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:37.985008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:37.991117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:37.991603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:37.992041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:37.992726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:37.993180 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:37.993601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:38.051706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-919c27be-0cc5-4dc3-86e6-2d48981d04e2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "POST /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f/action" status: 204 len: 0 microversion: 2.1 time: 0.071322 Oct 10 11:28:38.052548 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3241/6580] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:28:37 2022] POST /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:28:38.063229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:38.064355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:38.073180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:38.073711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:38.074359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:38.076438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:38.077553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:38.078005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:38.224118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:38.231956 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c17d057-a178-49b2-abbc-007a9f16a3a2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1512 microversion: 2.1 time: 0.173982 Oct 10 11:28:38.232540 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3340/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:38 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:39.257758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:39.259764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:39.267160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.267891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.268658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.269537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.270192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.270858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.433532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:39.442157 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-408d8396-2183-4b0c-9c88-9d3c9e1424ed tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1504 microversion: 2.1 time: 0.190106 Oct 10 11:28:39.442732 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3242/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:39 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:28:39.467617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:39.468308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:39.476793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.477313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.477756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.478880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.479387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.479831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.632746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:39.641402 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-031cda7e-f3a2-4275-9abc-7dd0e33f6c96 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1504 microversion: 2.1 time: 0.179306 Oct 10 11:28:39.641999 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3341/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:39 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:39.665581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:39.666338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:39.672635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.673165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.673635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.674356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.674817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.675286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.809866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:39.817567 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c34cb65e-125a-48d1-ad39-330d319831d6 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1504 microversion: 2.1 time: 0.156847 Oct 10 11:28:39.818137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3243/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:39 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:39.840103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:39.840627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:39.846683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.847232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.847687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.848400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.848907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.849353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.875133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:28:39.950134 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1f916f94-a9d9-4413-912c-80dda53e1a79 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 204 len: 0 microversion: 2.1 time: 0.113443 Oct 10 11:28:39.950957 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3342/6585] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:28:39 2022] DELETE /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:28:39.967707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:39.968206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:39.974176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.974727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.975199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:39.975893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:39.976345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:39.976771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:40.002936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:28:40.046570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.compute.api [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Instance is already in deleting state, ignoring this request Oct 10 11:28:40.047426 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1072e20e-a785-4d6f-982e-191cbd5b5c1e tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 204 len: 0 microversion: 2.1 time: 0.083800 Oct 10 11:28:40.047990 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3244/6586] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:28:39 2022] DELETE /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:28:40.056736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:40.057491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:40.064164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:40.064671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:40.065124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:40.065837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:40.066311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:40.066751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:40.196015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:40.204236 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db66ea61-0281-4145-b15c-39bbf98682c0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1510 microversion: 2.1 time: 0.151753 Oct 10 11:28:40.204917 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3343/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:40 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:41.228265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:41.228870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:41.235721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:41.236197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:41.236629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:41.237501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:41.238097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:41.238527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:41.298504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "name": "network-vif-plugged", "status": "completed", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:41.317768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:41.319489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:41.320027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:41.342368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] Creating event network-vif-plugged:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h2-860687-2 Oct 10 11:28:41.348435 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-654c6ef0-d7a8-4bbf-8b5a-34f4fd5eb17d req-decadacb-28cd-4b32-a3e1-a0e418f34325 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055028 Oct 10 11:28:41.349757 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3344/6588] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:28:41.386726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12192b37d6954012a0d611480ead1fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa188c17f2648f78cd4452678c72c07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:41.395255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7aa50e2a-84a3-4d48-a91d-4d7c7157f890 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 200 len: 1510 microversion: 2.1 time: 0.170991 Oct 10 11:28:41.395929 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3245/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:41 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:41.709572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071574b5-b9ea-4daa-850a-17a4dc34695f", "name": "network-vif-deleted", "tag": "171e2b18-3b6a-4dd1-9678-4b8b26b35549"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:41.720113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:41.720608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:41.721057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:41.733407 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] Creating event network-vif-deleted:171e2b18-3b6a-4dd1-9678-4b8b26b35549 for instance 071574b5-b9ea-4daa-850a-17a4dc34695f on n-h2-860687-2 Oct 10 11:28:41.738185 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ca014627-736d-4227-92e5-96f6c2fb1609 req-b3db2e40-7847-4231-8118-3a3ca4fad8e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Oct 10 11:28:41.738781 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3345/6590] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:42.418134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:42.418744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: 071574b5-b9ea-4daa-850a-17a4dc34695f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:42.426047 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:42.426534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:42.426969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:42.427693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:42.428148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:42.428581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:42.442066 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] HTTP exception thrown: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Request method failure captured: Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f HTTP/1.1 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAGGVh4IjKrDWqwBli7UWFwPY1hUbCGgADN0sZ2T5rndEGs5iK0cewrvLbMRBYXHLSu0QfElcNHmhSWdPgjmhFiJo3VyqGNqe051qj2muMdipuqPISj9wj1wa7sDyT56pfuSi5qnWjlpQAs4Mzv2fCY80we-xB15tyqPinyGhIt1PNM Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3aa188c17f2648f78cd4452678c72c07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3aa188c17f2648f78cd4452678c72c07"}]}] Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 12192b37d6954012a0d611480ead1fc6 Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '071574b5-b9ea-4daa-850a-17a4dc34695f'} Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:42.443755 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Returning 404 to user: Instance 071574b5-b9ea-4daa-850a-17a4dc34695f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffed5529-28ab-4727-8b61-700ff8559717 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f" status: 404 len: 111 microversion: 2.1 time: 0.031042 Oct 10 11:28:42.448731 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3246/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:42 2022] GET /compute/v2.1/servers/071574b5-b9ea-4daa-850a-17a4dc34695f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:28:42.455957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8ddfc022-bbe1-4506-9307-290088a8a8b2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '.version_select at 0x7f67776e00d0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:42.479928 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8ddfc022-bbe1-4506-9307-290088a8a8b2 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655634420" status: 202 len: 0 microversion: 2.1 time: 0.028831 Oct 10 11:28:42.480519 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3346/6592] 10.222.0.16 () {58 vars in 1218 bytes} [Mon Oct 10 11:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655634420 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:28:43.079530 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:43.080031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:43.086264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:43.086747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:43.087218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:43.088071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:43.088532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:43.088958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:43.102033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] HTTP exception thrown: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Request method failure captured: Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 HTTP/1.1 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAGGVh4IjKrDWqwBli7UWFwPY1hUbCGgADN0sZ2T5rndEGs5iK0cewrvLbMRBYXHLSu0QfElcNHmhSWdPgjmhFiJo3VyqGNqe051qj2muMdipuqPISj9wj1wa7sDyT56pfuSi5qnWjlpQAs4Mzv2fCY80we-xB15tyqPinyGhIt1PNM Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3aa188c17f2648f78cd4452678c72c07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3aa188c17f2648f78cd4452678c72c07"}]}] Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 12192b37d6954012a0d611480ead1fc6 Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'b00ace18-3280-4566-b5a6-19f30cb0bdc0'} Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:28:43.104266 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Returning 404 to user: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cdd0d0f-7449-43ae-af8e-5ff8f1504fd0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 404 len: 111 microversion: 2.1 time: 0.029998 Oct 10 11:28:43.108054 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3247/6593] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:28:43 2022] DELETE /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:28:43.114364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:43.115203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] [instance: b00ace18-3280-4566-b5a6-19f30cb0bdc0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:43.122462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:43.122968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:43.123454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:43.124164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:43.124642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:43.125165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:43.138366 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] HTTP exception thrown: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Request method failure captured: Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 HTTP/1.1 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAGGVh4IjKrDWqwBli7UWFwPY1hUbCGgADN0sZ2T5rndEGs5iK0cewrvLbMRBYXHLSu0QfElcNHmhSWdPgjmhFiJo3VyqGNqe051qj2muMdipuqPISj9wj1wa7sDyT56pfuSi5qnWjlpQAs4Mzv2fCY80we-xB15tyqPinyGhIt1PNM Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3aa188c17f2648f78cd4452678c72c07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3aa188c17f2648f78cd4452678c72c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3aa188c17f2648f78cd4452678c72c07"}]}] Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 3aa188c17f2648f78cd4452678c72c07 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1311729202 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 12192b37d6954012a0d611480ead1fc6 Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerDiskConfigTestJSON-1311729202-project Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'b00ace18-3280-4566-b5a6-19f30cb0bdc0'} Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:28:43.140084 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] Returning 404 to user: Instance b00ace18-3280-4566-b5a6-19f30cb0bdc0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e1c328a7-2f33-43d5-9260-9f1e767049a0 tempest-ServerDiskConfigTestJSON-1311729202 tempest-ServerDiskConfigTestJSON-1311729202-project] 10.222.0.16 "GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0" status: 404 len: 111 microversion: 2.1 time: 0.031209 Oct 10 11:28:43.144509 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3347/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:43 2022] GET /compute/v2.1/servers/b00ace18-3280-4566-b5a6-19f30cb0bdc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:28:51.734335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ca1d72d-7894-4b15-b02d-6b66adc5047c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: .version_select at 0x7f6777837280>, body: {"keypair": {"name": "tempest-keypair-1973446155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUhjg5Ri4neqicGu/Wv5ishn1QZJmO17HpQcqHr0oE7NXRN0bfoR824ZPN3yTSEFD1cRf5CkLkroL+9KsGS4Gs4JSyPv6OQfPXx04/s1LxdI/zEPUa+65r5UoBLy3FFuA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:51.740258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:51.752508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ca1d72d-7894-4b15-b02d-6b66adc5047c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:28:51.758022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ca1d72d-7894-4b15-b02d-6b66adc5047c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:28:51.784505 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ca1d72d-7894-4b15-b02d-6b66adc5047c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177216 Oct 10 11:28:51.785100 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3248/6595] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:28:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:53.068410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1153832106", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f3b280f-a8e9-48d9-8fee-8184b3cacde3"}], "security_groups": [{"name": "tempest-securitygroup--388977224"}], "key_name": "tempest-keypair-1973446155", "user_data": "}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:53.078465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:53.134857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:53.185519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] validate_networks() for [('8f3b280f-a8e9-48d9-8fee-8184b3cacde3', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:28:53.574905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:28:53.575372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:28:53.575865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:28:53.576295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:28:53.576725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:28:53.586398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:53.586897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:53.587384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:53.588140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:53.588769 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:53.589218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:53.608094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:28:53.613724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:28:53.626573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:28:53.628965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:28:53.677480 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-afdca7d5-a49c-45af-9c9b-07f7b4879069 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.613256 Oct 10 11:28:53.678394 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3348/6596] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:28:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:28:53.690648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9a5acdf-c40c-4f85-aab3-e4eb5071db88 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:53.691242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9a5acdf-c40c-4f85-aab3-e4eb5071db88 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:53.694761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:28:53.767910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9a5acdf-c40c-4f85-aab3-e4eb5071db88 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:53.776267 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9a5acdf-c40c-4f85-aab3-e4eb5071db88 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1239 microversion: 2.1 time: 0.090187 Oct 10 11:28:53.777027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3249/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:53 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:54.809775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:54.812332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:54.827464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:54.828272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:54.829551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:54.830497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:54.831246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:54.832190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:54.937715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:54.946104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-838e0fd4-1ac3-4ac1-9d28-c1de283466a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1309 microversion: 2.1 time: 0.149809 Oct 10 11:28:54.947107 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3349/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:54 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:55.970284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:55.971006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:55.979566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:55.980053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:55.980488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:55.981184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:55.981639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:55.982059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:56.120626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:56.128500 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ab63804-76a4-4c42-a0a4-8743e0882e52 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.162384 Oct 10 11:28:56.129079 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3250/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:55 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:56.269705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:28:56.284611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:56.285672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:56.287574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:56.302813 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] Creating event network-changed:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h2-860687-2 Oct 10 11:28:56.309130 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bfba04b9-0c12-4ea3-bc8a-f2dae6c0e3fa req-a73a4456-f779-459f-b6e4-98b756022318 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043920 Oct 10 11:28:56.309748 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3350/6600] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:28:57.153316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:57.153931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:57.160747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:57.161231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:57.161670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:57.162356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:57.162821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:57.163292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:57.292371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:57.300004 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e9073c3-cb5d-425b-b94d-1f973ceebdea tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.151777 Oct 10 11:28:57.300576 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3251/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:57 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:28:58.323892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:58.324554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:58.330793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:58.331316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:58.331763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:58.332459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:58.332924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:58.333613 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:58.725798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:58.733730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44d24449-273d-431f-bb78-ea05e9704afd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.415152 Oct 10 11:28:58.734755 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3351/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:58 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:28:59.757136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:28:59.757757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:28:59.765014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:59.765497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:59.765938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:59.766663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:28:59.767152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:28:59.767578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:28:59.898108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:28:59.906733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6793bf55-c307-4d5e-8a19-69a1b623802f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.154238 Oct 10 11:28:59.907348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3252/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:28:59 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:00.930214 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:00.930840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:00.938360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:00.938859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:00.939354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:00.940064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:00.940530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:00.940968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:01.069337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:01.077183 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc0ea5e6-a8bf-4a73-9093-641849377df8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.151229 Oct 10 11:29:01.077726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3352/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:00 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:01.368331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "name": "network-vif-plugged", "status": "completed", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:01.378993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:01.379495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:01.380195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:01.391545 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] Creating event network-vif-plugged:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h2-860687-2 Oct 10 11:29:01.396621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-108ca8db-3da2-4d5f-aec7-fe261e41b525 req-5c703aac-ec1b-41bb-add3-7a10560f974e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Oct 10 11:29:01.397226 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3253/6605] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:29:02.100352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:02.100988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:02.108715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:02.109216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:02.109661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:02.110363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:02.110829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:02.111301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:02.242721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:02.250917 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dce348c1-e4cb-45a8-b186-ee7d6323b257 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1364 microversion: 2.1 time: 0.154524 Oct 10 11:29:02.251509 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3353/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:02 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:03.274725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:03.275455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:03.282096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:03.282581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:03.283043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:03.283736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:03.284193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:03.284621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:03.414348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:03.422973 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87f9c7c0-8617-40f5-b880-14d3753c4eef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1550 microversion: 2.1 time: 0.153429 Oct 10 11:29:03.423571 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3254/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:03 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:03.445990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:03.446519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:03.453726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:03.454415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:03.454884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:03.455787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:03.456271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:03.456727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:03.537065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a55137b8-8a8d-4eb8-a746-99ec2f19f408 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094957 Oct 10 11:29:03.537655 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3354/6608] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:29:03 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:29:04.471160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:04.531060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:04.540703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:04.541190 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:04.542203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:04.553402 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] Creating event network-changed:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h2-860687-2 Oct 10 11:29:04.558642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b1cf3d8d-f12c-4d4d-bd82-ef70e75c3e80 req-dfee63b7-788c-4339-997a-30db9cfa2571 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094064 Oct 10 11:29:04.559287 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3255/6609] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:29:40.783157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:40.783994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:40.786428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:40.787129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=32 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:40.791245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:40.792399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:40.801008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:40.801518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:40.801979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:40.802698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:40.803212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:40.803659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.252218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:41.259892 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d82b69e0-7a8c-4b0e-8898-632267a6c8fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.477742 Oct 10 11:29:41.261047 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3355/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:40 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:41.280859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:41.281609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:29:41.286276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:41.286970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:41.295074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.295564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.296002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.296684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.297136 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.297561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.426583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:41.434991 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-310515ab-25f7-46f1-932c-27adc0ac86e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.156459 Oct 10 11:29:41.435660 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3256/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:41 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:41.456871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:41.457515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:41.464012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.464517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.464982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.465708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.466190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.466642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.602875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:41.611249 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8aa1b396-70e9-4569-831a-04e7bc809580 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.158220 Oct 10 11:29:41.611831 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3356/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:41 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:41.634447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:41.637165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:41.643170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.643661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.644102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.644795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.645287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.645719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.722479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:41.727873 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:29:41.734881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:29:41.735331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:29:41.735812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:29:41.736227 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:29:41.736644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:29:41.842314 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43222b1a-928c-4d32-a59a-1f91bf5cf155 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/action" status: 202 len: 0 microversion: 2.1 time: 0.211741 Oct 10 11:29:41.842927 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3257/6613] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:29:41 2022] POST /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:29:41.851304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:41.851933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:41.859325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.859834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.860285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:41.860994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:41.861462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:41.861901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:42.024940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:42.033419 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-851b86b9-160d-4414-a07c-e3163de0c4ef tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1678 microversion: 2.1 time: 0.186016 Oct 10 11:29:42.034062 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3357/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:41 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:43.056568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:43.057125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:43.065008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:43.065495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:43.065935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:43.066640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:43.067195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:43.067627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:43.201247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:43.209372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c5a742e-b0db-4edc-8598-c51aa49e37e2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1678 microversion: 2.1 time: 0.156748 Oct 10 11:29:43.209954 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3258/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:43 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:44.233519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:44.234179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:44.241001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:44.241500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:44.241953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:44.242657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:44.243155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:44.243625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:44.378050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:44.386009 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1302669d-536d-438f-8417-95e164360939 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.156540 Oct 10 11:29:44.386582 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3358/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:44 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:45.410030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:45.410638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:45.417014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:45.417494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:45.417927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:45.418755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:45.419226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:45.419650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:45.548676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:45.556375 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f8fc771-4b4e-477d-a59c-ed1a7e9c13fd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.150366 Oct 10 11:29:45.556945 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3259/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:45 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:46.580500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:46.581184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:46.588337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:46.588838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:46.589319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:46.590035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:46.590511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:46.590957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:46.718479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:46.726266 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a928f504-79c9-4222-a64f-7b99e3dba95d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.149704 Oct 10 11:29:46.726834 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3359/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:46 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:47.750359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:47.750904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:47.758037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:47.758528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:47.758965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:47.759743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:47.760207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:47.760639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:47.895628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:47.904770 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1569010-c737-478b-a25a-faf3149c44bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.158804 Oct 10 11:29:47.905347 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3260/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:47 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:48.927585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:48.928221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:48.935023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:48.935563 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:48.936019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:48.936725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:48.937196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:48.937636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:49.064265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:49.072228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aab7e6fc-3206-48f9-8f4c-8ff945269777 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.148499 Oct 10 11:29:49.072814 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3360/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:48 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:50.097488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:50.098078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:50.104917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:50.105399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:50.105833 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:50.106516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:50.106965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:50.108135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:50.242957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:50.250722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-095c304f-5966-4de9-a4a7-17cfd787d71d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.157063 Oct 10 11:29:50.251330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3261/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:50 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:51.273831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:51.274461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:51.282240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:51.282742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:51.283220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:51.283930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:51.284418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:51.284862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:51.414146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:51.422509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-38cb736e-5e83-4798-ab9d-a67151a27efb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.152608 Oct 10 11:29:51.423103 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3361/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:51 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:52.445091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:52.445709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:52.453843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:52.454333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:52.454773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:52.455488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:52.455946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:52.456369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:52.838322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:52.846819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04f3c57b-b8b0-457c-9898-6d9f69915571 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.405539 Oct 10 11:29:52.858541 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3262/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:52 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:53.871342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:53.872006 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:53.878957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:53.879496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:53.879959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:53.880675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:53.881150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:53.881599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:54.015447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:54.023223 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-97d85817-126a-4e7a-87b4-aef1886b8685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.155802 Oct 10 11:29:54.023835 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3362/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:53 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:55.047405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:55.048026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:55.054826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:55.055346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:55.055790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:55.056505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:55.056951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:55.057384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:55.184799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:55.192647 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5877951c-7b56-4caf-a45b-fe3ca5fc54f0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1683 microversion: 2.1 time: 0.149661 Oct 10 11:29:55.193210 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3263/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:55 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:55.961290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:55.972375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:55.972998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:55.973454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:55.985590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Creating event network-vif-unplugged:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h1-860687-2 Oct 10 11:29:55.991147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:29:56.002742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e7d6b382-5cb1-4305-9a51-5c746d526a13 req-3de2cafb-e47c-4471-abd7-2183345ff576 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045671 Oct 10 11:29:56.003593 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3363/6626] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:29:56.216808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:56.217475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:56.224498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:56.224998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:56.225440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:56.226151 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:56.226629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:56.227115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:56.370270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:56.385982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e9b4dd6-bd44-419d-a3e2-eba35e7e68c5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1682 microversion: 2.1 time: 0.173446 Oct 10 11:29:56.386655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3264/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:56 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:57.411718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:57.412478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:57.418665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:57.419216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:57.419733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:57.420451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:57.420929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:57.421379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:57.552957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:57.561496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ce313b9-3e86-497a-8549-35a5ff90cf62 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1680 microversion: 2.1 time: 0.154829 Oct 10 11:29:57.562071 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3364/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:57 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:58.036719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:58.047566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:58.048046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:58.048484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:58.059870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Creating event network-changed:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h1-860687-2 Oct 10 11:29:58.065843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:29:58.076433 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ed2b9025-4cdc-49ec-aab4-a986f9edcc64 req-a010a532-56c9-41ce-a6cf-e021d3c32708 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043386 Oct 10 11:29:58.077004 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3265/6629] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:29:58.585111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:58.585764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:58.592358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:58.592866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:58.593316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:58.594032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:58.594504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:58.594954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:58.733731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:58.743934 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f9e977c-ce52-4db5-ad25-852d44f4531e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1680 microversion: 2.1 time: 0.162734 Oct 10 11:29:58.759427 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3365/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:58 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:59.770780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:29:59.771514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:59.777711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:59.778202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:59.779202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:59.779845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:59.780303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:59.780737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:59.911672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:29:59.920103 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db3e3331-fdba-47b1-99bd-8b6addc4d50b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1677 microversion: 2.1 time: 0.153808 Oct 10 11:29:59.920835 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3266/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:29:59 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:29:59.942737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:29:59.943319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:29:59.950128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:59.951045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:59.951518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:29:59.952241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:29:59.952719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:29:59.953165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:00.011745 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-64599f99-e224-4734-9882-3042cf2b9d4c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/action" status: 204 len: 0 microversion: 2.1 time: 0.072653 Oct 10 11:30:00.012389 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3366/6632] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:29:59 2022] POST /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:30:00.021385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:00.021935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:00.028056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:00.029344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:00.029954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:00.031550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:00.032025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:00.032460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:00.174779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:00.183139 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-435adf38-b73a-4801-9a1d-094fdb948685 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1677 microversion: 2.1 time: 0.165584 Oct 10 11:30:00.183951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3267/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:00 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:01.209573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:01.210288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:01.216647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.217155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.217609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.218322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.218795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.219259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.360329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:01.368594 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f135b81a-4a5c-4c61-a9b8-3c0fa8a8eb66 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.164487 Oct 10 11:30:01.369233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3367/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:01 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:01.394528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:01.395185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:01.401900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.402366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.402804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.403522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.404029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.404458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.536042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:01.543985 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3c8832d-3385-43c2-be76-76261c76214c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.153327 Oct 10 11:30:01.545263 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3268/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:01 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:01.567375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:01.568014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:01.573983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.574489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.574944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.575712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.576188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.576632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.709332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:01.717303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-65834617-301a-49ca-a9e2-4985b4bcec8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1669 microversion: 2.1 time: 0.153739 Oct 10 11:30:01.717881 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3368/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:01 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:01.740253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:01.740923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:01.746880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.748026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.748474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.749161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.749616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.750035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.774262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:30:01.822678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:01.850103 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1016661b-5e66-4554-95b0-86512882ad8f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 204 len: 0 microversion: 2.1 time: 0.113815 Oct 10 11:30:01.851066 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3269/6637] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:30:01 2022] DELETE /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:30:01.859842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:01.860500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:01.866434 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.866935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.867426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:01.868134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:01.868606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:01.869050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:02.001091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:02.008825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5fcf84f-d49d-4459-95ca-b40844adbb71 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1675 microversion: 2.1 time: 0.153548 Oct 10 11:30:02.009399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3369/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:01 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:02.109984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "name": "network-vif-plugged", "status": "completed", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:02.119538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:02.120022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:02.121001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:02.131850 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] Creating event network-vif-plugged:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h1-860687-2 Oct 10 11:30:02.136739 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b090bf71-2f1f-4df3-8485-d35afe792eac req-69990c83-e426-48a4-b583-d9afc904bbca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 Oct 10 11:30:02.137330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3270/6639] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:30:03.032224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:03.032860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:03.039701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:03.040213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:03.040671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:03.041388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:03.041867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:03.042319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:03.176330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:03.178719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:03.185822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a12236a0-8274-478f-bf26-58d69f25b74c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1675 microversion: 2.1 time: 0.157558 Oct 10 11:30:03.186401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3370/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:03 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:04.210664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:04.211417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:04.219588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:04.220086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:04.220529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:04.221240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:04.221703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:04.222162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:04.245859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796edb8-2bc3-4967-82f1-8b6c6d832156", "name": "network-vif-deleted", "tag": "2cb6edf3-1730-4db9-a3c3-e5a788a37028"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:04.259246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:04.259746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:04.260266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:04.272556 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] Creating event network-vif-deleted:2cb6edf3-1730-4db9-a3c3-e5a788a37028 for instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 on n-h1-860687-2 Oct 10 11:30:04.278188 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-57e96f9f-43fa-4b1c-a263-5069a804d9cc req-ee6e6ccb-9831-4a60-8c32-9d406bd5b211 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036113 Oct 10 11:30:04.279355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3371/6641] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:30:04.306942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:04.321021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c975a2d-f025-4fa5-a880-d6003146b834 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 200 len: 1608 microversion: 2.1 time: 0.114892 Oct 10 11:30:04.321876 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3271/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:04 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 1608 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:05.347327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:05.348051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:05.365065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.365065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.365543 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.366662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.380424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.381047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.396997 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 HTTP/1.1 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3796edb8-2bc3-4967-82f1-8b6c6d832156'} Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:30:05.398725 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9a5bf190-eae5-4367-bce6-3842f03cf39f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 404 len: 111 microversion: 2.1 time: 0.058846 Oct 10 11:30:05.403088 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3372/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:05 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:30:05.416579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:05.417202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:05.425026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.425514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.425993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.426692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.427193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.427627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.441030 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 HTTP/1.1 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '3796edb8-2bc3-4967-82f1-8b6c6d832156'} Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:30:05.442688 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f95936f5-3493-4ed6-8d01-334ac1a27f48 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 404 len: 111 microversion: 2.1 time: 0.031420 Oct 10 11:30:05.447014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3272/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:05 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:30:05.493924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-53022294", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8f3b280f-a8e9-48d9-8fee-8184b3cacde3"}], "security_groups": [{"name": "tempest-securitygroup--388977224"}], "key_name": "tempest-keypair-1973446155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:05.599499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] validate_networks() for [('8f3b280f-a8e9-48d9-8fee-8184b3cacde3', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:30:05.967141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:30:05.967620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:30:05.968119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:30:05.968571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:30:05.969010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:30:05.978282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.978817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.979315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.980081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:05.980567 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:05.981025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:05.999421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:30:06.004759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:30:06.017380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:30:06.019786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:30:06.066601 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bfa3d706-31ca-4b1c-9502-1268b2d8cefd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.576517 Oct 10 11:30:06.067501 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3373/6645] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:30:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:30:06.078755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c4bff50-54a1-48ee-b6da-29435a20ed84 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:06.079420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c4bff50-54a1-48ee-b6da-29435a20ed84 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:06.132388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c4bff50-54a1-48ee-b6da-29435a20ed84 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:06.139636 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c4bff50-54a1-48ee-b6da-29435a20ed84 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1237 microversion: 2.1 time: 0.064978 Oct 10 11:30:06.140422 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3273/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:06 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:07.165421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:07.166682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:07.173807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:07.174353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:07.174815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:07.175579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:07.176059 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:07.176507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:07.239599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:07.247418 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23cc7491-f4e8-4da6-b97e-576cbf5deae5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1295 microversion: 2.1 time: 0.087767 Oct 10 11:30:07.248585 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3374/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:07 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:08.271908 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:08.272535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:08.280596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:08.281097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:08.281548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:08.282258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:08.282723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:08.283194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:08.421856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:08.425525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:08.436581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09a16991-97f4-4028-8d62-87564b8fd5f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.168476 Oct 10 11:30:08.437088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:08.437600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:08.438115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:08.438546 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3274/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:08 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:08.450115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] Creating event network-changed:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h2-860687-2 Oct 10 11:30:08.455939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ade3210d-473d-4a1c-ac1b-a12342a8f8b2 req-de3617c1-6534-4fab-87c7-d4bbf9335aab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038767 Oct 10 11:30:08.457122 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3375/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:30:09.461063 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:09.461724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:09.468510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:09.468995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:09.469430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:09.470116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:09.470569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:09.471017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:09.603599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:09.612530 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db434268-00ec-4d38-b79b-a52ad7e5a883 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.155516 Oct 10 11:30:09.613144 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3275/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:09 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:10.637328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:10.637829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:10.644291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:10.644799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:10.645257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:10.645969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:10.646445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:10.646920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:10.778515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:10.786373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1844d36c-7985-4571-8b2d-f0919d30076a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.154461 Oct 10 11:30:10.786946 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3376/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:10 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:11.809718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:11.810969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:11.813818 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:11.818808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:11.819338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:11.819784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:11.820481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:11.820942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:11.821375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:11.952116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:11.960417 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bc61de0-2e30-4ef8-bc30-ee837ebd31e7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.154587 Oct 10 11:30:11.960992 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3276/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:11 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:12.983494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:12.984133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:12.987081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:12.992667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:12.993174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:12.993628 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:12.994336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:12.994809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:12.995305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:13.127255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:13.134912 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6e10c214-b118-4ea9-b444-07968f0da489 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.155344 Oct 10 11:30:13.135522 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3377/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:12 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:13.707129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "name": "network-vif-plugged", "status": "completed", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:13.719139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:13.719649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:13.720067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:13.731432 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] Creating event network-vif-plugged:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h2-860687-2 Oct 10 11:30:13.736834 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ea04c922-72b0-4dc4-b0cb-9fa4f99816b4 req-ef590ddb-d367-4415-b499-4099e96f02a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Oct 10 11:30:13.737444 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3277/6654] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:30:14.159348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:14.160010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:14.166911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:14.167443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:14.167893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:14.168596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:14.169064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:14.169501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:14.299330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:14.306986 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d77ac4e5-3d62-408f-a486-1c8c9256804f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1362 microversion: 2.1 time: 0.151607 Oct 10 11:30:14.307593 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3378/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:14 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:15.331783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:15.332495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:15.338960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:15.339484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:15.339931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:15.340628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:15.341093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:15.342025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:15.472054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:15.480114 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fb11a0e-3284-4d6c-8e6e-07f5210ee5a9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1548 microversion: 2.1 time: 0.153617 Oct 10 11:30:15.480686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3278/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:15 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:15.504963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:15.505477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:15.512378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:15.512912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:15.513794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:15.514514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:15.515041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:15.515489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:15.592865 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d2b66e19-facc-4f94-9c18-355023d535a1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090761 Oct 10 11:30:15.593461 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3379/6657] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:30:15 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:30:16.516896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:16.521750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:16.528365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:16.528879 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:16.529438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:16.540568 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] Creating event network-changed:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h2-860687-2 Oct 10 11:30:16.546284 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fddcaba8-140a-4d8d-a6d0-6127deb3063d req-29cf3e24-b977-4189-a0d7-c7eafcec1238 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 Oct 10 11:30:16.546904 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3279/6658] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:30:49.484716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.485520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.487546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=5 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.488284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=37 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.493750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:30:49.501852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:49.502362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:49.502812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:49.524600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Going to try to stop instance {{(pid=128800) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:30:49.566706 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a169c460-0130-43c6-9dd2-124694208f34 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action" status: 202 len: 0 microversion: 2.1 time: 0.082192 Oct 10 11:30:49.567355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3380/6659] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:30:49 2022] POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:30:49.574099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.574937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:30:49.580042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:49.580793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:49.588211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:49.588687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:49.589137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:49.589830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:49.590290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:49.590720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:49.724757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:49.732510 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4356fa1c-1b32-4c09-a7b9-2d2395882530 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.160526 Oct 10 11:30:49.733649 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3280/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:49 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:50.759347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:50.759990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:50.767019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:50.767528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:50.767982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:50.768688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:50.769161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:50.769601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:50.896796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:50.904604 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a0466a6-f7b6-4a44-a3ea-a787161cba35 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.149669 Oct 10 11:30:50.906155 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3381/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:50 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:51.929263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:51.929883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:51.937370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:51.937861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:51.938304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:51.939012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:51.939484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:51.939915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:52.069318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:52.077392 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d53e2af2-5607-48c2-ab05-b719b29959b9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.152105 Oct 10 11:30:52.077967 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3281/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:51 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:53.100708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:53.101341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:53.108260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:53.108766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:53.109225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:53.109938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:53.110427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:53.110860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:53.237927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:53.245712 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eb0dbc7c-a81e-4b60-81e4-f50b668490b2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.148975 Oct 10 11:30:53.246284 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3382/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:53 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:30:54.270331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:54.270955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:54.277858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:54.278346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:54.278794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:54.279527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:54.280644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:54.281078 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:54.408240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:54.415909 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33d46a79-39c4-4c14-90f5-c0edd3a20fec tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.149547 Oct 10 11:30:54.416477 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3282/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:54 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:55.439701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:55.440348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:55.447250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:55.447764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:55.448225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:55.448990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:55.449455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:55.449902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:55.584004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:55.591782 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-23fc67ee-a07e-49fb-a50e-e3dcff10a2a2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.156186 Oct 10 11:30:55.593041 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3383/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:55 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:56.616260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:56.616902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:56.624307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:56.624793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:56.625229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:56.625914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:56.626369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:56.626791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:56.756677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:56.764552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89c6e24f-0f2d-4a06-a34e-ec1a7574eb40 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.152167 Oct 10 11:30:56.765164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3283/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:56 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:57.789165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:57.789727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:57.797757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:57.798266 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:57.798748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:57.799491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:57.799972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:57.800421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:57.933910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:57.942689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-366e32ab-447d-439a-b966-88389de0c841 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.157571 Oct 10 11:30:57.943297 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3384/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:57 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:30:58.965931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:30:58.966547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:30:58.973746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:58.974232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:58.974672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:58.975391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:30:58.975851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:30:58.976279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:30:59.104848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:30:59.113565 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d72f62f1-f2cb-451c-9e5a-0abe9bf7b125 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.151532 Oct 10 11:30:59.114144 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3284/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:30:58 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:00.137334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:00.137991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:00.145194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:00.145692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:00.146144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:00.146851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:00.147356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:00.147799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:00.275504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:00.283780 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4386c085-997f-448a-9fa8-15a249ac76df tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.150543 Oct 10 11:31:00.284355 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3385/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:00 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:01.306748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:01.307399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:01.314619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:01.315138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:01.315584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:01.316286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:01.316775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:01.317204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:01.449444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:01.457948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03f3a3da-a85e-4b70-ac05-91c4e255f18d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.155078 Oct 10 11:31:01.458777 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3285/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:01 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:02.481713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:02.482350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:02.489803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:02.490311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:02.490768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:02.491514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:02.491992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:02.492442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:02.621629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:02.629572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c786a3c7-fa80-466d-b3d1-9b505730bf07 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.151767 Oct 10 11:31:02.630156 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3386/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:02 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:03.653821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:03.654377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:03.661787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:03.662269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:03.662704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:03.663441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:03.663894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:03.664317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:03.794805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:03.803775 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04d16f32-2793-4f58-b58a-1a86e7c3d720 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.153912 Oct 10 11:31:03.804353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3286/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:03 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:04.829711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:04.830240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:04.837674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:04.838175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:04.838634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:04.839377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:04.839856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:04.840310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:04.978234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:04.986212 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1c192c2-73f2-42f9-ae94-7d7a55b58d4a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.162199 Oct 10 11:31:04.986777 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3387/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:04 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:06.009727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:06.010348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:06.017861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.018356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.018796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.019522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.019986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.020423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.149844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:06.158305 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0ceea51-cb4e-4651-a6da-df5a69bba094 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1654 microversion: 2.1 time: 0.152490 Oct 10 11:31:06.158873 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3287/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:06 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:06.181117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:06.183535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:06.190128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.190642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.191145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.191875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.192359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.192813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.221834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:06.227319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Old instance type m1.heat2, new instance type m1.heat {{(pid=128800) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:31:06.233932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:31:06.234384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:31:06.234914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:31:06.235380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:31:06.235822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:31:06.301509 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc6158a6-6233-4a32-b7b1-6873ff692ede tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action" status: 202 len: 0 microversion: 2.1 time: 0.124037 Oct 10 11:31:06.302048 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3388/6675] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:31:06 2022] POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:31:06.310401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:06.311875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:06.318028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.318529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.318982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.319712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:06.320347 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:06.320787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:06.475376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:06.483829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b304412f-ce55-4425-a915-81548f4fdf37 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.176831 Oct 10 11:31:06.484520 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3288/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:06 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:31:07.507289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:07.507959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:07.516268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:07.516787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:07.517247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:07.517981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:07.518456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:07.518899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:07.655621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:07.663572 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26e783e3-cdf6-4b5c-b64e-17a5438eb7fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1677 microversion: 2.1 time: 0.160292 Oct 10 11:31:07.664246 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3389/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:07 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:08.687778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:08.688326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:08.694805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:08.695335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:08.695786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:08.696487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:08.696959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:08.697397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:08.828244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:08.836195 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a74cba3-814e-4035-a415-e73e30d5cf93 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1682 microversion: 2.1 time: 0.153153 Oct 10 11:31:08.836767 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3289/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:08 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:09.860317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:09.860964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:09.868956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:09.869612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:09.870081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:09.870866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:09.871378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:09.871831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:10.017747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:10.025479 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a0f88fec-c603-430f-8d30-2dd2d27cf15a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1681 microversion: 2.1 time: 0.169492 Oct 10 11:31:10.026050 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3390/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:09 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:10.335175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "name": "network-vif-unplugged", "status": "completed", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:10.347634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:10.348576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:10.349166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:10.363999 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Creating event network-vif-unplugged:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h1-860687-2 Oct 10 11:31:10.369759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:31:10.383702 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-80ea7779-aa6b-41d1-bd03-92a744a1a120 req-1b1855f5-c989-4d58-8d48-d62c1bf5d887 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052800 Oct 10 11:31:10.384323 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3290/6680] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:11.050340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:11.051148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:11.058209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:11.058715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:11.059208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:11.059930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:11.060408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:11.060855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:11.194360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:11.203299 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a2727c0-412b-49b2-8abc-248536d84699 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1681 microversion: 2.1 time: 0.157106 Oct 10 11:31:11.203892 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3391/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:11 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:12.228790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:12.229487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:12.235792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:12.236276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:12.236713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:12.237396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:12.237848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:12.238270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:12.368987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:12.377852 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89303f9e-dc3e-4bd4-84a6-9668c035d916 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1679 microversion: 2.1 time: 0.154253 Oct 10 11:31:12.378435 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3291/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:12 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:12.402852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:12.413464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:12.414009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:12.414485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:12.426453 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Creating event network-changed:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h1-860687-2 Oct 10 11:31:12.432310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:31:12.443660 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-28d75211-3d98-4645-84f3-63c3b313ebf2 req-27b66b74-c4b3-4781-89ff-176def525ee2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044436 Oct 10 11:31:12.444270 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3392/6683] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:13.401830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:13.403276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:13.410698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.411215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.411659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.412359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.412810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.413236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.546891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:13.554785 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51ea066a-b0ac-46b5-8cc3-bb198d6e7077 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1675 microversion: 2.1 time: 0.156818 Oct 10 11:31:13.555391 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3292/6684] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:13 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:13.579952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:13.580606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:13.587136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.587656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.588119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.588848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.589330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.589782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.630655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:13.652756 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f608e8de-3b38-4ca8-85bf-43dab986bb5c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action" status: 204 len: 0 microversion: 2.1 time: 0.078492 Oct 10 11:31:13.653354 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3393/6685] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:31:13 2022] POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:31:13.661691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:13.662303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:13.668741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.669323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.669870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.671140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:13.671894 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:13.672330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:13.805026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:13.812838 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6a02540-428f-4ac5-9829-42f80e7462d3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1675 microversion: 2.1 time: 0.155005 Oct 10 11:31:13.813407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3293/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:13 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:14.837296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:14.838018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:14.845475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:14.845980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:14.846432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:14.847241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:14.847715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:14.848157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:14.985731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:14.993603 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc67a28b-3e18-4533-8af5-b8ac58981f6b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1654 microversion: 2.1 time: 0.160855 Oct 10 11:31:14.994208 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3394/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:14 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:15.016790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:15.017413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:15.024117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:15.024637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:15.025085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:15.025789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:15.026252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:15.026686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:15.154364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:15.162791 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c3f84df-c012-44f8-a3f9-8f218fa5d056 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1654 microversion: 2.1 time: 0.150348 Oct 10 11:31:15.163465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3294/6688] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:15 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:15.185579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:15.192247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:15.192755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:15.193213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:15.216065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Going to try to start instance {{(pid=128800) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:31:15.256429 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1d486d59-021d-4d53-a2ab-7dffd16d68fb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action" status: 202 len: 0 microversion: 2.1 time: 0.074739 Oct 10 11:31:15.257026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3395/6689] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:31:15 2022] POST /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:31:15.265933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:15.266552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:15.272889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:15.273499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:15.273860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:15.274698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:15.275228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:15.275676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:15.413695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:15.423095 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9bac2bb4-9b3c-4b56-bbe5-0c792523b726 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1663 microversion: 2.1 time: 0.161424 Oct 10 11:31:15.424135 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3295/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:15 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:16.445996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:16.446729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:16.458804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.460008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.460520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.461295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.461826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.462810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.496042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "name": "network-vif-plugged", "status": "completed", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:16.507392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.507939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.508380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.523656 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] Creating event network-vif-plugged:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h1-860687-2 Oct 10 11:31:16.528690 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c5ba2bdd-39e4-403a-a2cd-5b463eed8ad4 req-a207f862-f2c8-47fc-9263-285f5e938d97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111969 Oct 10 11:31:16.529966 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3396/6691] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:16.602246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:16.605909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:16.612239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-661318f7-51c2-48c2-9c02-6b328b9eaaa6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1667 microversion: 2.1 time: 0.170259 Oct 10 11:31:16.612816 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3296/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:16 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:16.636052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:16.636661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:16.643216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.643726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.644243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.644963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.645475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.645927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.671592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:31:16.745204 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1204a4e8-31bb-47c6-8b1c-10ad8b9466a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 204 len: 0 microversion: 2.1 time: 0.113089 Oct 10 11:31:16.745907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3397/6693] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:31:16 2022] DELETE /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:31:16.756552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:16.757163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:16.763366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.763853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.764299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.765121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:16.765576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:16.766002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:16.899158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:16.907714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eae19551-8395-4251-b83e-1d94ecca376e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1673 microversion: 2.1 time: 0.155683 Oct 10 11:31:16.908304 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3297/6694] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:16 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:17.932699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:17.933428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:17.941014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:17.941527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:17.941989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:17.942710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:17.943252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:17.943703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:18.072707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:18.080980 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-90635dba-6b9a-47de-9091-83fdbe4c35a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1673 microversion: 2.1 time: 0.152565 Oct 10 11:31:18.081587 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3398/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:17 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:18.883688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39796bb9-3de5-43c1-a8c7-0884a2933304", "name": "network-vif-deleted", "tag": "78a3e161-1680-450f-b7d4-2ce4a2a12f88"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:18.900005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:18.900488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:18.900914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:18.913890 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] Creating event network-vif-deleted:78a3e161-1680-450f-b7d4-2ce4a2a12f88 for instance 39796bb9-3de5-43c1-a8c7-0884a2933304 on n-h1-860687-2 Oct 10 11:31:18.918978 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1ae69c8c-ff5c-4233-9822-c85ee9ee8962 req-4e38c5ca-c679-47fa-b925-10148d5afdc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Oct 10 11:31:18.919972 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3298/6696] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:19.104888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:19.106155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:19.116947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:19.117528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:19.118180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:19.119032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:19.121153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:19.121595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:19.157938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:19.158462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:19.159172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:19.159644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lazy-loading 'fault' on Instance uuid 39796bb9-3de5-43c1-a8c7-0884a2933304 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:31:19.202876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:19.210262 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f0b16fe6-9959-4be5-a251-b01affa22e22 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 200 len: 1327 microversion: 2.1 time: 0.109369 Oct 10 11:31:19.210819 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3399/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:19 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:20.235258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:20.235965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:20.237933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=39 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:20.243951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.244432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.244869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.245559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.246013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.246435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.260009 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 HTTP/1.1 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '39796bb9-3de5-43c1-a8c7-0884a2933304'} Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:31:20.261660 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-455038dd-aa75-48df-b52f-bf410edd92f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 404 len: 111 microversion: 2.1 time: 0.032938 Oct 10 11:31:20.266539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3299/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:20 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:31:20.277448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:20.278088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:20.281696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:20.287182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.287694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.288149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.288875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.289345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.289788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.304132 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 HTTP/1.1 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '39796bb9-3de5-43c1-a8c7-0884a2933304'} Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:31:20.305860 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f033df7e-5884-48c2-bcd8-f91a432ece2c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 404 len: 111 microversion: 2.1 time: 0.033831 Oct 10 11:31:20.310053 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3400/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:20 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:31:20.356702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1906150469", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8f3b280f-a8e9-48d9-8fee-8184b3cacde3"}], "security_groups": [{"name": "tempest-securitygroup--388977224"}], "key_name": "tempest-keypair-1973446155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:20.462204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] validate_networks() for [('8f3b280f-a8e9-48d9-8fee-8184b3cacde3', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:31:20.895400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:31:20.895851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:31:20.896306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:31:20.896716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:31:20.897125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:31:20.905917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.906394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.906826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.907582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:20.908037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:20.908459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:20.925461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:31:20.930718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:31:20.943684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:31:20.945989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:31:20.993168 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-389b5eaf-b490-44c8-8b68-b0e8b5c8deb0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.639675 Oct 10 11:31:21.000906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3300/6700] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:31:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:31:21.006329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da3082c2-8e6f-4239-984e-f4ca32e4f60f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:21.007070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da3082c2-8e6f-4239-984e-f4ca32e4f60f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:21.068737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da3082c2-8e6f-4239-984e-f4ca32e4f60f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:21.075913 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da3082c2-8e6f-4239-984e-f4ca32e4f60f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1239 microversion: 2.1 time: 0.073677 Oct 10 11:31:21.078575 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3401/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:21 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:22.107232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:22.109411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:22.116560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:22.117062 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:22.117506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:22.118216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:22.118667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:22.119132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:22.188819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:22.201072 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9f387e0-2c24-4c0a-8523-46477f09b9bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1309 microversion: 2.1 time: 0.100292 Oct 10 11:31:22.202093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3301/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:22 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:23.225841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:23.226614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:23.234520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:23.235041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:23.235500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:23.236213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:23.236715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:23.237162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:23.367823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:23.375897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-175ade1e-e536-4f9b-b252-5501d131f325 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.154019 Oct 10 11:31:23.376497 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3402/6703] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:23 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:23.471858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0c8e0-2fed-47d8-b00a-5cb230f04ee0", "tag": "074a1af5-1620-436c-b421-e8c8f43a1067"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:23.482948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:23.483870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:23.484397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:23.497262 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] Creating event network-changed:074a1af5-1620-436c-b421-e8c8f43a1067 for instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 on n-h1-860687-2 Oct 10 11:31:23.502869 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2a3eeaf8-476d-4f67-86e1-32e54b8b153e req-fe91dadd-04f5-46ff-af7f-1ac830674823 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035448 Oct 10 11:31:23.503762 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3302/6704] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:24.399695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:24.400337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:24.407957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:24.408466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:24.408921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:24.409635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:24.410112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:24.410560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:24.545041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:24.553274 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1a4718b3-07ee-4d31-9a37-40af048a6fa0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.157581 Oct 10 11:31:24.553846 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3403/6705] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:24 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:25.577606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:25.578302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:25.584790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:25.585274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:25.585710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:25.586394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:25.586852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:25.587302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:25.714418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:25.722303 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58ebbfac-513b-439f-a5ba-da59ea444541 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.149834 Oct 10 11:31:25.722870 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3303/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:25 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:26.746863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:26.747482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:26.755150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:26.755660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:26.756115 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:26.756832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:26.757308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:26.757750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:26.902259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:26.910409 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b40a8f03-b4f3-4549-8b71-78b095045496 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.168368 Oct 10 11:31:26.911195 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3404/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:26 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:27.934133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:27.934751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:27.941683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:27.942175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:27.942620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:27.943350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:27.943813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:27.944277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:28.074630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:28.082907 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef92dcc6-88f2-448b-b989-bad4035cdf8e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.152731 Oct 10 11:31:28.083776 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3304/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:27 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:29.105753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:29.106504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:29.113994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:29.114497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:29.114945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:29.115685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:29.116158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:29.116600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:29.244456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:29.252651 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8867963a-3e88-4994-8902-4f68e1010f89 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.150800 Oct 10 11:31:29.253260 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3405/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:29 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:30.276689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:30.277307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:30.284872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:30.285354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:30.285792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:30.286481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:30.286934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:30.287385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:30.426449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:30.434325 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29088b14-d8a7-4167-967d-ed1a824a6bb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.161490 Oct 10 11:31:30.434925 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3305/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:30 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:30.473178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0c8e0-2fed-47d8-b00a-5cb230f04ee0", "name": "network-vif-plugged", "status": "completed", "tag": "074a1af5-1620-436c-b421-e8c8f43a1067"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:30.484841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:30.485352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:30.485809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:30.497106 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] Creating event network-vif-plugged:074a1af5-1620-436c-b421-e8c8f43a1067 for instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 on n-h1-860687-2 Oct 10 11:31:30.502250 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-92a37f86-f392-409e-854a-c72ddf9035ba req-b93ab357-195b-43b7-b6aa-e93884e38356 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Oct 10 11:31:30.502851 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3406/6711] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:31.457752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:31.458652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:31.460694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:31.461384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:31.468614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:31.469101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:31.469535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:31.470231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:31.470682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:31.471132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:31.599596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:31.608323 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f530943-2e9b-4f05-8957-89dd19aac6e8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1364 microversion: 2.1 time: 0.153755 Oct 10 11:31:31.608911 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3306/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:31 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:32.629240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:31:32.634484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:32.635188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:32.642392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:32.642889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:32.643364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:32.644065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:32.644535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:32.644974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:32.774876 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:31:32.782825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b737dec3-10cc-4497-821f-fde32af984cc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1550 microversion: 2.1 time: 0.154581 Oct 10 11:31:32.783445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3407/6713] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:31:32 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:31:32.805536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:31:32.806036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:31:32.808233 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:31:32.808384 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/os-interface (ip 10.222.0.16) !!! Oct 10 11:31:32.816006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:32.816494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:32.816937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:32.817641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:32.818103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:32.818533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:33.209615 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3abac49c-59af-489e-82fa-0a99242f49f2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.407994 Oct 10 11:31:33.210251 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3307/6714] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:31:32 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/os-interface => generated 284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:31:34.137452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de0c8e0-2fed-47d8-b00a-5cb230f04ee0", "tag": "074a1af5-1620-436c-b421-e8c8f43a1067"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:31:34.148019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:31:34.148650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:31:34.149107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:31:34.160732 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] Creating event network-changed:074a1af5-1620-436c-b421-e8c8f43a1067 for instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 on n-h1-860687-2 Oct 10 11:31:34.165728 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-b6d364e4-d34e-40f7-a76f-0b5c0052abc3 req-7859eaf1-0607-4a34-9ce8-a409e9c3b0f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031954 Oct 10 11:31:34.166327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3408/6715] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:32:06.992541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:06.993298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=48 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:06.998147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:07.000531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:07.008076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:07.008562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:07.008999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:07.009686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:07.010140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:07.010564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:07.038416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:07.043708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:32:07.050625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:32:07.051073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:32:07.051544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:32:07.051951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:32:07.052367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:32:07.115220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4dce07e-745c-4e5d-8792-b2e3d7695bb2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/action" status: 202 len: 0 microversion: 2.1 time: 0.124514 Oct 10 11:32:07.115914 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3308/6716] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:32:06 2022] POST /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:32:07.124862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:07.125594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:07.130927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=19 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:07.131928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=83,nova_cell1:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:07.138299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:07.138846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:07.139376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:07.140116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:07.140679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:07.141125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:07.310523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:07.318566 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-80ee5e85-b501-4c22-b1cd-2ff9f8f3f9ba tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1678 microversion: 2.1 time: 0.198055 Oct 10 11:32:07.319150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3409/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:07 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:08.344010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:08.344637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:08.351843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:08.352335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:08.352773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:08.353795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:08.354266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:08.354692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:08.486823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:08.494885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3169dab4-925d-4468-a2ea-1e1a93a8301d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1678 microversion: 2.1 time: 0.156855 Oct 10 11:32:08.495508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3309/6718] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:08 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:09.518518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:09.519190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:09.526103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:09.526615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:09.527111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:09.527841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:09.528866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:09.529334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:09.657954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:09.665719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57e7313e-ecd9-4566-b025-c13ccb7c6359 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.151191 Oct 10 11:32:09.666285 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3410/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:09 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:10.690503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:10.691080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:10.697919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:10.698410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:10.698854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:10.699577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:10.700037 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:10.700476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:10.837132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:10.845181 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c3717f4-027b-4cc5-825c-13b6e9f99b7b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.158792 Oct 10 11:32:10.845755 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3310/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:10 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:11.868532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:11.869165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:11.876228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:11.876730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:11.877182 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:11.877892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:11.878390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:11.878835 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:12.009914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:12.018242 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-762b4913-2fea-4959-b80e-27a26fe994ee tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.153805 Oct 10 11:32:12.018834 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3411/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:11 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:13.042116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:13.042739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:13.050459 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:13.050950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:13.051446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:13.052177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:13.052665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:13.053129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:13.185625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:13.193780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f87e6ce2-00f2-4e88-b98b-e8153b99789e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.155558 Oct 10 11:32:13.194355 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3311/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:13 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:32:14.216133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:14.217425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:14.224735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:14.225241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:14.225700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:14.226421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:14.226898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:14.227374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:14.356347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:14.365871 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-347f87fd-96c5-443c-b665-d44c917366c7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.153646 Oct 10 11:32:14.366459 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3412/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:14 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:15.392079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:15.392700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:15.399566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:15.400058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:15.400503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:15.401204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:15.401660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:15.402089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:15.535017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:15.542763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c078a229-2b3f-48e9-81a1-855f09fb6e95 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.156950 Oct 10 11:32:15.543362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3312/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:15 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:16.566265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:16.566904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:16.573844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:16.574351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:16.574815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:16.575562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:16.576054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:16.576607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:16.704063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:16.712710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17eab5cb-f00b-4e6e-94a6-bbaf34949df7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.150602 Oct 10 11:32:16.713289 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3413/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:16 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:17.737057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:17.738317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:17.745391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:17.745875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:17.746314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:17.747030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:17.747536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:17.748919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:17.880843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:17.888629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b05c4937-ebbc-4ab7-b665-bea32201d37b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.156384 Oct 10 11:32:17.889258 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3313/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:17 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:32:18.911190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:18.911828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:18.918874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:18.919404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:18.919885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:18.920746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:18.921247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:18.921689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:19.055392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:19.063753 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-51dc992c-e218-4c21-addb-4c415aac84f7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.156483 Oct 10 11:32:19.064320 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3414/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:18 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:20.087637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:20.088279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:20.096092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:20.096582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:20.097024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:20.097719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:20.098182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:20.098615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:20.227890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:20.235611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea2f68c5-0198-4537-aaf0-0323bd25dbc2 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.152286 Oct 10 11:32:20.236193 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3314/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:20 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:21.259393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:21.260030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:21.267547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:21.268048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:21.268501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:21.269207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:21.269677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:21.270117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:21.409465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:21.417351 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5a0298a7-02c2-44b9-b462-62ad68b5784c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.162088 Oct 10 11:32:21.417933 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3415/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:21 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:22.440875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:22.441493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:22.448382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:22.448866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:22.449310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:22.449997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:22.450451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:22.450977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:22.580651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:22.588762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06628467-3db8-4731-b39d-cd89dc605ccd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.151796 Oct 10 11:32:22.589337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3315/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:22 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:23.613331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:23.613978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:23.620897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:23.621413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:23.621874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:23.622597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:23.623730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:23.624183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:23.754386 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:23.762376 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fee8f4a2-dc79-4628-b31d-2369ead74377 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.153113 Oct 10 11:32:23.764161 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3416/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:23 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:24.785483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:24.786019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:24.792869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:24.793349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:24.793784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:24.794475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:24.794947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:24.795380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:24.930529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:24.938772 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f1917b4-68c2-4389-a4f9-56f7202b11e9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1683 microversion: 2.1 time: 0.157246 Oct 10 11:32:24.939372 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3316/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:24 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:25.961970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:25.962603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:25.970040 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:25.970544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:25.971015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:25.971732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:25.972203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:25.972648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:26.106632 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:26.115228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c9865910-87b1-452d-b0c6-909d2a26495f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1682 microversion: 2.1 time: 0.157379 Oct 10 11:32:26.115850 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3417/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:25 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:27.138729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:27.139376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:27.146224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:27.146712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:27.147188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:27.147887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:27.148356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:27.148787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:27.283815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:27.291656 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40d947bd-1348-44d6-a6d5-92b62002198a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1680 microversion: 2.1 time: 0.157007 Oct 10 11:32:27.292243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3317/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:27 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:28.315993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:28.316648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:28.323757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.324260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.324711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.325416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.326232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.326347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.460826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:28.469883 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-820ad621-a47f-47d9-a425-8ab3bcc25c6d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1677 microversion: 2.1 time: 0.157789 Oct 10 11:32:28.470396 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3418/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:28 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:28.492633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:28.493174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:28.500176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.500666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.501107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.501802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.502263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.502696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.540002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.540478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.540916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.541642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.542097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.542527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.562589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:32:28.567846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:32:28.668073 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfa1012b-1db5-4f50-862e-92bf8e11abcd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/action" status: 202 len: 0 microversion: 2.1 time: 0.179135 Oct 10 11:32:28.668686 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3318/6736] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:32:28 2022] POST /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:32:28.677949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:28.678577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:28.684620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.685241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.686067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.686865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:28.687470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:28.687984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:28.825284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:28.834154 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8d456eb3-4c26-44c7-b1a2-5c9bce679b27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1676 microversion: 2.1 time: 0.160876 Oct 10 11:32:28.834920 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3419/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:28 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:29.859618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:29.860359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:29.867594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:29.868099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:29.868536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:29.869222 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:29.869679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:29.870105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:29.997564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:30.005391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91ecdce1-c306-4d40-97a2-036cfea25143 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1676 microversion: 2.1 time: 0.151902 Oct 10 11:32:30.005963 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3319/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:29 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:31.029447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:31.030845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:31.038517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:31.039444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:31.039602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:31.040244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:31.041099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:31.041212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:31.079963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0c8e0-2fed-47d8-b00a-5cb230f04ee0", "name": "network-vif-unplugged", "status": "completed", "tag": "074a1af5-1620-436c-b421-e8c8f43a1067"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:31.103417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:31.103903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:31.104553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:31.120103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:31.124763 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Creating event network-vif-unplugged:074a1af5-1620-436c-b421-e8c8f43a1067 for instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 on n-h1-860687-2 Oct 10 11:32:31.132361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:32:31.142817 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b3013649-4087-43b5-a4b3-7f7d76a1712d req-6d392b42-0331-44c8-a9b4-222a77d06c54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067282 Oct 10 11:32:31.144196 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3320/6739] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:32:31.205369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:31.219490 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a2c2226f-a822-42aa-93f5-428913976d31 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1676 microversion: 2.1 time: 0.194434 Oct 10 11:32:31.231226 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3420/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:31 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:32.245085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:32.245794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:32.252870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:32.253361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:32.253799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:32.254498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:32.254958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:32.255416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:32.455293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:32.463539 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-316b2108-f9dd-45e1-9d9d-f0051c2866bb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1676 microversion: 2.1 time: 0.223540 Oct 10 11:32:32.464113 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3321/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:32 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:33.487489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:33.488121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:33.495777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.496296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.496761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:33.498017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.498500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.498980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:33.681755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:33.689966 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bae34769-08b7-41d8-abb5-e11b94327b08 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1669 microversion: 2.1 time: 0.206392 Oct 10 11:32:33.690538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3421/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:33 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:33.712791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:33.713419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:33.721011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.721501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.721944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:33.722647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.723138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.723577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:33.858591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:33.866600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8557e66-1b1f-4b3a-8c8b-bd946bfd7e43 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1669 microversion: 2.1 time: 0.157657 Oct 10 11:32:33.867216 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3322/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:33 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:32:33.889498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:33.890056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:33.896072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.896572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.897023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:33.897726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:33.898196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:33.898636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:34.027253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:34.035761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55136eae-24cd-47dc-b851-1f0fd33d6e55 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1669 microversion: 2.1 time: 0.150828 Oct 10 11:32:34.036322 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3422/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:33 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:34.057742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:34.058248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:34.064733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:34.065221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:34.065660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:34.066356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:34.066812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:34.067269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:34.093234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:32:34.170009 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f2a5fde-0dce-47a7-ba45-1a5dcde17f6a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 204 len: 0 microversion: 2.1 time: 0.115095 Oct 10 11:32:34.170673 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3323/6745] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:32:34 2022] DELETE /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:32:34.178911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:34.179703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:34.185724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:34.186227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:34.186682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:34.187426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:34.187966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:34.188411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:34.316123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:34.323947 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0ac6c97-c27f-45a0-a235-813e3e3009b0 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1675 microversion: 2.1 time: 0.148932 Oct 10 11:32:34.324519 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3423/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:34 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:35.348653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:35.349367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:35.357859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:35.358351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:35.358789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:35.359522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:35.359982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:35.360433 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:35.495988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:35.504659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33089160-1d55-4748-83d8-c792be69ebb5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1675 microversion: 2.1 time: 0.160229 Oct 10 11:32:35.505243 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3324/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:35 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:36.277555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de0c8e0-2fed-47d8-b00a-5cb230f04ee0", "name": "network-vif-deleted", "tag": "074a1af5-1620-436c-b421-e8c8f43a1067"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:36.297670 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:36.300046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:36.300596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:36.319223 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] Creating event network-vif-deleted:074a1af5-1620-436c-b421-e8c8f43a1067 for instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 on n-h1-860687-2 Oct 10 11:32:36.324861 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e9988add-6fd1-48a4-b097-803915b776c3 req-dd52b230-c53a-4509-92eb-2fc773f90e6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051106 Oct 10 11:32:36.330344 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3424/6748] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:32:36.528152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:36.529024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:36.535927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:36.536469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:36.536909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:36.537613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:36.538069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:36.538495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:36.570295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:36.570776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:36.571242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:36.571690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lazy-loading 'fault' on Instance uuid 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:32:36.613817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:36.621636 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-daf705e3-eec6-4487-842b-a244a2b7fcd9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 200 len: 1329 microversion: 2.1 time: 0.097413 Oct 10 11:32:36.631427 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3325/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:36 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:37.646513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:37.647269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:37.649261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=33 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:37.656237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:37.656745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:37.657198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:37.657940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:37.658410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:37.658851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:37.661531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=93 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:37.673304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 HTTP/1.1 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '8de0c8e0-2fed-47d8-b00a-5cb230f04ee0'} Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:32:37.674943 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-077f3891-769f-48d8-b768-8fc8f892ad81 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 404 len: 111 microversion: 2.1 time: 0.034950 Oct 10 11:32:37.679263 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3425/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:37 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:32:37.692805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:37.693472 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:37.696348 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:37.703279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:37.703789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:37.704234 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:37.704933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:37.705396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:37.705829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:37.720898 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 HTTP/1.1 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8de0c8e0-2fed-47d8-b00a-5cb230f04ee0'} Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:32:37.722558 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbfeb3c8-320b-42eb-92cd-730d137b6641 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 404 len: 111 microversion: 2.1 time: 0.035141 Oct 10 11:32:37.726849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3326/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:37 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:32:37.773133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1942249405", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "8f3b280f-a8e9-48d9-8fee-8184b3cacde3"}], "security_groups": [{"name": "tempest-securitygroup--388977224"}], "key_name": "tempest-keypair-1973446155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:37.877332 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] validate_networks() for [('8f3b280f-a8e9-48d9-8fee-8184b3cacde3', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:32:38.289894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:32:38.290343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:32:38.290833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:32:38.291302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:32:38.291732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:32:38.301198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:38.301702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:38.302153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:38.302921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:38.303418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:38.303860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:38.321029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:32:38.326257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:32:38.338816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:32:38.341292 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:32:38.388672 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7426b8c1-0533-4bdf-ba47-325bc002a07a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619351 Oct 10 11:32:38.389332 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3426/6752] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:32:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:32:38.400936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbf48c81-7caa-463d-ae67-b935a8d1ab27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:38.401806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbf48c81-7caa-463d-ae67-b935a8d1ab27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:38.458453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbf48c81-7caa-463d-ae67-b935a8d1ab27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:38.465486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbf48c81-7caa-463d-ae67-b935a8d1ab27 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1239 microversion: 2.1 time: 0.068596 Oct 10 11:32:38.466175 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3327/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:38 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:39.490301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:39.490946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:39.499025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:39.499550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:39.500032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:39.500772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:39.501466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:39.501922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:39.569312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:39.577352 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2cb667ef-4dcb-4d54-869f-acd650457b0e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1309 microversion: 2.1 time: 0.091957 Oct 10 11:32:39.577942 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3427/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:39 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:40.601816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:40.602735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:40.604843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:40.612254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:40.612806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:40.613251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:40.613963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:40.614425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:40.614850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:40.745584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:40.755075 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af7ca00f-dbd5-4fea-a6e6-09a569360406 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.157083 Oct 10 11:32:40.755679 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3328/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:40 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:40.785934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:40.800680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:40.801189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:40.801834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:40.814492 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] Creating event network-changed:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:32:40.819476 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-03d4aa4b-39bc-4ffe-b3aa-302991b8fae9 req-0f7e6a48-b136-4ee8-ae48-f23d7bebd02f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038026 Oct 10 11:32:40.820114 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3428/6756] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:32:41.780952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:41.781509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:41.788520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:41.789013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:41.789462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:41.790164 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:41.790632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:41.791098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:41.919981 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:41.928068 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-318376c6-cbf9-4523-88f0-e573efdae800 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.151665 Oct 10 11:32:41.928584 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3329/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:41 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:42.953736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:42.954481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:42.960996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:42.961500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:42.961951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:42.962674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:42.963175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:42.963614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:43.097293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:43.105140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ba9819c-2925-4f6d-b3be-8d8848280645 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.156826 Oct 10 11:32:43.105709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3429/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:42 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:44.129870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:44.130492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:44.137215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:44.137709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:44.138153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:44.138849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:44.139343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:44.139777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:44.270855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:44.280001 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-204cfd6b-058a-4795-8db8-64408a0c9374 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.153594 Oct 10 11:32:44.280609 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3330/6759] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:44 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:45.302916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:45.303610 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:45.311515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:45.312024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:45.312513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:45.313229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:45.313732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:45.314178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:45.445881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:45.454201 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eceea636-e794-44a8-adad-86854108a9fe tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.155192 Oct 10 11:32:45.454774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3430/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:45 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:46.470928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "name": "network-vif-plugged", "status": "completed", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:46.480742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:46.482582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:46.483104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:46.483516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:46.483627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:46.494746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:46.495445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:46.495917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:46.496667 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] Creating event network-vif-plugged:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:32:46.497187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:46.501173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:46.501731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:46.502537 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6600a517-7e7e-4e9f-9f0f-b5331a650331 req-862a4689-de37-42da-b199-f91559b2f105 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Oct 10 11:32:46.503586 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3331/6761] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:32:46.640396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:46.648104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8832760-0ef3-472d-84a3-320cf78bc163 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.174232 Oct 10 11:32:46.648690 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3431/6762] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:46 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:47.673829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:47.674439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:47.680777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:47.681271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:47.681713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:47.682411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:47.683470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:47.683909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:47.824799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:47.833945 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f70caa1-f427-4861-ba41-8337fb7de87b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1364 microversion: 2.1 time: 0.165540 Oct 10 11:32:47.834519 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3332/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:47 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:48.858425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:48.859072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:48.861943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:48.862705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:48.868652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:48.869152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:48.869607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:48.870312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:48.870781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:48.871257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:49.001057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:32:49.008743 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc798b34-e107-46e3-b98b-350cdd0cf062 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1550 microversion: 2.1 time: 0.154868 Oct 10 11:32:49.009331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3432/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:32:48 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:32:49.032388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:32:49.032928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:32:49.034816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:32:49.041082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:49.041587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:49.042027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:49.042754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:49.043252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:49.043803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:49.120687 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da76b85a-2f9f-4015-9017-3279adf4b1a5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092998 Oct 10 11:32:49.121283 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3333/6765] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:32:49 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:32:50.056801 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:32:50.067588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:32:50.068100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:32:50.068557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:32:50.081456 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] Creating event network-changed:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:32:50.087250 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-978a0311-d940-4c8b-8dd4-e7f35bcfa2fa req-43222627-3b24-477b-93eb-f36b50e8ffa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034478 Oct 10 11:32:50.087885 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3433/6766] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:33:24.310445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=17 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:24.311854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:24.316469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:24.317079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:24.324788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:24.325268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:24.325702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:24.326384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:24.326854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:24.327303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:24.460296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:24.468212 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-906e34ae-7e5b-4c97-bd30-c49ae839bc50 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1669 microversion: 2.1 time: 0.159795 Oct 10 11:33:24.468783 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3334/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:24 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:24.492179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d54e5522-ab0c-4bff-8be0-178d40b2972e"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:33:24.494699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:24.496903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:24.497569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=37 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:24.505952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:24.506461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:24.506920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:24.507740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:24.508249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:24.508698 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:24.744123 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f3e223e3-cc08-4a87-84f1-e9f9717e0d41 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256499 Oct 10 11:33:24.744766 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3434/6768] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:33:24 2022] POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:33:35.460579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:33:35.462856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:35.465667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:35.466334 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:35.472912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:35.473411 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:35.473859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:35.474569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:35.475072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:35.475512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:35.503597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:35.509254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:33:35.517576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:33:35.518004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:33:35.518486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:33:35.518902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:33:35.519382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:33:35.584415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c3184d6-a98f-49d7-ac3c-14ecb735a864 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/action" status: 202 len: 0 microversion: 2.1 time: 0.127614 Oct 10 11:33:35.587075 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3335/6769] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:33:35 2022] POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:33:35.591843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:35.593702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:33:35.597920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:35.598337 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:35.605967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:35.606795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:35.607358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:35.608098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:35.608773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:35.609415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:36.076042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:36.085516 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af9bd693-90e8-4c2c-8ea0-546f440f3696 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1724 microversion: 2.1 time: 0.495724 Oct 10 11:33:36.086095 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3435/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:35 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:37.109815 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:37.110441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:37.118142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:37.118718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:37.119194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:37.120054 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:37.120685 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:37.121271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:37.257717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:37.266934 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60a44251-c306-4a0b-96fd-0c163551ed9d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1724 microversion: 2.1 time: 0.162128 Oct 10 11:33:37.267545 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3336/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:37 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:38.290183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:38.290821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:38.298308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:38.298816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:38.299300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:38.300012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:38.300487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:38.300931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:38.428844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:38.437286 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a43fc00e-7281-4b50-b4b2-708e221d23f1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.151020 Oct 10 11:33:38.437869 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3436/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:38 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:39.461572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:39.462221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:39.469536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:39.470022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:39.470463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:39.471191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:39.471654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:39.472083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:39.606613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:39.615203 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-690ba8dc-b2b6-4fb0-98d0-f7987752c854 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.157727 Oct 10 11:33:39.615804 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3337/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:39 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:40.638587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:40.639212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:40.646288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:40.646794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:40.647284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:40.647999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:40.648497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:40.648939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:40.778558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:40.787547 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b20455fa-b125-4aa8-b3a4-d04b16cfabe6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.153072 Oct 10 11:33:40.788115 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3437/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:40 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:41.810495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:41.811060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:41.818686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:41.819223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:41.819666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:41.820370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:41.820834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:41.821269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:41.950735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:41.959447 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-968d5724-05da-4c98-9618-33244aac7da3 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.152933 Oct 10 11:33:41.960027 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3338/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:41 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:42.983802 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:42.984436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:42.991290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:42.991797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:42.992255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:42.993002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:42.993481 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:42.993936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:43.129117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:43.138230 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-69c1569a-af7f-49a7-8474-daa15001ae92 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.158946 Oct 10 11:33:43.138931 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3438/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:42 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:44.161366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:44.162016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:44.168678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:44.169283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:44.169795 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:44.170527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:44.170985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:44.171449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:44.299427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:44.307701 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c48a7c4-03e4-4710-af96-c029efea396e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.150278 Oct 10 11:33:44.308276 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3339/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:44 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:45.332036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:45.332620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:45.339842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:45.340351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:45.340809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:45.341523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:45.341999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:45.342482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:45.476957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:45.485398 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ce3816eb-c665-4a5a-b7fc-6a1cf63b5fd6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.157316 Oct 10 11:33:45.485967 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3439/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:45 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:46.508743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:46.509393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:46.517589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:46.518090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:46.518531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:46.519289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:46.519724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:46.520162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:46.651463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:46.660172 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85862176-681f-4f75-8aac-bc0f5f1cdf9e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.155391 Oct 10 11:33:46.660741 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3340/6779] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:46 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:47.688823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:47.689463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:47.696548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:47.697058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:47.697520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:47.698237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:47.698720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:47.699218 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:47.834685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:47.843727 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9f0512fb-5c57-41a8-9d8c-df93eb5ca368 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.158848 Oct 10 11:33:47.844302 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3440/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:47 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:48.866991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:48.867650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:48.875099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:48.875590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:48.876031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:48.876726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:48.877186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:48.877616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:49.010610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:49.019022 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9542b1a7-c819-4ace-991b-93c617565cd4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.155890 Oct 10 11:33:49.019654 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3341/6781] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:48 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:50.042047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:50.042683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:50.050142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:50.050649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:50.051143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:50.051864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:50.052341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:50.052788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:50.180894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:50.189813 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-67337ffd-9a3f-493d-91f6-c18b28c1ae4f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.151720 Oct 10 11:33:50.190382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3441/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:50 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:51.213699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:51.214319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:51.221331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:51.221821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:51.222267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:51.222963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:51.223450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:51.223880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:51.353501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:51.362811 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6b9868d-dbf8-4258-9dba-bdb9e983c743 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.153024 Oct 10 11:33:51.363604 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3342/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:51 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:52.435741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:52.436396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:52.442326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:52.442823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:52.443302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:52.444003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:52.444472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:52.444910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:52.573391 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:52.581715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-68415285-cc61-4987-a633-68aa8b529ea9 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.198615 Oct 10 11:33:52.582286 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3442/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:52 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:53.604719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:53.605341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:53.612851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:53.613345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:53.613790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:53.614491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:53.614951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:53.615413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:53.750632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:53.759385 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df6bb856-3ffd-431d-bb8f-5f50c272871d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.158546 Oct 10 11:33:53.759970 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3343/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:53 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:54.782538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:54.783164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:54.790043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:54.790555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:54.791110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:54.791822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:54.792304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:54.792747 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:54.924242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:54.932994 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6a327d2-d2cc-40b7-9029-0794077c698f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.155215 Oct 10 11:33:54.933676 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3443/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:54 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:55.957568 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:55.958450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:55.965453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:55.965946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:55.966389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:55.967119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:55.967783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:55.968226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:56.099306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:56.108526 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2684a8c-05f2-4674-ab2d-e8fc90124080 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1729 microversion: 2.1 time: 0.154215 Oct 10 11:33:56.109059 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3344/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:55 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:57.132339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:57.133046 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:57.142628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:57.143251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:57.143986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:57.144731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:57.145270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:57.145777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:57.153688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "name": "network-vif-unplugged", "status": "completed", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:33:57.165189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:57.165687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:57.166135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:57.180749 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Creating event network-vif-unplugged:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h1-860687-2 Oct 10 11:33:57.187326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] Instance ede38153-5326-49e9-8c0d-04989c629852 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:33:57.198929 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-985bd288-9b1e-424c-a1d6-b7b1f34ea14c req-8d97e892-470d-4f37-afe7-78afeae7627d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122386 Oct 10 11:33:57.199706 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3444/6788] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:33:57.298964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:57.307288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-871132a9-5b1d-44a3-bf20-bd6288f29354 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1728 microversion: 2.1 time: 0.179101 Oct 10 11:33:57.307865 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3345/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:57 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:33:58.331545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:58.332395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:58.338856 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:58.339393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:58.339858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:58.340568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:58.341046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:58.341492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:58.477232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:58.486625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab48f29d-bbd5-499d-b864-74335f9bf6a7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.160516 Oct 10 11:33:58.487268 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3445/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:58 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:33:59.230619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:33:59.241794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:59.242281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:59.242748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:59.254487 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Creating event network-changed:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h1-860687-2 Oct 10 11:33:59.259776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] Instance ede38153-5326-49e9-8c0d-04989c629852 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:33:59.271013 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a13a3881-49b3-4f0d-8fe6-0de4023605a6 req-15fac4d8-4c6d-4974-99bd-02c315e3a1a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044164 Oct 10 11:33:59.271628 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3346/6791] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:33:59.511536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:33:59.512468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:33:59.521459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:59.522119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:59.522870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:59.523756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:33:59.524333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:33:59.524907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:33:59.676558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:33:59.685371 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f44dd9c8-851a-49c3-8393-b00e36b7dbfd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.177937 Oct 10 11:33:59.694851 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3446/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:33:59 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:00.710505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:00.711166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:00.717361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:00.717843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:00.718280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:00.718974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:00.719453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:00.719877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:00.857259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:00.866464 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1653e22f-9f6f-4d15-a781-d15d336c3f3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.161402 Oct 10 11:34:00.867071 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3347/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:00 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:01.891676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:01.892320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:01.899661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:01.900175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:01.900637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:01.901374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:01.901852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:01.907113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:02.040440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:02.049888 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b1ab23b4-a8ef-45a0-8004-568b407d68a4 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.162201 Oct 10 11:34:02.050470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3447/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:01 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:03.073812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:03.074430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:03.082382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:03.083158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:03.083602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:03.084290 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:03.084748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:03.085199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:03.219218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:03.227446 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bb00853-9c8f-490f-9e9f-87d446488f7f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.157622 Oct 10 11:34:03.228013 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3348/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:03 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:04.250847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:04.251507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:04.258345 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:04.258848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:04.259334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:04.260048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:04.260521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:04.260966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:04.390634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:04.399040 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-40148630-d55b-4e6d-9e0e-315bb16defd1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.152684 Oct 10 11:34:04.399609 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3448/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:04 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:05.422993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:05.423644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:05.430518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:05.431029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:05.431470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:05.432166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:05.432630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:05.433059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:05.572696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:05.575331 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:05.583391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26baeb21-700c-404d-af8f-c2438bf8d5d1 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.164741 Oct 10 11:34:05.583974 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3349/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:05 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:06.607177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:06.607890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:06.610496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=29 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:06.615798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:06.616343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:06.616804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:06.617519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:06.617995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:06.618440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:06.621237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=83 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:06.751452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:06.760193 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8359d215-b806-4d25-ae7b-718d5b00c796 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.156952 Oct 10 11:34:06.760779 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3449/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:06 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:07.784268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:07.784893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:07.787702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:07.794032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:07.794526 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:07.795547 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:07.796254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:07.796721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:07.797155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:07.929025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:07.937860 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17293103-03ce-42cb-ae82-732dbace9085 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.157870 Oct 10 11:34:07.938423 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3350/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:07 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:08.960910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:08.961547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:08.968254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:08.968754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:08.969211 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:08.969929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:08.970404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:08.970852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:09.100780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:09.109648 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dc6d1ee3-a20b-4b9d-93d4-2109f3e026be tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1726 microversion: 2.1 time: 0.152890 Oct 10 11:34:09.110224 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3450/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:08 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:10.132938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:10.133553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:10.140823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.141294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.141730 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.142418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.142871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.143319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.272263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:10.280706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0437a038-a861-43d1-8e32-363c5a208455 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1723 microversion: 2.1 time: 0.151690 Oct 10 11:34:10.281279 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3351/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:10 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:10.303909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:10.304473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:10.311996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.312509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.312983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.313706 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.314187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.314636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.355228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.355743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.356204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.356962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.357999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.358542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.379138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:34:10.384581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Getting quotas for user 4f6633da771841deab2caa3f029eb997 and project 164126b1104a4f48ab483cfd232e9ba3. Resources: {'ram', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:34:10.487849 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-68253c7e-cb46-4e3f-a70d-7011ddf1cd20 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/action" status: 202 len: 0 microversion: 2.1 time: 0.187607 Oct 10 11:34:10.488774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3451/6802] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:34:10 2022] POST /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:34:10.497163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:10.497826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:10.504049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.504538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.504972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.505779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:10.506431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:10.506797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:10.642158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:10.650514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bb77a40-6ca4-4302-a6fc-e52e7444142f tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.157385 Oct 10 11:34:10.651327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3352/6803] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:10 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:11.675676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:11.676394 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:11.684285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:11.684789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:11.685241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:11.686573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:11.687095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:11.687542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:11.820276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:11.828808 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-214f4e81-3014-45d4-a971-33c266de95cd tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.157554 Oct 10 11:34:11.829378 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3452/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:11 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:12.852749 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:12.853358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:12.861356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:12.861467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:12.861940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:12.862600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:12.863083 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:12.863513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:13.002127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:13.010562 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bb8438d-3639-498f-a08e-3e2b720fc226 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.161720 Oct 10 11:34:13.011160 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3353/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:12 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:13.321545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "name": "network-vif-plugged", "status": "completed", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:13.333172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:13.333681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:13.334134 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:13.347268 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Creating event network-vif-plugged:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h1-860687-2 Oct 10 11:34:13.352993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] Instance ede38153-5326-49e9-8c0d-04989c629852 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:34:13.364723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-167d3c71-370b-4bab-92ac-9e1280e6fe7d req-3cf9eb4c-93bd-4e93-ae5d-cceee5ff6024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047308 Oct 10 11:34:13.365900 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3453/6806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:34:14.034565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:14.035208 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:14.041940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:14.042423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:14.042859 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:14.043655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:14.044130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:14.044988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:14.182198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:14.191268 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-760a0f1e-088d-4312-8bc4-1e4617c0db3e tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.160617 Oct 10 11:34:14.191848 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3354/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:14 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:15.217241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:15.218052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:15.224291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:15.224793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:15.225245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:15.225952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:15.226456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:15.226897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:15.361824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:15.370164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9d6f7fc1-5a1c-40dd-9de2-deac6569a58b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.158653 Oct 10 11:34:15.370775 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3454/6808] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:15 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:15.624188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "name": "network-vif-unplugged", "status": "completed", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:15.634808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:15.635220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:15.635782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:15.649004 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Creating event network-vif-unplugged:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:34:15.654457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] Instance ede38153-5326-49e9-8c0d-04989c629852 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:34:15.665348 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-76c0691f-635f-4a3c-a89f-dac1498563fa req-4043d6e2-07f1-4e2e-844b-4de3d33dc7ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045916 Oct 10 11:34:15.666122 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3355/6809] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:34:16.394087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:16.394720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:16.401770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:16.402278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:16.402767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:16.403512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:16.404051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:16.404051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:16.553366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:16.563025 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e32efc15-51f0-4a9e-8f73-9dd8f0cbc8ca tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.173449 Oct 10 11:34:16.563742 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3455/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:16 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:17.589236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:17.590043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:17.597441 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:17.597963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:17.598583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:17.599308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:17.599766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:17.600192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:17.681982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:17.693739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:17.694472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:17.695038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:17.708313 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Creating event network-changed:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:34:17.714322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] Instance ede38153-5326-49e9-8c0d-04989c629852 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:34:17.726151 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-aba3eb65-ead6-4c23-bb31-f4523f9b8a18 req-8f2c5eb9-91cb-4c93-a8fc-004aed179876 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048018 Oct 10 11:34:17.727275 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3456/6811] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:34:17.739200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:17.748318 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bbd72b0-de93-4f8e-b54a-cc9a525ad2cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.164393 Oct 10 11:34:17.766098 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3356/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:17 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:18.774609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:18.775254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:18.782009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:18.782514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:18.782965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:18.783694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:18.784166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:18.784605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:18.927748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:18.936104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e6221d34-f569-4012-86fd-f98d30b17c54 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.166663 Oct 10 11:34:18.936708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3457/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:18 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:19.960483 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:19.961111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:19.969289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:19.969785 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:19.970230 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:19.970929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:19.971417 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:19.971848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:20.104510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:20.113311 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-650aa494-e311-4e06-adee-68484d87a7dc tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.156996 Oct 10 11:34:20.113892 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3357/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:19 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:21.137723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:21.138741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:21.141823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:21.148173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:21.148809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:21.149283 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:21.149990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:21.150469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:21.150923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:21.288614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:21.298436 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-12ce3a5a-4d25-4ce9-9231-4fab25923936 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.164623 Oct 10 11:34:21.302286 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3458/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:21 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:22.322387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:22.322926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:22.330304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:22.330797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:22.331282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:22.331980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:22.332439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:22.333124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:22.462163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:22.470843 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-994ca71b-f415-48b2-b7bd-e62840367477 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.152497 Oct 10 11:34:22.471455 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3358/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:22 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:23.494406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:23.495051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:23.502076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:23.502576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:23.503052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:23.503757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:23.504227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:23.504665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:23.634233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:23.643421 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54f10261-a172-4d06-b485-10be539d696a tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.152920 Oct 10 11:34:23.643997 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3459/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:23 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:24.667731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:24.668277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:24.676224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:24.676716 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:24.677160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:24.677854 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:24.678316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:24.678752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:24.813551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:24.821804 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a0a7365-02ea-427c-9b70-b01c1dd9a819 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.158079 Oct 10 11:34:24.822371 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3359/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:24 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:25.845314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:25.845960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:25.853219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:25.853729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:25.854191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:25.854911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:25.855414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:25.855862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:25.985988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:25.994259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c479d0b1-57b1-469c-9322-9f653236c888 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.153041 Oct 10 11:34:25.994830 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3460/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:25 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:27.019343 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:27.019988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:27.026867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:27.027391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:27.027835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:27.028590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:27.029079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:27.029537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:27.163681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:27.172929 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e373a833-8464-4373-b1e5-8f00e6979009 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.157554 Oct 10 11:34:27.173508 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3360/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:27 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:28.196388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:28.197022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:28.204899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:28.205413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:28.205871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:28.206589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:28.207143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:28.207849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:28.342104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:28.351889 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1c9fff12-2d27-498c-bdeb-b04b8d1aee56 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1722 microversion: 2.1 time: 0.159371 Oct 10 11:34:28.352470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3461/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:28 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:29.375455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:29.376074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:29.382975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.383493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.383934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.384635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.385097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.385527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.515675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:29.523950 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d241be1-ab0c-491a-98e4-30d8781ed171 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1715 microversion: 2.1 time: 0.152608 Oct 10 11:34:29.524539 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3361/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:29 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:29.547636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:29.548274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:29.555178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.555685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.556142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.556846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.557315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.557755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.690663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:29.699090 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-92e189ff-432f-44d5-b1ad-20cb63fbb3ae tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1715 microversion: 2.1 time: 0.156308 Oct 10 11:34:29.699675 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3462/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:29 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:29.722223 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:29.722852 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:29.728921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.729420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.729866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.730566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.731059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.731500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.862503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:29.870717 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb83990e-1165-459c-acef-89503cd97da8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1715 microversion: 2.1 time: 0.152512 Oct 10 11:34:29.871524 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3362/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:29 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:29.893978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:29.894419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:29.900404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.900902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.901355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.902057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:29.902525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:29.902963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:29.918138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:29.932764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:34:30.010115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09d58548-cacd-4760-993f-257acb34e0aa tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 204 len: 0 microversion: 2.1 time: 0.119920 Oct 10 11:34:30.010708 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3463/6825] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:34:29 2022] DELETE /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:34:30.021308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:30.021931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:30.028197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:30.028679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:30.030319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:30.031035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:30.031496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:30.031922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:30.164499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:30.173196 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a85dae2-8006-42ea-8681-b4abd81f0712 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1721 microversion: 2.1 time: 0.157096 Oct 10 11:34:30.174025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3363/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:30 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:31.198476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:31.199568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:31.206966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:31.207506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:31.208220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:31.208943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:31.209421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:31.209875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:31.342285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:31.350778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-86f8becc-aac6-42b6-a178-52987c0248cb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1721 microversion: 2.1 time: 0.156635 Oct 10 11:34:31.351381 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3464/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:31 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:32.378649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:32.378649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:32.383299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede38153-5326-49e9-8c0d-04989c629852", "name": "network-vif-deleted", "tag": "7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:32.391827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:32.392555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:32.393511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:32.394648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:32.394869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:32.395387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:32.395503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:32.395848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:32.396360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:32.407842 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] Creating event network-vif-deleted:7d55f5a6-3b75-4e48-b5e1-65163c4fc0ec for instance ede38153-5326-49e9-8c0d-04989c629852 on n-h2-860687-2 Oct 10 11:34:32.413343 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-948795be-f770-420c-8408-a77aa18a9535 req-962ac7af-b9b7-46ba-9d67-584336f027c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Oct 10 11:34:32.413959 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3465/6828] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:34:32.496329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:32.507315 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3483f0f5-193a-4c03-a344-5e9ec9b7dcf6 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1370 microversion: 2.1 time: 0.135302 Oct 10 11:34:32.508264 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3364/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:32 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:33.531647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:33.532604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:33.539048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:33.539634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:33.540159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:33.540938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:33.541488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:33.542043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:33.609118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:33.617659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-30520957-5548-4243-8391-1ee4ceb8211c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1370 microversion: 2.1 time: 0.091522 Oct 10 11:34:33.618534 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3466/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:33 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:34.641617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:34.642175 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:34.649076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:34.649575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:34.650020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:34.650723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:34.651245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:34.651679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:34.714649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:34.723401 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffec70bd-33f8-4ef3-ba9e-6a0a96015bd7 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1370 microversion: 2.1 time: 0.086486 Oct 10 11:34:34.723987 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3365/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:34 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:35.748421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:35.750226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:35.756966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:35.757475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:35.757951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:35.758697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:35.759178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:35.759625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:35.823147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f6633da771841deab2caa3f029eb997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164126b1104a4f48ab483cfd232e9ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:35.831772 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36d2e696-b0a2-451e-add5-fb4c230603d5 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 200 len: 1370 microversion: 2.1 time: 0.087499 Oct 10 11:34:35.832353 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3467/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:35 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:36.854811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:36.855452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:36.862512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:36.863030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:36.863468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:36.864155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:36.864610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:36.865035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:36.878584 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 HTTP/1.1 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ede38153-5326-49e9-8c0d-04989c629852'} Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:36.880280 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-762d8d26-860e-4bc6-9b30-bf09e112ce98 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 404 len: 111 microversion: 2.1 time: 0.030737 Oct 10 11:34:36.884410 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3366/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:36 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:36.943321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:36.945524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:36.948323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:36.954551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:36.955159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:36.955625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:36.956346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:36.956823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:36.957370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:36.971786 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-volume_attachments HTTP/1.1 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'ede38153-5326-49e9-8c0d-04989c629852'} Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:36.973522 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4b5b0981-0bfe-4683-b3b8-44533ffc8b8b tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035668 Oct 10 11:34:36.977351 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3468/6834] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:34:36 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.307668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.308186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.311443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:40.317581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.318074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.318539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.319277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.319737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.321075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.324387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:40.337894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 HTTP/1.1 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ede38153-5326-49e9-8c0d-04989c629852'} Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.339500 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6cd50fa-789b-4cc5-8b30-835ca81accbb tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 404 len: 111 microversion: 2.1 time: 0.037402 Oct 10 11:34:40.345030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3367/6835] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:34:40 2022] DELETE /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.350199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.350843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: ede38153-5326-49e9-8c0d-04989c629852] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.357995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.358776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.359264 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.359992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.360463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.360913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.375340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 HTTP/1.1 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'ede38153-5326-49e9-8c0d-04989c629852'} Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.377092 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance ede38153-5326-49e9-8c0d-04989c629852 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.381326 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-70804b01-de03-4dcd-8ef3-8304c70ead58 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852" status: 404 len: 111 microversion: 2.1 time: 0.032323 Oct 10 11:34:40.382374 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3469/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:40 2022] GET /compute/v2.1/servers/ede38153-5326-49e9-8c0d-04989c629852 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.387192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.387695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.395027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.395569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.395989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.396699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.397159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.397586 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.412751 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 HTTP/1.1 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8de0c8e0-2fed-47d8-b00a-5cb230f04ee0'} Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.414351 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c2cdab7-66dc-484f-be15-0d29cf97b76d tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 404 len: 111 microversion: 2.1 time: 0.032593 Oct 10 11:34:40.419038 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3368/6837] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:34:40 2022] DELETE /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.425643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.426407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.432838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.433438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.433987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.434788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.436318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.436710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.452228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 HTTP/1.1 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '8de0c8e0-2fed-47d8-b00a-5cb230f04ee0'} Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.453828 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-021a09b2-7c2a-40c8-9ee5-4bf17a4c0b8c tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0" status: 404 len: 111 microversion: 2.1 time: 0.033722 Oct 10 11:34:40.458381 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3470/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:40 2022] GET /compute/v2.1/servers/8de0c8e0-2fed-47d8-b00a-5cb230f04ee0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.464301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.464905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.471797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.472385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.472897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.473670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.474205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.474704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.489477 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 HTTP/1.1 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '39796bb9-3de5-43c1-a8c7-0884a2933304'} Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.491192 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a558a60-c725-4831-a283-cd328282eda8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 404 len: 111 microversion: 2.1 time: 0.033155 Oct 10 11:34:40.495021 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3369/6839] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:34:40 2022] DELETE /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:34:40.502820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.503627 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 39796bb9-3de5-43c1-a8c7-0884a2933304] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.509757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.510359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.510862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.511665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.512233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.512746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.530900 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 HTTP/1.1 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '39796bb9-3de5-43c1-a8c7-0884a2933304'} Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.532550 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 39796bb9-3de5-43c1-a8c7-0884a2933304 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac31acfc-da21-4572-85f0-d22763d09321 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304" status: 404 len: 111 microversion: 2.1 time: 0.035139 Oct 10 11:34:40.539521 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3471/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:40 2022] GET /compute/v2.1/servers/39796bb9-3de5-43c1-a8c7-0884a2933304 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:34:40.542641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.543189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.549875 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.550296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.550736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.551479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.551943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.552374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.565987 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 HTTP/1.1 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '3796edb8-2bc3-4967-82f1-8b6c6d832156'} Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.567599 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0bfafac-e049-44bc-9247-b1ea32d20dc8 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 404 len: 111 microversion: 2.1 time: 0.030285 Oct 10 11:34:40.572171 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3370/6841] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:34:40 2022] DELETE /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.577721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.578358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [instance: 3796edb8-2bc3-4967-82f1-8b6c6d832156] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:40.584687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.585189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.585645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.586357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:40.586840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:40.587312 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:40.601969 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] HTTP exception thrown: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Request method failure captured: Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 HTTP/1.1 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAHzfQ2Hd0X9bUpZht6kMriIvaT4--Icvf33ppBcXyjcDLX6-Rkf2tIjYHohtSpRkUbu92F6iN2r3UX3o0KD-ZntUieReg3ihEs98zhRmUM1_k4s9wc8KKZdhn_Ai-RkkqD5tid54fn_Kj5Vmp0otBgdmLZcINPLVb4xk9tw6mwSMPs Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_164126b1104a4f48ab483cfd232e9ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/164126b1104a4f48ab483cfd232e9ba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/164126b1104a4f48ab483cfd232e9ba3"}]}] Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 164126b1104a4f48ab483cfd232e9ba3 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServerActionsTestJSON-1788112437 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 4f6633da771841deab2caa3f029eb997 Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServerActionsTestJSON-1788112437-project Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '3796edb8-2bc3-4967-82f1-8b6c6d832156'} Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:34:40.603590 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Returning 404 to user: Instance 3796edb8-2bc3-4967-82f1-8b6c6d832156 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f8915a0-1d14-460f-ac3f-1d5261718136 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156" status: 404 len: 111 microversion: 2.1 time: 0.031352 Oct 10 11:34:40.608489 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3472/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:40 2022] GET /compute/v2.1/servers/3796edb8-2bc3-4967-82f1-8b6c6d832156 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:34:40.614502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46fb8809-9bbe-46b5-8a84-64dee19a3b60 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] Calling method '.version_select at 0x7f677c37a040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:40.618953 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46fb8809-9bbe-46b5-8a84-64dee19a3b60 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [21bd7560-9ba7-42e8-9028-dc838971d640] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:34:41.627331 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-46fb8809-9bbe-46b5-8a84-64dee19a3b60 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] [21bd7560-9ba7-42e8-9028-dc838971d640] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42018. Oct 10 11:34:41.647445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46fb8809-9bbe-46b5-8a84-64dee19a3b60 tempest-ServerActionsTestJSON-1788112437 tempest-ServerActionsTestJSON-1788112437-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973446155" status: 202 len: 0 microversion: 2.1 time: 1.036657 Oct 10 11:34:41.647953 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3371/6843] 10.222.0.16 () {58 vars in 1221 bytes} [Mon Oct 10 11:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973446155 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:34:50.572988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-417760401", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "96b561f7-c1b7-40cb-9525-aaeabd72f010"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:50.583618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:50.594478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:50.635684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] validate_networks() for [('96b561f7-c1b7-40cb-9525-aaeabd72f010', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:34:51.055577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:34:51.056028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:34:51.056641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:34:51.056945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:34:51.057380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:34:51.066957 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:51.067498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:51.067959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:51.068716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:51.069195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:51.069643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:51.087516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Getting quotas for project 359c72602a5e47c3bbae9b27f88e74d6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:34:51.093750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Getting quotas for user ba5cce247c9641c98cd06a8d4074d7a1 and project 359c72602a5e47c3bbae9b27f88e74d6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:34:51.108130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:34:51.110503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:34:51.158941 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [d60a5dfe-28e2-4f67-ab61-2da9702fa889] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:34:52.167533 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [d60a5dfe-28e2-4f67-ab61-2da9702fa889] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42098. Oct 10 11:34:52.172446 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-463c639a-61ef-4f57-81a8-d6ca08ac6927 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728829 Oct 10 11:34:52.173382 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3473/6844] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:34:52.182051 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:52.183447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:34:52.188126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-344b1ecf-3438-4565-88b9-380472f11e47 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:52.188742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-344b1ecf-3438-4565-88b9-380472f11e47 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:52.246005 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-344b1ecf-3438-4565-88b9-380472f11e47 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:52.253674 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-344b1ecf-3438-4565-88b9-380472f11e47 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1216 microversion: 2.1 time: 0.073391 Oct 10 11:34:52.254255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3372/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:52 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:34:53.278810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:53.280253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:53.287467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:53.288414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:53.289196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:53.290178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:53.290764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:53.291467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:53.387229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:53.397823 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bc1aebd5-9205-4069-ae9c-02a0083bb375 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1286 microversion: 2.1 time: 0.124784 Oct 10 11:34:53.398726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3474/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:53 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:54.425806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:54.427150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:54.438199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:54.438704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:54.439199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:54.440145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:54.440615 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:54.441056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:54.616740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:54.627414 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-605ed23a-fedb-455c-a529-011e52a5fd0e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.208032 Oct 10 11:34:54.628367 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3373/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:54 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:54.972093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3", "tag": "07282eb8-cf2c-4df8-8c1b-7f0322126d15"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:34:54.993969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:54.994714 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:54.995199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:55.006945 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] Creating event network-changed:07282eb8-cf2c-4df8-8c1b-7f0322126d15 for instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 on n-h1-860687-2 Oct 10 11:34:55.011987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6d3e7fd8-7994-480e-90cb-f19fcd281879 req-e952ba82-24b1-404c-8175-2c70d854dda5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046826 Oct 10 11:34:55.013470 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3475/6848] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:34:55.654644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:55.655212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:55.662101 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:55.662594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:55.663061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:55.663761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:55.664225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:55.664653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:55.794552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:55.802288 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48d7c5fe-b7c8-4bad-a406-9b3ae3121cb2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.152172 Oct 10 11:34:55.802860 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3374/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:55 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:56.827062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:56.827829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:56.834351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:56.834859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:56.835350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:56.836084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:56.836542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:56.837011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:56.965291 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:56.973495 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89ff456e-2de3-4b7d-b054-10e2510f73ee tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.152011 Oct 10 11:34:56.974060 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3476/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:56 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:57.996409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:57.997028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:58.005061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:58.005553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:58.005995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:58.006693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:58.007200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:58.007631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:58.140620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:58.148399 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4611fb0e-af7c-4c67-aaf1-f4de62f674c0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.155935 Oct 10 11:34:58.148980 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3375/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:57 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:34:59.171681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:34:59.172349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:34:59.178819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:59.179353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:59.179804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:59.180517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:34:59.180988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:34:59.181427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:34:59.314376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:34:59.324082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b04a1384-ffcf-42ea-8933-9bf1cb94bd26 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.157056 Oct 10 11:34:59.324670 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3477/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:34:59 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:00.347636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:00.348292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:00.355304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:00.355797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:00.356241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:00.356942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:00.357403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:00.358589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:00.489084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:00.496872 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95cf3ec2-72ba-4c7a-8193-481ab4f4b1fe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.153178 Oct 10 11:35:00.497449 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3376/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:00 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:01.470652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3", "name": "network-vif-plugged", "status": "completed", "tag": "07282eb8-cf2c-4df8-8c1b-7f0322126d15"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:01.476452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:01.477143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:01.484024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:01.484532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:01.484977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:01.496277 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] Creating event network-vif-plugged:07282eb8-cf2c-4df8-8c1b-7f0322126d15 for instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 on n-h1-860687-2 Oct 10 11:35:01.501339 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8c956289-c321-4547-9c3e-d0252cd30a82 req-a4026b19-863f-4f38-b57b-a7b0662194a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Oct 10 11:35:01.501926 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3478/6854] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:35:01.519995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:01.520632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:01.527304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:01.527802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:01.528481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:01.529954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:01.530622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:01.531600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:01.663641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:01.672304 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afac1b11-970a-4adc-acc2-f58edca776c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.156162 Oct 10 11:35:01.672883 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3377/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:01 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:02.696455 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:02.697171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:02.703961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:02.704477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:02.705070 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:02.706420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:02.706916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:02.707419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:02.846963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:02.854839 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-784ca2a5-07f3-4662-8ccf-3bd25ade68a7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1316 microversion: 2.1 time: 0.163650 Oct 10 11:35:02.855457 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3479/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:02 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:03.878139 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:03.878768 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:03.880711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:03.887279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:03.887775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:03.888220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:03.889080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:03.889563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:03.890007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:04.016769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:04.024560 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33ea6e3d-cf90-4ac8-91a3-55ad55a30829 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.150325 Oct 10 11:35:04.025134 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3378/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:03 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:04.087877 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531343567", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "96b561f7-c1b7-40cb-9525-aaeabd72f010"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:04.142442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] validate_networks() for [('96b561f7-c1b7-40cb-9525-aaeabd72f010', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:35:04.502532 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:35:04.502776 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 10 11:35:04.816668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:35:04.817109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:35:04.817596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:35:04.818022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:35:04.818446 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:35:04.827431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:04.827926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:04.828375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:04.829114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:04.829585 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:04.830027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:04.847169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Getting quotas for project 359c72602a5e47c3bbae9b27f88e74d6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:35:04.852458 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Getting quotas for user ba5cce247c9641c98cd06a8d4074d7a1 and project 359c72602a5e47c3bbae9b27f88e74d6. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:35:04.865110 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:35:04.867403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:35:04.912738 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f912a04c-7ebe-4cf6-a047-cf5f928194e8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.828653 Oct 10 11:35:04.913399 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3480/6858] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:35:04.925467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3c584d7-b4f6-480d-8016-c4e3ee82ecad tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:04.926098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3c584d7-b4f6-480d-8016-c4e3ee82ecad tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:04.981434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3c584d7-b4f6-480d-8016-c4e3ee82ecad tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:04.992964 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3c584d7-b4f6-480d-8016-c4e3ee82ecad tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1216 microversion: 2.1 time: 0.071903 Oct 10 11:35:04.993556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3379/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:04 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:06.017555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:06.018202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:06.024254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:06.024767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:06.025248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:06.025990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:06.026472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:06.026922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:06.095419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:06.103931 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-24439360-bcd7-4476-9da7-c1c6d5683bfc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1274 microversion: 2.1 time: 0.091318 Oct 10 11:35:06.104596 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3481/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:06 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:07.130004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:07.132386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:07.140019 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:07.140482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:07.140928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:07.141639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:07.142102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:07.142537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:07.235036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c579fdc-7e07-4a26-9503-bfbe1ae8b999", "tag": "9e64f30c-f814-490a-8f3d-664b5fa37407"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:07.250814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:07.251734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:07.252411 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:07.270413 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] Creating event network-changed:9e64f30c-f814-490a-8f3d-664b5fa37407 for instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 on n-h2-860687-2 Oct 10 11:35:07.276423 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-286037c2-f0cb-41ab-9f55-d9bd60cbbb44 req-3a350b98-0d0a-42f8-80fa-f6908feecbe0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047286 Oct 10 11:35:07.277313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3482/6861] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:35:07.281463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:07.290592 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1163bfac-9896-46bb-9840-9df2f800b4c8 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.165148 Oct 10 11:35:07.291774 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3380/6862] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:07 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:08.314244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:08.315032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:08.322116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:08.322615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:08.323093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:08.323800 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:08.324270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:08.324711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:08.461636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:08.470939 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33ec76c1-2309-4896-bde4-9c1f8c890ed0 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.160967 Oct 10 11:35:08.472398 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3483/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:08 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:09.493984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:09.494604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:09.501502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:09.501989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:09.502426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:09.503145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:09.503602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:09.504035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:09.634118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:09.642421 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac7add22-1fe0-46ed-9f5b-b1fce2e058f5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.152388 Oct 10 11:35:09.643016 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3381/6864] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:09 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:10.665172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:10.665744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:10.673922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:10.674442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:10.674901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:10.675650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:10.676122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:10.676568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:10.815339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:10.823178 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-77d45c2c-429e-432f-a1cb-bda00c11f8f2 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.162059 Oct 10 11:35:10.823753 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3484/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:10 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:11.847288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:11.847917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:11.854762 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:11.855272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:11.855711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:11.856408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:11.856861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:11.857921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:11.988944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:11.996697 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abd03524-2986-4cca-a8cf-9572cd98f5e4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.153491 Oct 10 11:35:11.997276 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3382/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:11 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:13.019534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:13.020175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:13.027165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:13.027681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:13.028143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:13.028860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:13.029395 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:13.029873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:13.166240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:13.174897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-18035f6f-b827-414c-a397-711cf3c01ad7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.159346 Oct 10 11:35:13.176206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3485/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:13 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:13.231340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c579fdc-7e07-4a26-9503-bfbe1ae8b999", "name": "network-vif-plugged", "status": "completed", "tag": "9e64f30c-f814-490a-8f3d-664b5fa37407"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:13.245142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:13.245703 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:13.246212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:13.258008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] Creating event network-vif-plugged:9e64f30c-f814-490a-8f3d-664b5fa37407 for instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 on n-h2-860687-2 Oct 10 11:35:13.263956 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f9103df5-c147-4539-92a2-9f07533b6a99 req-ac1c4532-6afa-409c-a8ac-d62720fe8309 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035994 Oct 10 11:35:13.264440 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3383/6868] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:35:14.200076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:14.200712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:14.208430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:14.208933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:14.209388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:14.210106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:14.210579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:14.211041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:14.347762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:14.355737 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-75028660-0127-4825-b81a-425857662944 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1316 microversion: 2.1 time: 0.159527 Oct 10 11:35:14.356327 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3486/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:14 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:15.379738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:15.380448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:15.382950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:15.388880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.389359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.389796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.390482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.390940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.391387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.522385 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:15.530758 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d64d3ab3-2de3-456b-85b3-8b48876b0260 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1504 microversion: 2.1 time: 0.155496 Oct 10 11:35:15.531362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3384/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:15 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:15.552647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:15.553162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:15.555272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:15.555890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:15.563254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.563763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.564220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.564936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.565410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.565857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.592591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:35:15.666742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e7bc915-25cc-4620-9ca7-fbae2f652ad3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 204 len: 0 microversion: 2.1 time: 0.117701 Oct 10 11:35:15.667383 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3487/6871] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:35:15 2022] DELETE /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:35:15.675824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:15.676442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:15.682307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.682789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.683268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.683954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:15.684407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:15.684832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:15.812593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:15.820344 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c396fe48-6ea0-415f-86c2-47de8b7294c7 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1510 microversion: 2.1 time: 0.148412 Oct 10 11:35:15.820916 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3385/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:15 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:16.844994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:16.845772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:16.852608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:16.853109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:16.853560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:16.854268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:16.854734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:16.855207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:17.048522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:17.056463 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-118f3988-ea3e-4ce0-be10-a48ab2dd4484 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 200 len: 1510 microversion: 2.1 time: 0.216448 Oct 10 11:35:17.057034 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3488/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:16 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:17.377479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c579fdc-7e07-4a26-9503-bfbe1ae8b999", "name": "network-vif-deleted", "tag": "9e64f30c-f814-490a-8f3d-664b5fa37407"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:17.390145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:17.390947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:17.391666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:17.404192 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] Creating event network-vif-deleted:9e64f30c-f814-490a-8f3d-664b5fa37407 for instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 on n-h2-860687-2 Oct 10 11:35:17.410102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3456f096-5c3a-445c-9695-1b22060e1c77 req-a18c0b2b-81ed-444a-abc5-d0bad55defeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036873 Oct 10 11:35:17.411126 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3386/6874] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:35:18.080878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.081462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.088552 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.089047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.089496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.090206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.090676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.091143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.104390 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 HTTP/1.1 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '5c579fdc-7e07-4a26-9503-bfbe1ae8b999'} Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.106046 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 404 to user: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ddea91ab-058b-4f91-8982-b498e2307c1f tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 404 len: 111 microversion: 2.1 time: 0.030658 Oct 10 11:35:18.110970 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3489/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 11:35:18.117173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.117874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.124603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.125080 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.125515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.126202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.126657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.127104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.295167 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:18.302957 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a65d9fc-9f8f-4383-808d-b50f84877726 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.189965 Oct 10 11:35:18.303554 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3387/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:35:18.325774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:18.328430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: cb5f5eb2-202e-4dae-b3ba-324a8c851e58] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.334174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/cb5f5eb2-202e-4dae-b3ba-324a8c851e58/action HTTP/1.1 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 32 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: {"resize": {"flavorRef": "452"}} Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'cb5f5eb2-202e-4dae-b3ba-324a8c851e58', 'body': {'resize': {'flavorRef': '452'}}} Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:35:18.335807 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 404 to user: Instance cb5f5eb2-202e-4dae-b3ba-324a8c851e58 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ae1135a-9a79-431a-9245-9817aba09d96 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "POST /compute/v2.1/servers/cb5f5eb2-202e-4dae-b3ba-324a8c851e58/action" status: 404 len: 111 microversion: 2.1 time: 0.015626 Oct 10 11:35:18.340467 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3490/6877] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:35:18 2022] POST /compute/v2.1/servers/cb5f5eb2-202e-4dae-b3ba-324a8c851e58/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:35:18.346213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.346841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.352862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.353355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.353801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.354514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.354979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.355438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.490925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:18.499453 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cf669bf-e20e-4de7-8010-5759dc1b14d3 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.157145 Oct 10 11:35:18.500035 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3388/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:18.522439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.523102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.530033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.530530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.531027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.531735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.532202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.532639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.661248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:18.668906 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-337f9070-94e6-4795-abdb-286c4dd73c18 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.150683 Oct 10 11:35:18.670157 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3491/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:18.692621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "950076bc-156d-4401-821d-6b07b8d2ccbf"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:18.694925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.701014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.701504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.701949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.702677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.703178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.703622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.733076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:18.737798 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action HTTP/1.1 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 65 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: {"resize": {"flavorRef": "950076bc-156d-4401-821d-6b07b8d2ccbf"}} Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: exception: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3', 'body': {'resize': {'flavorRef': '950076bc-156d-4401-821d-6b07b8d2ccbf'}}} Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:18.752380 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 400 to user: Flavor 950076bc-156d-4401-821d-6b07b8d2ccbf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f6ca499-7e13-4614-8690-48bd1a9f035c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action" status: 400 len: 107 microversion: 2.1 time: 0.065229 Oct 10 11:35:18.756442 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3389/6880] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:35:18 2022] POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:35:18.763021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.763788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.770475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.770986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.771472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.772191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.772669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.773117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.902886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:18.907068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:18.912245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-efe359f6-f030-4816-8922-8c5c8c81965c tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.153349 Oct 10 11:35:18.912838 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3492/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:35:18.935619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:18.936245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:18.942186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.942678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.943155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:18.943860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:18.944324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:18.944756 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.076931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:19.084976 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8821b37b-f5cf-49ef-b83d-5a30b9ced066 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.153440 Oct 10 11:35:19.085552 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3390/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:18 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:19.109020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a2d934e-c468-4cf4-9617-47b4d0b9aebe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a2d934e-c468-4cf4-9617-47b4d0b9aebe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: request: POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action HTTP/1.1 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 29 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: {"resize": {"flavorRef": ""}} Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3', 'body': {'resize': {'flavorRef': ''}}} Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise error Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi '' Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.112622 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a2d934e-c468-4cf4-9617-47b4d0b9aebe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a2d934e-c468-4cf4-9617-47b4d0b9aebe tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action" status: 400 len: 113 microversion: 2.1 time: 0.010633 Oct 10 11:35:19.117173 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3493/6883] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:35:19 2022] POST /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 11:35:19.122546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:19.124025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:19.129990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.130475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.130917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.131710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.132171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.132602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.266737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:19.274527 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-caa52ed3-a6f9-4b62-8a70-527f26363adc tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1505 microversion: 2.1 time: 0.155842 Oct 10 11:35:19.275159 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3391/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:19 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:35:19.301514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:19.302031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:19.309663 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.310791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.311275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.311986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.312461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.312913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.326505 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 HTTP/1.1 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '5c579fdc-7e07-4a26-9503-bfbe1ae8b999'} Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:35:19.328103 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 404 to user: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed2b305c-a3d8-4042-aa49-02cf1f9aabe5 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 404 len: 111 microversion: 2.1 time: 0.033084 Oct 10 11:35:19.332773 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3494/6885] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:35:19 2022] DELETE /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:35:19.338388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:19.339024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 5c579fdc-7e07-4a26-9503-bfbe1ae8b999] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:19.345509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.345987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.346422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.347137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.347592 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.348015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.352100 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:19.363733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 HTTP/1.1 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '5c579fdc-7e07-4a26-9503-bfbe1ae8b999'} Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:19.365287 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 404 to user: Instance 5c579fdc-7e07-4a26-9503-bfbe1ae8b999 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7420eba5-3192-45ae-bbe5-aa64fee82be4 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999" status: 404 len: 111 microversion: 2.1 time: 0.032551 Oct 10 11:35:19.369229 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3392/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:19 2022] GET /compute/v2.1/servers/5c579fdc-7e07-4a26-9503-bfbe1ae8b999 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:35:19.377305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:19.377820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:19.384185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.384754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.385198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.385916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.386790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.386962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.413063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:35:19.488285 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3604c4bb-6a71-451d-a98b-22b4b2025cfd tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 204 len: 0 microversion: 2.1 time: 0.114686 Oct 10 11:35:19.488876 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3495/6887] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:35:19 2022] DELETE /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:35:19.498811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:19.499468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:19.506275 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.506772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.507258 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.507962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:19.508428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:19.508864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:19.641597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:19.649396 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c1dda99-3d33-4531-a543-c656ea83d71e tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1511 microversion: 2.1 time: 0.156324 Oct 10 11:35:19.649973 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3393/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:19 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:20.674005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:20.674640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:20.677489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:20.682983 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:20.683525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:20.683979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:20.684686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:20.685156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:20.686387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:20.988383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba5cce247c9641c98cd06a8d4074d7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359c72602a5e47c3bbae9b27f88e74d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:20.997595 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af7d5c59-959d-4ac8-acbe-89db054a1000 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 200 len: 1511 microversion: 2.1 time: 0.328504 Oct 10 11:35:20.998618 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3496/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:20 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:21.335388 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3", "name": "network-vif-deleted", "tag": "07282eb8-cf2c-4df8-8c1b-7f0322126d15"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:21.349104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:21.349596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:21.350028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:21.368004 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] Creating event network-vif-deleted:07282eb8-cf2c-4df8-8c1b-7f0322126d15 for instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 on n-h1-860687-2 Oct 10 11:35:21.373564 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-59bd190f-9e55-4447-aa5b-8c05216a38aa req-e5789be4-8803-4b54-a580-f9a1515ae9d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041861 Oct 10 11:35:21.374973 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3394/6890] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:35:22.022331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:22.022975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] [instance: 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:22.030549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:22.031035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:22.031488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:22.032232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:22.032705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:22.033146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:22.047464 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] HTTP exception thrown: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Request method failure captured: Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 HTTP/1.1 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRANa8T9_xDFnRR5sWbnsOk2qNYMa4HpPQObapej8wXOHC86I-aMlIAFyiL4OP4PVUXsB48xLufJMcZJzpFt9xoFK1NdqhFw5TcMUt_9wDufYNcq5abYTdy_Itunq8NMF3mdrVsRYwp7shKD1DTat2N2q-RoIgkjIt_R2rNZttz-ZfJU Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_359c72602a5e47c3bbae9b27f88e74d6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/359c72602a5e47c3bbae9b27f88e74d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/359c72602a5e47c3bbae9b27f88e74d6"}]}] Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 359c72602a5e47c3bbae9b27f88e74d6 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1516636039 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: ba5cce247c9641c98cd06a8d4074d7a1 Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-ServersNegativeTestJSON-1516636039-project Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3'} Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:35:22.049142 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] Returning 404 to user: Instance 8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a440642f-1445-4b2f-9dae-156323828e43 tempest-ServersNegativeTestJSON-1516636039 tempest-ServersNegativeTestJSON-1516636039-project] 10.222.0.16 "GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3" status: 404 len: 111 microversion: 2.1 time: 0.032580 Oct 10 11:35:22.054159 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3497/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:22 2022] GET /compute/v2.1/servers/8bc6270e-8a1e-4f5b-a2ed-3fd0636a9ce3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:35:54.977207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=52 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:54.978396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:55.188446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-853fc303-a768-4525-83cb-b8fd95a56dce tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: .version_select at 0x7f6777a06ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-990667929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFV/V7cucKOcGOyaOIhqzwkg0ABvzwsJAKd6QdKFeJZ5zD8t3l2lgPkFGMPbjsn7D++P7eUho9ds1cwv7Klef0RWLS2AWST4MPFpoeC1HX4duXcoBIQVey8deTXeW/lVA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:55.205892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-853fc303-a768-4525-83cb-b8fd95a56dce tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:35:55.212651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-853fc303-a768-4525-83cb-b8fd95a56dce tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:35:55.240051 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-853fc303-a768-4525-83cb-b8fd95a56dce tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.265160 Oct 10 11:35:55.241007 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3395/6892] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:35:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:35:55.298004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-196126091", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-990667929", "networks": [{"uuid": "98dedbf3-07ab-461d-8041-36cc02676cbf"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:55.308594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:55.309515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:35:55.368032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] validate_networks() for [('98dedbf3-07ab-461d-8041-36cc02676cbf', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:35:55.758131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:35:55.758582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:35:55.759123 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:35:55.759558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:35:55.759992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:35:55.771144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:55.771659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:55.772116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:55.772873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:55.773383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:55.773832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:55.791230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:35:55.796827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:35:55.809392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:35:55.811897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:35:55.860551 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b0684c0c-dd73-4238-a342-dbed62161cb0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568050 Oct 10 11:35:55.861211 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3498/6893] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:35:55.872529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51c43a5c-b856-42b0-8a22-353987bd28b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:55.873281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51c43a5c-b856-42b0-8a22-353987bd28b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:56.068561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51c43a5c-b856-42b0-8a22-353987bd28b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:56.076602 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51c43a5c-b856-42b0-8a22-353987bd28b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1261 microversion: 2.1 time: 0.208122 Oct 10 11:35:56.077317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3396/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:55 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:57.104398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:57.105971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:57.116566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:57.117191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:57.117737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:57.118569 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:57.119150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:57.119680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:57.209113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:57.221208 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d5b5fdc2-fcb9-4dd3-b849-3e538e38ee24 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1319 microversion: 2.1 time: 0.122940 Oct 10 11:35:57.234729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3499/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:57 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:35:58.245998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:58.246759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:58.254057 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:58.254574 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:58.255033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:58.255743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:58.256201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:58.256805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:58.408635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3461e9d-39b4-4a3b-add1-c71b46e2f5e5", "tag": "3592c9b9-dd86-48fa-a3be-34b5d42e3165"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:35:58.415927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:58.426092 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-514c19c0-8c69-4f8e-93cb-e43f7a3903ea tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.183571 Oct 10 11:35:58.439186 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3397/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:58 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:35:58.439348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:58.449525 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:58.451213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:58.486338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] Creating event network-changed:3592c9b9-dd86-48fa-a3be-34b5d42e3165 for instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 on n-h2-860687-2 Oct 10 11:35:58.494394 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c09aa20e-0656-4ef7-b989-9a608ea2c2f7 req-e1eda736-1e36-4ca3-b412-46d41089378c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092111 Oct 10 11:35:58.495347 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3500/6897] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:35:59.454128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:35:59.454855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:35:59.462173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:59.462751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:59.463217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:59.463921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:35:59.464378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:35:59.464881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:35:59.601585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:35:59.610681 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-982c127f-0404-409e-94b3-5f3c549b5d67 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.161009 Oct 10 11:35:59.611318 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3398/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:35:59 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:00.635330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:00.636193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:00.645717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:00.646358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:00.646928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:00.647795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:00.648363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:00.648910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:00.796429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:00.804863 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-21443107-659d-42b3-88f8-111b4988726d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.174619 Oct 10 11:36:00.805459 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3501/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:00 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:01.828992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:01.829648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:01.837802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:01.838302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:01.838742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:01.839513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:01.839972 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:01.840403 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:01.980684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:01.988549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85234d21-533b-49a6-820b-e4d61b8c5f87 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.164079 Oct 10 11:36:01.989151 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3399/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:01 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:03.011612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:03.012279 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:03.019201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:03.019704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:03.020158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:03.020868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:03.021346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:03.021789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:03.157167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:03.164820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73763c09-11d5-4623-b5d2-5d2b64d70f3d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.157167 Oct 10 11:36:03.165397 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3502/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:03 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:03.584020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3461e9d-39b4-4a3b-add1-c71b46e2f5e5", "name": "network-vif-plugged", "status": "completed", "tag": "3592c9b9-dd86-48fa-a3be-34b5d42e3165"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:03.593455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:03.594491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:03.594936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:03.605734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] Creating event network-vif-plugged:3592c9b9-dd86-48fa-a3be-34b5d42e3165 for instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 on n-h2-860687-2 Oct 10 11:36:03.611177 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2203c28b-7555-4f4a-98db-6dc5ba656bd4 req-19ca25c1-6589-47a5-b667-106dd49fd4a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082579 Oct 10 11:36:03.611767 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3400/6902] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:36:04.188171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:04.188804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:04.195739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:04.196250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:04.196710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:04.197423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:04.197902 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:04.198347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:04.328602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:04.336625 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-44ebbf30-88ca-458b-b6a9-015ea2ffd642 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1361 microversion: 2.1 time: 0.153057 Oct 10 11:36:04.337234 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3503/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:04 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:05.362709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:05.363484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:05.369683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:05.370170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:05.370613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:05.371389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:05.371851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:05.372336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:05.510368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:05.518372 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac54ca37-b8c5-4ff4-acdf-86f143b35433 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1553 microversion: 2.1 time: 0.162093 Oct 10 11:36:05.518944 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3401/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:05 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:05.540526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:05.541165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:05.548729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:05.549230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:05.549710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:05.550424 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:05.550901 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:05.551373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:05.680564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:05.689501 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83f8e371-8ca6-4a44-a998-2199e08f661b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1553 microversion: 2.1 time: 0.152852 Oct 10 11:36:05.690078 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3504/6905] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:05 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:07.353808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c9a7b02-a663-41f4-aa39-ced739069f75"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:07.356322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:07.358360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:07.365625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:07.366121 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:07.366567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:07.367315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:07.367783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:07.368218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:07.613604 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a59afd1-14d9-4d51-b1c8-a7b9433df1ae tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263238 Oct 10 11:36:07.614242 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3402/6906] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:36:07 2022] POST /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:18.320056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:18.320592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:18.322555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.323253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.324947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.325623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=34 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.333579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:18.334094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:18.334582 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:18.335343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:18.335826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:18.336277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:18.420962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'services' on Instance uuid d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:36:18.493245 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-162c7d4c-fc8f-4697-9f85-0d99b6cfedd7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments/9c9a7b02-a663-41f4-aa39-ced739069f75" status: 202 len: 0 microversion: 2.1 time: 0.176959 Oct 10 11:36:18.493879 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3505/6907] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:36:18 2022] DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments/9c9a7b02-a663-41f4-aa39-ced739069f75 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:36:18.503669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:18.506191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:18.508816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.509729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:18.516822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:18.517323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:18.518131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:18.519025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:18.519486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:18.519915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:18.555461 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cc1b84e-2a4d-4228-bdb7-aa241936bcad tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056858 Oct 10 11:36:18.556268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3403/6908] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:18 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:36:19.568989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:19.571462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:19.579235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:19.579746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:19.580221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:19.580936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:19.581412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:19.581886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:19.615817 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fc3d5ae0-e6d1-40a3-b118-1c2ed3bbf210 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051260 Oct 10 11:36:19.616439 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3506/6909] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:19 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:20.628995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:20.631211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:20.637902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:20.638345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:20.638788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:20.639522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:20.640127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:20.640712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:20.670933 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0be685d-1c5e-4c08-9ce8-03eac03607d5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 Oct 10 11:36:20.672083 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3404/6910] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:20 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:21.684079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:21.686403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:21.693414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:21.693917 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:21.694369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:21.695106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:21.695579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:21.696022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:21.727653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7c1f743e-3aaf-4969-8720-7cfbd6505e5e tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047560 Oct 10 11:36:21.728417 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3507/6911] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:21 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:22.740977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:22.743115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:22.750517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:22.751010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:22.751452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:22.752147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:22.752599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:22.753024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:22.784556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0952aa30-5545-47fe-a78a-90c059915e85 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047687 Oct 10 11:36:22.785124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3405/6912] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:22 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:23.797945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:23.800105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:23.807420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:23.807919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:23.808372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:23.809074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:23.809545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:23.809982 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:23.838761 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4a659b53-44e3-40be-af44-08624093139d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045635 Oct 10 11:36:23.839338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3508/6913] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:23 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:36:23.850654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:23.851186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:23.857938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:23.858421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:23.859467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:23.860257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:23.860714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:23.861141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:23.936069 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 is not attached to volume 9c9a7b02-a663-41f4-aa39-ced739069f75 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments/9c9a7b02-a663-41f4-aa39-ced739069f75 HTTP/1.1 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 is not attached to volume 9c9a7b02-a663-41f4-aa39-ced739069f75 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': 'd3461e9d-39b4-4a3b-add1-c71b46e2f5e5', 'id': '9c9a7b02-a663-41f4-aa39-ced739069f75'} Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c9a7b02-a663-41f4-aa39-ced739069f75. Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 is not attached to volume 9c9a7b02-a663-41f4-aa39-ced739069f75 Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:36:23.945439 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 is not attached to volume 9c9a7b02-a663-41f4-aa39-ced739069f75 Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 is not attached to volume 9c9a7b02-a663-41f4-aa39-ced739069f75 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75bcd1a8-3b0d-4720-851b-328d025af5e7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments/9c9a7b02-a663-41f4-aa39-ced739069f75" status: 404 len: 154 microversion: 2.1 time: 0.100306 Oct 10 11:36:23.949381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3406/6914] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:36:23 2022] DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5/os-volume_attachments/9c9a7b02-a663-41f4-aa39-ced739069f75 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:36:27.294064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:27.294674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:27.302106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:27.302696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:27.303738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:27.304560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:27.304774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:27.305274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:27.332465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:36:27.413784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-463d4b3b-29b6-4ff7-b94b-9af4c3430a44 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 204 len: 0 microversion: 2.1 time: 0.123210 Oct 10 11:36:27.414727 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3509/6915] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:36:27 2022] DELETE /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:36:27.423270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:27.423906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:27.431848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:27.432340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:27.432841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:27.433464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:27.433919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:27.434345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:27.568891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:27.576870 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a289d1e-6308-4ff9-84d8-cb3b6b3ececf tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1559 microversion: 2.1 time: 0.157515 Oct 10 11:36:27.578201 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3407/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:27 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:36:28.603577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:28.604302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:28.611118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:28.611624 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:28.612080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:28.612789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:28.613260 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:28.613704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:28.747224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:28.755938 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ef78c27-f7f6-4e29-b386-cf3167bc8e13 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1559 microversion: 2.1 time: 0.156641 Oct 10 11:36:28.756533 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3510/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:28 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:29.407119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3461e9d-39b4-4a3b-add1-c71b46e2f5e5", "name": "network-vif-deleted", "tag": "3592c9b9-dd86-48fa-a3be-34b5d42e3165"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:29.418283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:29.418777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:29.419247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:29.435858 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] Creating event network-vif-deleted:3592c9b9-dd86-48fa-a3be-34b5d42e3165 for instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 on n-h2-860687-2 Oct 10 11:36:29.441489 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c8d69f66-fe53-406f-b460-84148cd4a11e req-756bba53-b2e4-49db-8829-281149c1f9a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Oct 10 11:36:29.442285 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3408/6918] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:29.782232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:29.782817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:29.789878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:29.790381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:29.790833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:29.791565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:29.792036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:29.792475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:29.826587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:29.827814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:29.828468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:29.829022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'fault' on Instance uuid d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:36:29.871045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:29.880150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d227f0b4-c0e9-4460-ac08-4aa933d5d949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 200 len: 1351 microversion: 2.1 time: 0.102821 Oct 10 11:36:29.880842 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3511/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:29 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:30.905293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:30.905993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: d3461e9d-39b4-4a3b-add1-c71b46e2f5e5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:30.912561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:30.913053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:30.913496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:30.914193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:30.914650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:30.915108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:30.929141 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 HTTP/1.1 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'd3461e9d-39b4-4a3b-add1-c71b46e2f5e5'} Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:36:30.930778 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b7cc258-1b61-4635-9114-d5431ffee8a9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5" status: 404 len: 111 microversion: 2.1 time: 0.032021 Oct 10 11:36:30.935808 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3409/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:30 2022] GET /compute/v2.1/servers/d3461e9d-39b4-4a3b-add1-c71b46e2f5e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:36:30.943248 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e6e40469-ead4-4b8a-b7a9-cde728aa2bb8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '.version_select at 0x7f677cbdc670>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:30.966364 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e6e40469-ead4-4b8a-b7a9-cde728aa2bb8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-990667929" status: 202 len: 0 microversion: 2.1 time: 0.028517 Oct 10 11:36:30.966945 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3512/6921] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-990667929 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:36:30.984392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-246d31b7-aeec-45a1-b325-c990d85c9f4d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: .version_select at 0x7f677ca1aca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-404420893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNMkz9hwynaKgx8T15fmxOmu3wSI6ZEEv0YjIzkZOIqs04EEBwkBuoA/paxKccHHpQbQmRP2UToERC9nLwsWt6xt0SSxiWDznYmHOOqL5ql6zAeefS6UTVA3/EZL7A35A=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:31.000270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-246d31b7-aeec-45a1-b325-c990d85c9f4d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:36:31.006337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-246d31b7-aeec-45a1-b325-c990d85c9f4d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:36:31.028843 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-246d31b7-aeec-45a1-b325-c990d85c9f4d tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048854 Oct 10 11:36:31.029436 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3410/6922] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:36:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:36:31.080295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-381166566", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-404420893", "networks": [{"uuid": "98dedbf3-07ab-461d-8041-36cc02676cbf"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:31.135993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] validate_networks() for [('98dedbf3-07ab-461d-8041-36cc02676cbf', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:36:31.508955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:36:31.509401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:36:31.509895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:36:31.510326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:36:31.510759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:36:31.519767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:31.520269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:31.520727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:31.521482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:31.521959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:31.522414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:31.540616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:36:31.546634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:36:31.559174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:36:31.561538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:36:31.609022 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-297ced8a-d135-40fa-8279-7a1dfc38177b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532652 Oct 10 11:36:31.609903 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3513/6923] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:36:31.621297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2f66cf5-6727-4759-aba2-7f8c2b6312b6 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:31.621910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2f66cf5-6727-4759-aba2-7f8c2b6312b6 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:31.676738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2f66cf5-6727-4759-aba2-7f8c2b6312b6 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:31.683530 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2f66cf5-6727-4759-aba2-7f8c2b6312b6 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1261 microversion: 2.1 time: 0.066377 Oct 10 11:36:31.684317 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3411/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:31 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:32.706441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:32.707519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:32.714874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:32.715430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:32.715884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:32.716597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:32.717074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:32.718085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:32.785367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:32.793138 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3730686e-0aca-4a3b-a3b4-ea110fc17938 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1319 microversion: 2.1 time: 0.091195 Oct 10 11:36:32.793681 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3514/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:32 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:33.816913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:33.817535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:33.824505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:33.825001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:33.825454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:33.826170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:33.826634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:33.827764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:33.962306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:33.971734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-253e01f4-76ad-45cf-9f7c-0d531f76e377 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.158803 Oct 10 11:36:33.972335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3412/6926] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:33 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:33.993497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d597e51-ee07-482c-86c7-f6d03357073c", "tag": "8b0b77dc-82bb-4830-860e-4c9a1f1bafc2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:34.003615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:34.004151 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:34.004575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:34.017038 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] Creating event network-changed:8b0b77dc-82bb-4830-860e-4c9a1f1bafc2 for instance 7d597e51-ee07-482c-86c7-f6d03357073c on n-h1-860687-2 Oct 10 11:36:34.022235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-3a5bb1f6-89e2-4373-92a5-7117dbb26dc1 req-5904ec92-d8e8-43ee-9a4d-229b3ce29efc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033837 Oct 10 11:36:34.022870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3515/6927] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:34.999038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:34.999667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:35.006454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:35.006947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:35.007412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:35.008105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:35.008564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:35.008989 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:35.137627 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:35.145624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1db253bd-5fe9-4c6c-b89a-04991ce9ef94 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.150600 Oct 10 11:36:35.146194 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3413/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:34 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:36.170338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:36.172039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:36.179037 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:36.179770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:36.180280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:36.181023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:36.181597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:36.182052 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:36.320556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:36.328194 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f593b3c5-a3f9-4b4a-bcd3-8885cbedfb62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.162463 Oct 10 11:36:36.328768 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3516/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:36 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:37.350986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:37.351638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:37.358938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:37.359922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:37.360374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:37.361079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:37.361540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:37.361987 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:37.493755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:37.502431 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc4568fe-56f4-4f8b-a08a-abea8102dc07 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.155377 Oct 10 11:36:37.503015 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3414/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:37 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:38.525768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:38.526407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:38.534233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:38.534737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:38.535230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:38.535951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:38.536419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:38.536862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:38.671309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:38.679229 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8c84ed2e-b215-4706-b5e8-97ae1c0dfb97 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.157367 Oct 10 11:36:38.679805 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3517/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:38 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:39.702089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:39.702715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:39.709731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:39.710220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:39.710655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:39.711384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:39.711835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:39.712261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:39.813720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d597e51-ee07-482c-86c7-f6d03357073c", "name": "network-vif-plugged", "status": "completed", "tag": "8b0b77dc-82bb-4830-860e-4c9a1f1bafc2"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:39.828699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:39.829206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:39.829662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:39.841718 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] Creating event network-vif-plugged:8b0b77dc-82bb-4830-860e-4c9a1f1bafc2 for instance 7d597e51-ee07-482c-86c7-f6d03357073c on n-h1-860687-2 Oct 10 11:36:39.848150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4a17110e-33c6-434d-b667-17c4bb2ff966 req-7d2d726d-dea0-455d-be15-fe7a34a6d1bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038723 Oct 10 11:36:39.848828 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3518/6932] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:36:39.849874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:39.858184 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-266a0869-e3c1-4d66-b6ac-438e30a9afcb tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.160151 Oct 10 11:36:39.859281 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3415/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:39 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:40.883018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:40.883771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:40.890162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:40.890676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:40.891234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:40.891992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:40.892473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:40.892931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:41.022526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:41.030987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-011128aa-8b97-4529-bf0c-bd6a02d2c833 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1361 microversion: 2.1 time: 0.153069 Oct 10 11:36:41.031586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3519/6934] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:40 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:42.053712 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:42.054328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:42.057205 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:42.065300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:42.065794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:42.066239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:42.066940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:42.067427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:42.067858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:42.205018 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:42.213103 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-539bc492-fae5-4421-93b3-f4b198c631ac tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1552 microversion: 2.1 time: 0.163342 Oct 10 11:36:42.213692 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3416/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:42 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:42.236725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:42.237487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:42.239637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:42.240321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:42.247509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:42.248041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:42.249130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:42.249967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:42.250480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:42.250935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:42.388255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:36:42.396563 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d80ef10c-a503-49bc-aa8d-de7bbadb04b9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1552 microversion: 2.1 time: 0.164385 Oct 10 11:36:42.397200 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3520/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:36:42 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:36:43.889130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e01b9bd-1857-423a-a4ac-4e9372f783a0"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:36:43.891525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:43.898263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:43.898743 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:43.899214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:43.899900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:43.900353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:43.900779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:44.158028 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a59bca28-5bd8-407f-8610-715fe507ab69 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272646 Oct 10 11:36:44.158667 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3417/6937] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:36:43 2022] POST /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:54.882342 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:54.882851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:54.886095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:54.886873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:54.896287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:54.896799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:54.897255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:54.897978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:54.898454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:54.898903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:54.983017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'services' on Instance uuid 7d597e51-ee07-482c-86c7-f6d03357073c {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:36:55.053894 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41956464-f781-49ea-8e39-a72bf48b11b5 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments/6e01b9bd-1857-423a-a4ac-4e9372f783a0" status: 202 len: 0 microversion: 2.1 time: 0.175275 Oct 10 11:36:55.055026 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3521/6938] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:36:54 2022] DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments/6e01b9bd-1857-423a-a4ac-4e9372f783a0 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:36:55.062153 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:36:55.062657 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:36:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments (ip 10.222.0.16) !!! Oct 10 11:36:55.063736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:55.064511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:36:55.069392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:55.072501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:55.084272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:55.085507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:55.085507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:55.086031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:55.086489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:55.086919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:55.121398 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdbc44e7-313a-48e0-a6cb-02b460bdbc62 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061573 Oct 10 11:36:55.122124 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3418/6939] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:55 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:36:56.134621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:56.137296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:56.144557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:56.145067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:56.145540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:56.146268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:56.146752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:56.147238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:56.180043 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8519a8bf-eb39-492b-9c67-56f721bc6253 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049995 Oct 10 11:36:56.180832 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3522/6940] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:56 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:57.193001 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:57.195279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:57.202443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:57.202948 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:57.203423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:57.204138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:57.204603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:57.205041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:57.236181 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-358a5c39-66f3-44e2-898e-46e5acb3c949 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Oct 10 11:36:57.236757 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3419/6941] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:57 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:58.249352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:58.251558 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:58.258406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:58.258904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:58.259399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:58.260106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:58.260575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:58.261033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:58.291789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-635e98a7-3e7b-4f51-8f0e-a05523eb3b3a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 Oct 10 11:36:58.292357 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3523/6942] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:58 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:36:59.304416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:36:59.306649 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:36:59.313831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:59.314327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:59.314769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:59.315499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:36:59.315959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:36:59.316392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:36:59.348052 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1a4684c-db5b-4acb-9746-5bed1541a7f2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Oct 10 11:36:59.348619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3420/6943] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:36:59 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:00.361406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:00.363586 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:00.370171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:00.370687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:00.371186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:00.371905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:00.372408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:00.372855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:00.402360 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6c370a3-f74f-4759-b78d-8141356a720c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045742 Oct 10 11:37:00.402936 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3524/6944] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:00 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:37:00.413518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:00.414004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:00.421525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:00.422017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:00.422458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:00.423189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:00.423652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:00.424084 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:00.501317 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance 7d597e51-ee07-482c-86c7-f6d03357073c is not attached to volume 6e01b9bd-1857-423a-a4ac-4e9372f783a0 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments/6e01b9bd-1857-423a-a4ac-4e9372f783a0 HTTP/1.1 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7d597e51-ee07-482c-86c7-f6d03357073c is not attached to volume 6e01b9bd-1857-423a-a4ac-4e9372f783a0 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '7d597e51-ee07-482c-86c7-f6d03357073c', 'id': '6e01b9bd-1857-423a-a4ac-4e9372f783a0'} Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e01b9bd-1857-423a-a4ac-4e9372f783a0. Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d597e51-ee07-482c-86c7-f6d03357073c is not attached to volume 6e01b9bd-1857-423a-a4ac-4e9372f783a0 Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:00.502938 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d597e51-ee07-482c-86c7-f6d03357073c is not attached to volume 6e01b9bd-1857-423a-a4ac-4e9372f783a0 Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance 7d597e51-ee07-482c-86c7-f6d03357073c is not attached to volume 6e01b9bd-1857-423a-a4ac-4e9372f783a0 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cea184f1-ba4a-43b0-abf0-7ad0815531ff tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments/6e01b9bd-1857-423a-a4ac-4e9372f783a0" status: 404 len: 154 microversion: 2.1 time: 0.094940 Oct 10 11:37:00.507581 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3421/6945] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:37:00 2022] DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c/os-volume_attachments/6e01b9bd-1857-423a-a4ac-4e9372f783a0 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:37:03.884063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:03.884571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:03.892290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:03.892805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:03.893259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:03.894021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:03.894496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:03.894946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:03.921913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:37:04.005219 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ac4e0f1-9377-45fe-be19-9f62438e764b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 204 len: 0 microversion: 2.1 time: 0.124876 Oct 10 11:37:04.009017 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3525/6946] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:37:03 2022] DELETE /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:37:04.015647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:04.017156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:04.024900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:04.025608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:04.026074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:04.026831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:04.027324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:04.027761 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:04.163451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:04.171349 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-579445dc-6fb1-4d38-a265-a955bffbf951 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1558 microversion: 2.1 time: 0.160790 Oct 10 11:37:04.172146 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3422/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:04 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:05.195414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:05.196064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:05.203324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:05.203840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:05.204294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:05.205004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:05.205475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:05.205916 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:05.336657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:05.345793 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fe6e04dd-d532-4291-b8ad-96eb377b854b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1558 microversion: 2.1 time: 0.154748 Oct 10 11:37:05.346381 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3526/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:05 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:06.092369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d597e51-ee07-482c-86c7-f6d03357073c", "name": "network-vif-deleted", "tag": "8b0b77dc-82bb-4830-860e-4c9a1f1bafc2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:06.102740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:06.103250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:06.103690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:06.115591 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] Creating event network-vif-deleted:8b0b77dc-82bb-4830-860e-4c9a1f1bafc2 for instance 7d597e51-ee07-482c-86c7-f6d03357073c on n-h1-860687-2 Oct 10 11:37:06.120533 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-339ffda3-edf6-470b-91d3-525d9b956f77 req-710db699-bcc2-45d0-a268-0fe9e0084c49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085234 Oct 10 11:37:06.121129 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3423/6949] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:06.370468 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:06.371203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:06.381011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:06.381837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:06.381984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:06.382928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:06.383439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:06.383897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:06.419773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:06.421533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:06.422159 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:06.422648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'fault' on Instance uuid 7d597e51-ee07-482c-86c7-f6d03357073c {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:37:06.467773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:06.475055 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0af96914-c0bf-49f6-99c5-802dac808457 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 200 len: 1351 microversion: 2.1 time: 0.109285 Oct 10 11:37:06.475642 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3527/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:06 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:07.500599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:07.501235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: 7d597e51-ee07-482c-86c7-f6d03357073c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:07.507602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:07.508093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:07.508535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:07.509235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:07.509696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:07.510126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:07.526771 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c HTTP/1.1 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '7d597e51-ee07-482c-86c7-f6d03357073c'} Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:07.528436 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance 7d597e51-ee07-482c-86c7-f6d03357073c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-839e79d2-3642-4249-81b1-cb40d39cefc2 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c" status: 404 len: 111 microversion: 2.1 time: 0.035052 Oct 10 11:37:07.532960 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3424/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:07 2022] GET /compute/v2.1/servers/7d597e51-ee07-482c-86c7-f6d03357073c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:37:07.538961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-894ea2b8-df65-4363-bce3-3ad20b645eee tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '.version_select at 0x7f677d1ef700>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:07.558956 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-894ea2b8-df65-4363-bce3-3ad20b645eee tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-404420893" status: 202 len: 0 microversion: 2.1 time: 0.023767 Oct 10 11:37:07.559563 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3528/6952] 10.222.0.16 () {58 vars in 1275 bytes} [Mon Oct 10 11:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-404420893 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:37:07.578182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e15d37cd-42cd-4372-a81f-30d6152f1f36 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: .version_select at 0x7f677d385ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2134076663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrt3Co4pEE2aXakXrXJlTsybHA9m59Ry5G4QmplffbryxjUekog4biA27kgrn9UzSYT+n0CR+WlJdHUSBykJ93bjaUOiHad3PzhKkvIJBNQErXxI5XopfxAunvm48Azaw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:07.596283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e15d37cd-42cd-4372-a81f-30d6152f1f36 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:37:07.601407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e15d37cd-42cd-4372-a81f-30d6152f1f36 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:37:07.625283 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e15d37cd-42cd-4372-a81f-30d6152f1f36 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051085 Oct 10 11:37:07.625881 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3425/6953] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:37:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:07.675109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2046850330", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2134076663", "networks": [{"uuid": "98dedbf3-07ab-461d-8041-36cc02676cbf"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:07.728073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] validate_networks() for [('98dedbf3-07ab-461d-8041-36cc02676cbf', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:37:08.179786 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:37:08.180226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:37:08.180744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:37:08.181168 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:37:08.181594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:37:08.193365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:08.193858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:08.194310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:08.195073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:08.195546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:08.195985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:08.215094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:37:08.220880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Getting quotas for user 09fe0ec2200e4739b58f31aebfeb966d and project 19f662a530b84f7f86c633f0ec309edc. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:37:08.233001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:37:08.236029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:37:08.282206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a7b84a5-470e-4d39-9808-1c9fc9ab7053 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611482 Oct 10 11:37:08.282855 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3529/6954] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:37:08.293949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0df14a1c-8478-40cb-87d6-31a1d6c28df1 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:08.294562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0df14a1c-8478-40cb-87d6-31a1d6c28df1 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:08.354855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0df14a1c-8478-40cb-87d6-31a1d6c28df1 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:08.363218 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0df14a1c-8478-40cb-87d6-31a1d6c28df1 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1263 microversion: 2.1 time: 0.073090 Oct 10 11:37:08.363814 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3426/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:08 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:09.387581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:09.388227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:09.394546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:09.395089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:09.395550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:09.396451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:09.396927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:09.397375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:09.461556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:09.470488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be58c826-76f3-4fc5-a5f9-d77afab5a0e9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1321 microversion: 2.1 time: 0.087808 Oct 10 11:37:09.471106 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3530/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:09 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1321 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:10.493945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:10.494564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:10.501517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:10.502006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:10.502444 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:10.503169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:10.503629 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:10.504061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:10.560038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6060d5e-da43-4986-b17f-cdf2cf154468", "tag": "7177253d-c4a1-48e1-b64d-907cf794b029"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:10.576507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:10.577860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:10.579311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:10.597553 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] Creating event network-changed:7177253d-c4a1-48e1-b64d-907cf794b029 for instance e6060d5e-da43-4986-b17f-cdf2cf154468 on n-h2-860687-2 Oct 10 11:37:10.602898 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-25397ede-a199-4387-af0d-24eac4fb5f97 req-dbd5a544-ec2c-44cb-9cf7-9984de3280a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046933 Oct 10 11:37:10.603698 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3531/6957] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:10.649138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:10.658213 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c95ec23-cf0d-4661-8aca-fb348b973563 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.168341 Oct 10 11:37:10.658812 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3427/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:10 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:11.681885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:11.682529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:11.689553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:11.690060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:11.690516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:11.691265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:11.691746 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:11.692222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:11.827672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:11.835784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cc111253-45fb-4ad8-ad28-8fefc23c0fcd tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.159165 Oct 10 11:37:11.836367 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3532/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:11 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:12.860131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:12.860779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:12.867722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:12.868210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:12.868650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:12.869346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:12.869804 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:12.870237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:12.998281 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:13.006762 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-394f3946-4f4d-4249-ae0f-c363cc84a91c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.151104 Oct 10 11:37:13.007378 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3428/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:12 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:14.030390 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:14.031054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:14.037888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:14.038389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:14.038839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:14.039578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:14.040056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:14.040496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:14.175946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:14.183672 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-765bbf30-cf57-4ff1-b31e-710731047fd8 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.157871 Oct 10 11:37:14.184249 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3533/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:14 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:15.206895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:15.207778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:15.214596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:15.215108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:15.215554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:15.216243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:15.216695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:15.217118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:15.350339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:15.359173 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3b2beea-ccd3-4df8-987d-0cff81415ed9 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.155214 Oct 10 11:37:15.359773 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3429/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:15 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:15.767027 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6060d5e-da43-4986-b17f-cdf2cf154468", "name": "network-vif-plugged", "status": "completed", "tag": "7177253d-c4a1-48e1-b64d-907cf794b029"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:15.779230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:15.780269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:15.781197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:15.792802 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] Creating event network-vif-plugged:7177253d-c4a1-48e1-b64d-907cf794b029 for instance e6060d5e-da43-4986-b17f-cdf2cf154468 on n-h2-860687-2 Oct 10 11:37:15.798858 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-15977872-1196-4dd9-847d-3f24deec6091 req-c2ba653a-c144-43f4-8663-03fef8bf64f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Oct 10 11:37:15.799541 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3534/6963] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:16.382897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:16.383582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:16.391294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:16.391779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:16.392215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:16.392900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:16.393350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:16.393771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:16.523454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:16.531592 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7822d340-4ada-48f6-bf4f-a01ee072e557 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1363 microversion: 2.1 time: 0.152807 Oct 10 11:37:16.532177 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3430/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:16 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:17.556971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:17.557696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:17.564364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:17.564870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:17.565329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:17.566041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:17.566518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:17.566962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:17.699761 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:17.708844 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d16bac7d-3b14-4b2c-b893-8dcbf334cc4f tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1554 microversion: 2.1 time: 0.157082 Oct 10 11:37:17.709690 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3535/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:17 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:17.731545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:17.732161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:17.739253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:17.739737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:17.740174 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:17.740865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:17.741319 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:17.741742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:17.874302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:17.882159 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc9daeae-dfbb-4997-acd3-4d1c50b2416b tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1554 microversion: 2.1 time: 0.154451 Oct 10 11:37:17.882733 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3431/6966] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:17 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:37:19.371934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fee5343-0cac-4c56-bd70-e95441c32682"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:19.375157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:19.378296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:19.379193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:19.386320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:19.386832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:19.387311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:19.388029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:19.388497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:19.388937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:19.612678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:19.630303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dabeab48-9f1a-491b-adb1-2cae0b27473a tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "POST /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262244 Oct 10 11:37:19.630993 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3536/6967] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:37:19 2022] POST /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:30.339500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:30.340036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:30.342015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:30.343667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:30.344966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=64 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:30.351405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:30.351886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:30.352320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:30.353008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:30.353469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:30.353893 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:30.435992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'services' on Instance uuid e6060d5e-da43-4986-b17f-cdf2cf154468 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:37:30.508255 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-797a7fd1-09ae-4c89-ba58-95ffe38d9a00 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments/1fee5343-0cac-4c56-bd70-e95441c32682" status: 202 len: 0 microversion: 2.1 time: 0.172518 Oct 10 11:37:30.508898 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3432/6968] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:37:30 2022] DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments/1fee5343-0cac-4c56-bd70-e95441c32682 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:37:30.516298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:37:30.520898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:30.523325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:30.534073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:30.534577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:30.535051 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:30.535767 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:30.536239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:30.536682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:30.567567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b5bc932b-145d-4274-91ce-61dc1a6de384 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054019 Oct 10 11:37:30.568138 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3537/6969] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:30 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:31.582669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:31.585090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:31.594692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:31.595329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:31.595779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:31.596482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:31.596946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:31.597410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:31.627877 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2e138d5-baf7-4319-9b12-835ecb2d6a12 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051431 Oct 10 11:37:31.628467 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3433/6970] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:31 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:32.640482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:32.643602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:32.650584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:32.651136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:32.651600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:32.652329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:32.652808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:32.653258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:32.684047 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03222204-9f4d-48eb-828e-d52938ffc8d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047636 Oct 10 11:37:32.684624 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3538/6971] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:32 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:33.697445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:33.699867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:33.707256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:33.707754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:33.708206 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:33.708931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:33.709396 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:33.709831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:33.740911 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21b5a26c-abc2-466f-bafd-6bb854042e74 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Oct 10 11:37:33.741492 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3434/6972] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:33 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:34.753550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:34.755696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:34.762488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:34.762989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:34.763474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:34.764186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:34.764656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:34.765094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:34.798134 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3536fb5c-2e60-4bbe-9aad-5df48de340d0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048804 Oct 10 11:37:34.798729 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3539/6973] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:34 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:37:35.810276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:35.812449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:35.822029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:35.822518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:35.822963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:35.823688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:35.824169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:35.824603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:35.854292 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62f6b758-d293-4fa5-b2ce-ea6d660657b0 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048149 Oct 10 11:37:35.854854 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3435/6974] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:37:35 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:37:35.866837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:35.867418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:35.874117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:35.874620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:35.875138 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:35.875847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:35.876315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:35.876755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:35.953800 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 is not attached to volume 1fee5343-0cac-4c56-bd70-e95441c32682 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: request: DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments/1fee5343-0cac-4c56-bd70-e95441c32682 HTTP/1.1 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 is not attached to volume 1fee5343-0cac-4c56-bd70-e95441c32682 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'server_id': 'e6060d5e-da43-4986-b17f-cdf2cf154468', 'id': '1fee5343-0cac-4c56-bd70-e95441c32682'} Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1fee5343-0cac-4c56-bd70-e95441c32682. Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 is not attached to volume 1fee5343-0cac-4c56-bd70-e95441c32682 Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:35.955839 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 is not attached to volume 1fee5343-0cac-4c56-bd70-e95441c32682 Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 is not attached to volume 1fee5343-0cac-4c56-bd70-e95441c32682 {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37ab02cd-a475-4dba-8b68-ee7c07dd1b9c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments/1fee5343-0cac-4c56-bd70-e95441c32682" status: 404 len: 154 microversion: 2.1 time: 0.094787 Oct 10 11:37:35.960742 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3540/6975] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:37:35 2022] DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468/os-volume_attachments/1fee5343-0cac-4c56-bd70-e95441c32682 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:37:39.306767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:39.307357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:39.314452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:39.314959 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:39.315434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:39.316142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:39.316600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:39.317028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:39.345742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:37:39.423559 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-550c9437-0498-4d6a-8e90-153ff0187724 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 204 len: 0 microversion: 2.1 time: 0.120595 Oct 10 11:37:39.424532 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3436/6976] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:37:39 2022] DELETE /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:37:39.433008 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:39.433652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:39.440993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:39.441496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:39.441950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:39.442662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:39.443163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:39.443606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:39.579210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:39.587373 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a4126857-cab0-4cd6-8dff-2a317135bbe7 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1560 microversion: 2.1 time: 0.158336 Oct 10 11:37:39.587949 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3541/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:39 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:40.612257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:40.612966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:40.619919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:40.620408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:40.620850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:40.621542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:40.622002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:40.622428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:40.761858 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:40.769885 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-502263d7-b178-497e-a9e6-b03c4cd4d12c tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1560 microversion: 2.1 time: 0.162933 Oct 10 11:37:40.770465 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3437/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:40 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:41.447157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6060d5e-da43-4986-b17f-cdf2cf154468", "name": "network-vif-deleted", "tag": "7177253d-c4a1-48e1-b64d-907cf794b029"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:37:41.474503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:41.475640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:41.476560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:41.494820 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] Creating event network-vif-deleted:7177253d-c4a1-48e1-b64d-907cf794b029 for instance e6060d5e-da43-4986-b17f-cdf2cf154468 on n-h2-860687-2 Oct 10 11:37:41.502538 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c79968b1-871e-4f28-9750-147d5ca66f2d req-1279ad6e-cedb-4c31-9d55-83b31ab9577d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060880 Oct 10 11:37:41.503639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3542/6979] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:37:41.793694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:41.794250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:41.801249 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:41.801736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:41.802178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:41.802877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:41.803357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:41.803791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:41.843708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:41.844401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:41.844851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:41.845313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lazy-loading 'fault' on Instance uuid e6060d5e-da43-4986-b17f-cdf2cf154468 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:37:41.889648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09fe0ec2200e4739b58f31aebfeb966d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f662a530b84f7f86c633f0ec309edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:37:41.898633 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-383cd12d-f9c4-477a-aa23-b11ece819296 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 200 len: 1353 microversion: 2.1 time: 0.108872 Oct 10 11:37:41.899362 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3438/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:41 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:37:42.923402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:42.924063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] [instance: e6060d5e-da43-4986-b17f-cdf2cf154468] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:37:42.930206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:42.930708 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:42.931194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:42.931899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:37:42.932369 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:37:42.932815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:37:42.945987 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] HTTP exception thrown: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Request method failure captured: Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 HTTP/1.1 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAOVHAAWkA_93dCsYM35v1BOmvOoAI4EWU3nPc-BP0Oy7OZAr41o_k_nulATlEoxFgTK353JUQ3RfII1SV3U76pMSZOj0gpP6Auy4WpHKVKjE_AzfRmEqRM11YXsGaSxuw1VU7CcDTXFgRJG_D3bQrrDDcg5qQ40Pbnex540Ewq8fjQ Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19f662a530b84f7f86c633f0ec309edc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19f662a530b84f7f86c633f0ec309edc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19f662a530b84f7f86c633f0ec309edc"}]}] Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 19f662a530b84f7f86c633f0ec309edc Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-291881272 Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 09fe0ec2200e4739b58f31aebfeb966d Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestEncryptedCinderVolumes-291881272-project Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'e6060d5e-da43-4986-b17f-cdf2cf154468'} Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:37:42.947658 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Returning 404 to user: Instance e6060d5e-da43-4986-b17f-cdf2cf154468 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8214f36c-5309-44b6-8c49-64d060611eec tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468" status: 404 len: 111 microversion: 2.1 time: 0.031095 Oct 10 11:37:42.952338 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3543/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:37:42 2022] GET /compute/v2.1/servers/e6060d5e-da43-4986-b17f-cdf2cf154468 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:37:42.959048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f53a02b-67de-4f9d-81a8-ca5af8edef25 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] Calling method '.version_select at 0x7f677cf0ef70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:37:42.979940 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f53a02b-67de-4f9d-81a8-ca5af8edef25 tempest-TestEncryptedCinderVolumes-291881272 tempest-TestEncryptedCinderVolumes-291881272-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2134076663" status: 202 len: 0 microversion: 2.1 time: 0.024931 Oct 10 11:37:42.980518 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3439/6982] 10.222.0.16 () {58 vars in 1278 bytes} [Mon Oct 10 11:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2134076663 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:38:10.257438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6dcb61bf-6b7e-4654-805e-603fcd4abc12 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: .version_select at 0x7f677cbdc8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1741870951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzigErfZN8cjBe4wRVykgj9pNM9ync+gqaJbhrryIz1zvUA1jR2c+ELU5y0mkMTfGg5DOCyP1ISjpqZKeWH5eB2tSfYar0uVjW738LPfYZNsg+MJQuXFMpsxr0Se8NGwg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:10.263254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=14 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:10.263937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:10.277500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6dcb61bf-6b7e-4654-805e-603fcd4abc12 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for project 73b3b96c70004420a542ffbd48f77b49. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:38:10.282841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6dcb61bf-6b7e-4654-805e-603fcd4abc12 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for user bf929e7dd45d433592226eb45bc984c4 and project 73b3b96c70004420a542ffbd48f77b49. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:38:10.306703 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6dcb61bf-6b7e-4654-805e-603fcd4abc12 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053363 Oct 10 11:38:10.311560 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3544/6983] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:38:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:10.356844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:10.357608 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:10.361774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-33840705", "imageRef": "f649ffc0-213d-4bfa-bf1b-e96215eb50d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1741870951", "networks": [{"uuid": "7163eb0f-8f3f-44af-b93d-97c1d2212ea9"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:10.415988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] validate_networks() for [('7163eb0f-8f3f-44af-b93d-97c1d2212ea9', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:38:10.920766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:38:10.921197 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:38:10.922346 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:38:10.922877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:38:10.923326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:38:10.932310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:10.932741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:10.933182 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:10.933911 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:10.934395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:10.934823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:10.954292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for project 73b3b96c70004420a542ffbd48f77b49. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:38:10.959993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for user bf929e7dd45d433592226eb45bc984c4 and project 73b3b96c70004420a542ffbd48f77b49. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:38:10.972635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:38:10.974868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f649ffc0-213d-4bfa-bf1b-e96215eb50d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:38:11.022672 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b566e94-8063-4c41-8945-924f391e25a7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667946 Oct 10 11:38:11.023396 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3440/6984] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:38:11.035429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ad1b5a31-218f-4630-a1d0-39c559acf53c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:11.036098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ad1b5a31-218f-4630-a1d0-39c559acf53c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:11.091376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ad1b5a31-218f-4630-a1d0-39c559acf53c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:11.100285 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ad1b5a31-218f-4630-a1d0-39c559acf53c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1257 microversion: 2.1 time: 0.069920 Oct 10 11:38:11.100849 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3545/6985] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:11 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:12.123984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:12.124707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:12.131056 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:12.131550 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:12.131986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:12.132672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:12.133122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:12.133566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:12.204696 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:12.213267 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08c46132-4488-4a9b-a845-24be1f4cb3c8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1309 microversion: 2.1 time: 0.094067 Oct 10 11:38:12.227025 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3441/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:12 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:13.239745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:13.240496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:13.247520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:13.248023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:13.248473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:13.249189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:13.249668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:13.250099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:13.316483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:13.324541 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dd6c029c-09cf-4441-a71c-ead937c91d02 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.089490 Oct 10 11:38:13.325115 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3546/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:13 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:14.350177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:14.351717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:14.359253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:14.361026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:14.361877 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:14.362718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:14.363248 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:14.363942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:14.429937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:14.437814 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d08b5f5-42db-4764-a281-c5b2f2d47b0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.092241 Oct 10 11:38:14.439041 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3442/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:14 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:15.461770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:15.462412 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:15.470444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:15.470970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:15.471650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:15.472561 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:15.473198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:15.473848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:15.537359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:15.545053 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-771decc4-6bbb-479f-961f-43e0aade4349 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.087508 Oct 10 11:38:15.545637 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3547/6989] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:15 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:16.569954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:16.570494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:16.577766 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:16.578261 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:16.578705 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:16.579475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:16.579927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:16.580353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:16.648277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:16.656188 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0af22c36-e8d6-44cf-8944-f2d2b6184f94 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.090152 Oct 10 11:38:16.657473 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3443/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:16 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:17.679553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:17.680188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:17.690336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:17.690851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:17.691340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:17.692067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:17.692547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:17.693044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:17.770713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:17.779104 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ca1316e-64b2-4894-b745-4d53b6c3f98a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.103335 Oct 10 11:38:17.779714 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3548/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:17 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:18.803673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:18.804457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:18.811779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:18.812520 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:18.813002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:18.814413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:18.814886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:18.815352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:18.884727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:18.893658 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97c74335-6879-4664-8e10-420a8cadf9cc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.093888 Oct 10 11:38:18.895389 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3444/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:18 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:38:19.917079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:19.917710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:19.925362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:19.925866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:19.926317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:19.927047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:19.927522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:19.927962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:19.993719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:20.002488 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1062e25a-a469-4e98-b603-d6cebe2aa945 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1315 microversion: 2.1 time: 0.089090 Oct 10 11:38:20.003493 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3549/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:19 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:21.025951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:21.026492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:21.033737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:21.036067 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:21.038198 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:21.038910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:21.039663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:21.040575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:21.041286 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:21.042185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:21.202764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:21.211687 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad560902-aa16-4d66-8ffb-329af422a182 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.189605 Oct 10 11:38:21.212543 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3445/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:21 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:21.288445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:21.301479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:21.322825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:21.323657 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:21.324304 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:21.339042 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] Creating event network-changed:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:38:21.346216 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8fbd6097-8a07-4225-8b8f-7f4c74224c04 req-54e564b2-17cb-446a-b67a-bbd71ef578ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060796 Oct 10 11:38:21.347619 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3550/6995] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:22.234788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:22.235482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:22.242802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:22.243330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:22.243798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:22.244487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:22.244942 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:22.245367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:22.374973 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:22.384008 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a3baa58-9484-450f-a0be-6219776721f0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.153116 Oct 10 11:38:22.387163 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3446/6996] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:22 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:23.414515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:23.415284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:23.421809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:23.422806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:23.422806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:23.423533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:23.424804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:23.424804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:23.556090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:23.563856 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb5c3b34-19fe-4b7e-b239-0ce00fdcf7b8 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.156332 Oct 10 11:38:23.565158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3551/6997] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:23 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:24.587332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:24.587955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:24.594865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:24.595884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:24.596350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:24.597040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:24.597498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:24.597926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:24.727538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:24.735319 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce8842f7-7b1e-4925-ba00-27e0f04ec7e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.152039 Oct 10 11:38:24.735901 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3447/6998] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:24 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:25.757807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:25.758354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:25.765181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:25.765680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:25.766133 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:25.766861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:25.767344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:25.767839 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:25.896736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:25.904521 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a9c9cb29-7558-4d51-9136-b1e0c0cd4d03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.150781 Oct 10 11:38:25.905099 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3552/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:25 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:26.076552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "name": "network-vif-plugged", "status": "completed", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:26.088721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:26.089237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:26.089674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:26.101965 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] Creating event network-vif-plugged:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:38:26.106982 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-acb02b93-df6b-4d93-a9aa-b3a2e872952c req-17af289f-c0fa-4a6f-a14f-81ebfe2ca625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Oct 10 11:38:26.108230 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3448/7000] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:26.928355 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:26.928998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:26.935926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:26.936465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:26.936925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:26.937646 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:26.938124 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:26.938574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:27.070373 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:27.078191 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-47db206d-5378-4d53-9240-f0c8a4e642ad tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1357 microversion: 2.1 time: 0.154495 Oct 10 11:38:27.078724 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3553/7001] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:26 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:28.103300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:28.104009 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:28.110159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.110643 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.111113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.111917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.112368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.112794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.245702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:28.253974 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-360dc4b5-ed56-455f-87b3-7853c8a951ca tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1547 microversion: 2.1 time: 0.156004 Oct 10 11:38:28.254550 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3449/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:28 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:28.276555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:28.277195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:28.284180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.284684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.285143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.285859 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.286334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.286781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.418240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:28.426568 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a6616ab3-215b-4b9f-a06b-d47adb9eed7e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1547 microversion: 2.1 time: 0.153919 Oct 10 11:38:28.427173 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3554/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:28 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:28.448853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:28.453665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:28.454439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Searching by: {'deleted': False, 'project_id': '73b3b96c70004420a542ffbd48f77b49'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 11:38:28.460070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.460553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.460997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.461726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.462186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.462619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.486740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 11:38:28.513200 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e13a2dfe-fd49-4462-8432-ac6f77748775 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.068253 Oct 10 11:38:28.513775 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3450/7004] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 11:38:28 2022] GET /compute/v2.1/servers => generated 341 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:28.525441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:28.526082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:28.532107 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.532619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.533139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.533834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:28.534315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:28.534766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:28.665129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:28.673001 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4a889d5-395d-48f5-bcac-75fdc91d2146 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1547 microversion: 2.1 time: 0.151486 Oct 10 11:38:28.674205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3555/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:28 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:30.215171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af7a9f7e-0351-4c89-b234-ded46d03f3ed"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:30.217630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:30.225263 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:30.225782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:30.226226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:30.226922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:30.227406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:30.227836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:30.466123 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0017675-b1ed-4c31-a376-a9a5d2c05c78 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254886 Oct 10 11:38:30.466785 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3451/7006] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:38:30 2022] POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:43.515385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:43.516201 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:43.520294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:43.520962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=56 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:43.527738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:43.528236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:43.528684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:43.529410 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:43.529857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:43.530298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:43.656871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:43.665764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a9fb8c4c-0fdc-4cf0-bca7-e1d513d423e5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1593 microversion: 2.1 time: 0.154253 Oct 10 11:38:43.666347 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3556/7007] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:43 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:45.462093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:45.463239 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:45.464515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:38:45.549308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:45.562393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:45.562986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:45.563614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:45.576862 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] Creating event network-changed:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:38:45.584526 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-74933e57-30fc-442a-9878-2e70d92f860d req-085a22a0-8925-4e0e-acc9-2f3093f2371d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129169 Oct 10 11:38:45.587057 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3452/7008] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:38:46.537774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1972804313"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:46.538374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:46.545529 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:46.546034 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:46.546489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:46.547231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:46.547804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:46.548531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:46.680039 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Adding security group 8e22d2e7-c6e7-4140-955e-d74f4abfd47d to port 6d440c8d-c843-41d2-96a6-45e698fc7a26 Oct 10 11:38:47.317888 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-152ffd3a-ad50-43e4-bce7-51f271fd0866 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action" status: 202 len: 0 microversion: 2.1 time: 0.784135 Oct 10 11:38:47.322060 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3557/7009] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:38:46 2022] POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:38:47.328707 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:38:47.330162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:38:47.336677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:47.338145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:47.338584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:47.339488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:47.340126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:47.340561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:47.492393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:38:47.501848 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eea5a6ce-72ab-486a-a1f0-6db41edc6b75 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1758 microversion: 2.1 time: 0.177499 Oct 10 11:38:47.502446 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3453/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:38:47 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:38:47.605989 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:38:47.617284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:38:47.617777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:38:47.618226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:38:47.629567 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] Creating event network-changed:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:38:47.634566 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a1818c9f-89e2-4bb9-8fcd-3e26dffc1757 req-946de3e7-a6af-49b2-b4c0-88ae774d917d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033361 Oct 10 11:38:47.635368 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3558/7011] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:40:25.112277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:40:25.113027 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:40:25.117425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:40:25.119810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:40:25.126611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:25.127140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:25.127580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:25.128269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:25.128729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:25.129655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:25.202263 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53aa892d-6406-4d84-bd16-3fb2f9ec8598 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action" status: 202 len: 0 microversion: 2.1 time: 0.091656 Oct 10 11:40:25.202872 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3454/7012] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:40:25 2022] POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:40:25.212932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:40:25.213701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:40:25.214744 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:40:25.214965 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 (ip 10.222.0.16) !!! Oct 10 11:40:25.229958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:40:25.231318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:40:25.238243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:25.238849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:25.239371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:25.240104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:25.240581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:25.241031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:25.446605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:40:25.455247 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6821936-45a5-4608-a7b5-54f19c77469b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1760 microversion: 2.1 time: 0.245189 Oct 10 11:40:25.455770 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3559/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:40:25 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1760 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:40:26.480058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:40:26.480758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:40:26.491684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:26.492168 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:26.492607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:26.493292 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:40:26.493746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:40:26.494171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:40:26.637363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:40:26.645578 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45362c34-7a06-401c-86e7-07ae174adbc3 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1758 microversion: 2.1 time: 0.169835 Oct 10 11:40:26.646148 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3455/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:40:26 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:41:39.421713 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:41:39.422512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:41:39.426651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1972804313"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:41:39.427251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:39.434539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:39.435267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:39.435730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:39.436444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:39.436920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:39.437366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:39.570405 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Removing security group 8e22d2e7-c6e7-4140-955e-d74f4abfd47d from port 6d440c8d-c843-41d2-96a6-45e698fc7a26 Oct 10 11:41:39.866174 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-56695d9a-9645-4fc4-87dc-eaef8e34158e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action" status: 202 len: 0 microversion: 2.1 time: 0.446340 Oct 10 11:41:39.867331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3560/7015] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:41:39 2022] POST /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:41:39.876102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:41:39.881475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:41:39.882146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:41:39.888938 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:39.889540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:39.889977 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:39.904176 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] Creating event network-changed:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:41:39.909789 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4ae6830f-12f2-4854-b594-5c4a18b42941 req-7209ce0c-818a-4c80-b65e-0eb0255e7c84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038915 Oct 10 11:41:39.910326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3456/7016] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:41.012363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:41.012865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:41.018852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:41.019384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:41.019840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:41.020547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:41.021014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:41.021453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:41.102233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lazy-loading 'services' on Instance uuid ab67da6c-2a6c-416c-b456-6d77a975adb8 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:41:41.172134 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [153bedad-0b3a-4320-890a-ff6a8837b932] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:41:41.930485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:41:41.941805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:41.942289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:41.943036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:41.955321 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] Creating event network-changed:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:41:41.960670 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5571ef10-d557-47d7-8c66-1bd8f4777c72 req-964d9568-d5af-49d6-adea-a1f551e49468 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035519 Oct 10 11:41:41.961357 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3457/7017] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:41:42.179901 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [153bedad-0b3a-4320-890a-ff6a8837b932] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43456. Oct 10 11:41:42.183447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb96220c-2d0b-4725-b955-5113564e8939 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments/af7a9f7e-0351-4c89-b234-ded46d03f3ed" status: 202 len: 0 microversion: 2.1 time: 1.176498 Oct 10 11:41:42.185194 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3561/7018] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:41:41 2022] DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments/af7a9f7e-0351-4c89-b234-ded46d03f3ed => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:41:42.194236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:42.196590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:42.204282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:42.205041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:42.205489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:42.206454 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:42.207126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:42.207580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:42.241019 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c127f8b-384f-4979-b7fe-695863d6dc50 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050959 Oct 10 11:41:42.241394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3458/7019] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:42 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:43.255041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:43.257396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:43.265280 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:43.265797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:43.266262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:43.266990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:43.267493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:43.268079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:43.298391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c26dce89-567d-4b2a-920d-4e061f4ef3a9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048713 Oct 10 11:41:43.298970 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3562/7020] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:43 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:44.311946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:44.314269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:44.321008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:44.321584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:44.322090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:44.322869 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:44.323418 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:44.323906 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:44.357817 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-879e1a8d-2b4a-4882-b865-dbcfc17c4c68 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050684 Oct 10 11:41:44.358518 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3459/7021] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:44 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:45.370200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:45.372733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:45.379753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:45.380261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:45.380887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:45.381433 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:45.381908 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:45.382354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:45.415383 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72a08509-a045-4ca3-b00e-10cfee4841c1 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049115 Oct 10 11:41:45.415968 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3563/7022] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:45 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:41:46.428462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:46.430702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:46.439298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:46.439539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:46.440086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:46.440887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:46.441247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:46.441678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:46.477675 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a45befbf-0ce1-4d6d-b018-2178b3808b4b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053077 Oct 10 11:41:46.478510 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3460/7023] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:46 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:47.490372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:47.492659 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:47.500696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:47.501202 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:47.501662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:47.502383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:47.502864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:47.503324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:47.533093 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-817ba87e-994e-4833-ac34-d31baa4582eb tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046653 Oct 10 11:41:47.533656 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3564/7024] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:41:47 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:41:47.544779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:47.545288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:47.551978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:47.552458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:47.552892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:47.553580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:47.554033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:47.554457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:47.726692 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] HTTP exception thrown: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 is not attached to volume af7a9f7e-0351-4c89-b234-ded46d03f3ed Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Request method failure captured: Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments/af7a9f7e-0351-4c89-b234-ded46d03f3ed HTTP/1.1 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAQS8P4liLqKiR--wtF1WcFnzLRmr8AjQdDdJsCFKs7iJzzVxQyAlH-Rc3caPoixj4vwZU85qiuIFl0pDJ1DD1w1Dig5TyMJ3Etev6fPp_WtbQM6xAH0jQOiayeMZNHRBeJjtayiBhVB0gbzEs6gQanScWpNodS5vU8G56KIZZrUrIs Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73b3b96c70004420a542ffbd48f77b49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73b3b96c70004420a542ffbd48f77b49"}]}] Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf929e7dd45d433592226eb45bc984c4 Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 is not attached to volume af7a9f7e-0351-4c89-b234-ded46d03f3ed Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': 'ab67da6c-2a6c-416c-b456-6d77a975adb8', 'id': 'af7a9f7e-0351-4c89-b234-ded46d03f3ed'} Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af7a9f7e-0351-4c89-b234-ded46d03f3ed. Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 is not attached to volume af7a9f7e-0351-4c89-b234-ded46d03f3ed Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:41:47.728342 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 is not attached to volume af7a9f7e-0351-4c89-b234-ded46d03f3ed Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Returning 404 to user: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 is not attached to volume af7a9f7e-0351-4c89-b234-ded46d03f3ed {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f092d0c-48e3-459a-b593-eab9f5f59681 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments/af7a9f7e-0351-4c89-b234-ded46d03f3ed" status: 404 len: 154 microversion: 2.1 time: 0.189543 Oct 10 11:41:47.733659 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3461/7025] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:41:47 2022] DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8/os-volume_attachments/af7a9f7e-0351-4c89-b234-ded46d03f3ed => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:41:50.987660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:50.988235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:50.995050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:50.995562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:50.996094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:50.996814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:50.997285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:50.997730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:51.025641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:41:51.107714 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f280fad6-ad90-4876-8100-b02cdd3f1049 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 204 len: 0 microversion: 2.1 time: 0.123460 Oct 10 11:41:51.108553 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3565/7026] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:41:50 2022] DELETE /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:41:51.117116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:51.117757 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:51.125882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:51.126371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:51.126817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:51.127540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:51.127996 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:51.128431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:51.265849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:41:51.273752 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34c37c75-df91-410b-8adb-df48e69a72df tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1553 microversion: 2.1 time: 0.160538 Oct 10 11:41:51.274326 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3462/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:41:51 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:41:52.298781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:52.299527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:52.306324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:52.306827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:52.307319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:52.308035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:52.309689 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:52.310139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:52.440833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:41:52.448662 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7462f240-5e8f-4353-a6a3-35f28bd6b6a0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1553 microversion: 2.1 time: 0.154181 Oct 10 11:41:52.449352 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3566/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:41:52 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:41:53.097660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab67da6c-2a6c-416c-b456-6d77a975adb8", "name": "network-vif-deleted", "tag": "6d440c8d-c843-41d2-96a6-45e698fc7a26"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:41:53.110352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:53.110915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:53.111446 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:53.124901 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] Creating event network-vif-deleted:6d440c8d-c843-41d2-96a6-45e698fc7a26 for instance ab67da6c-2a6c-416c-b456-6d77a975adb8 on n-h2-860687-2 Oct 10 11:41:53.129890 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1a9086ce-e6d3-419f-a680-e792e6edc90d req-280920d7-30f9-443f-b680-25f915070d14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Oct 10 11:41:53.131022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3463/7029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:41:53.472593 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:53.473231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:53.481065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:53.481505 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:53.481968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:53.482699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:53.483207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:53.483652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:53.518594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:53.519323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:53.519783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:53.520259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lazy-loading 'fault' on Instance uuid ab67da6c-2a6c-416c-b456-6d77a975adb8 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:41:53.562810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:41:53.570776 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-aab9b835-da67-4dc4-902c-b0bc5a8cbf61 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 200 len: 1347 microversion: 2.1 time: 0.102405 Oct 10 11:41:53.571737 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3567/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:41:53 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:41:54.597241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:54.597946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: ab67da6c-2a6c-416c-b456-6d77a975adb8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:41:54.604940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:54.605486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:54.605903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:54.606593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:41:54.607072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:41:54.607531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:41:54.620488 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] HTTP exception thrown: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Request method failure captured: Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 HTTP/1.1 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAQS8P4liLqKiR--wtF1WcFnzLRmr8AjQdDdJsCFKs7iJzzVxQyAlH-Rc3caPoixj4vwZU85qiuIFl0pDJ1DD1w1Dig5TyMJ3Etev6fPp_WtbQM6xAH0jQOiayeMZNHRBeJjtayiBhVB0gbzEs6gQanScWpNodS5vU8G56KIZZrUrIs Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73b3b96c70004420a542ffbd48f77b49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73b3b96c70004420a542ffbd48f77b49"}]}] Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf929e7dd45d433592226eb45bc984c4 Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': 'ab67da6c-2a6c-416c-b456-6d77a975adb8'} Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:41:54.622229 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Returning 404 to user: Instance ab67da6c-2a6c-416c-b456-6d77a975adb8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3390cbc4-4b20-4a60-8eba-d24412d08246 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8" status: 404 len: 111 microversion: 2.1 time: 0.030738 Oct 10 11:41:54.627145 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3464/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:41:54 2022] GET /compute/v2.1/servers/ab67da6c-2a6c-416c-b456-6d77a975adb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:41:54.632716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-78e8a988-3ca5-4576-a17a-324f3dd63176 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '.version_select at 0x7f6777af5d30>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:41:54.653984 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-78e8a988-3ca5-4576-a17a-324f3dd63176 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1741870951" status: 202 len: 0 microversion: 2.1 time: 0.025119 Oct 10 11:41:54.654677 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3568/7032] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 11:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1741870951 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:42:03.707720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4c74758-8190-428e-8d27-38a89d7386cd tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: .version_select at 0x7f6780d0f280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1338445340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcUyF/q2tW3xOIGnXHxqPT+T/TKp6bkmNKacSIbFDWfUpCndocmXZG4wOn04lJOdm6U4sb4x72q7hI7DAkb8t/8vRcBB+NhHBOP9RvZf22oQAzTy5hYHd8WT89v6tGjw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:03.724611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d4c74758-8190-428e-8d27-38a89d7386cd tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for project 73b3b96c70004420a542ffbd48f77b49. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:42:03.729904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d4c74758-8190-428e-8d27-38a89d7386cd tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for user bf929e7dd45d433592226eb45bc984c4 and project 73b3b96c70004420a542ffbd48f77b49. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:42:03.753493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4c74758-8190-428e-8d27-38a89d7386cd tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049791 Oct 10 11:42:03.754034 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3465/7033] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:42:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:03.803316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:03.808357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-35493631", "imageRef": "69c9ece8-f60f-44d4-a7f5-2b198997abb1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1338445340", "networks": [{"uuid": "7163eb0f-8f3f-44af-b93d-97c1d2212ea9"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:03.867372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] validate_networks() for [('7163eb0f-8f3f-44af-b93d-97c1d2212ea9', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:42:04.242379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:42:04.242829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:42:04.243364 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:42:04.243798 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:42:04.244236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:42:04.253301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:04.253810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:04.254272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:04.255058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:04.255541 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:04.255991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:04.274335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for project 73b3b96c70004420a542ffbd48f77b49. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:42:04.280483 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Getting quotas for user bf929e7dd45d433592226eb45bc984c4 and project 73b3b96c70004420a542ffbd48f77b49. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:42:04.292924 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:42:04.295227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69c9ece8-f60f-44d4-a7f5-2b198997abb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:42:04.342082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55be2c08-fb96-4e09-b266-c25b19352927 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540601 Oct 10 11:42:04.342734 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3569/7034] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:42:04.353746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42426cb1-9a09-4201-8ead-8ad139caef4d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:04.354367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42426cb1-9a09-4201-8ead-8ad139caef4d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:04.408661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42426cb1-9a09-4201-8ead-8ad139caef4d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:04.415604 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42426cb1-9a09-4201-8ead-8ad139caef4d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1257 microversion: 2.1 time: 0.065792 Oct 10 11:42:04.416164 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3466/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:04 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:05.439537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fdb1f7ff-7c7e-4c0f-ac06-452ebde32b0f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:05.440172 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fdb1f7ff-7c7e-4c0f-ac06-452ebde32b0f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:05.498487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fdb1f7ff-7c7e-4c0f-ac06-452ebde32b0f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:05.505613 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fdb1f7ff-7c7e-4c0f-ac06-452ebde32b0f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1257 microversion: 2.1 time: 0.071359 Oct 10 11:42:05.506193 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3570/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:05 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:06.529271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fa10422-adb0-4872-8fe6-3f269eb70e36 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:06.529824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fa10422-adb0-4872-8fe6-3f269eb70e36 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:06.531775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:06.587713 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fa10422-adb0-4872-8fe6-3f269eb70e36 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:06.595534 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fa10422-adb0-4872-8fe6-3f269eb70e36 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1257 microversion: 2.1 time: 0.071181 Oct 10 11:42:06.596213 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3467/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:06 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:07.618680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0188033e-1da9-4dac-be7f-7a640a461554 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:07.619375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0188033e-1da9-4dac-be7f-7a640a461554 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:07.673651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0188033e-1da9-4dac-be7f-7a640a461554 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:07.680494 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0188033e-1da9-4dac-be7f-7a640a461554 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1257 microversion: 2.1 time: 0.066626 Oct 10 11:42:07.681070 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3571/7038] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:07 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:08.703390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:08.703912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:08.710593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:08.711119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:08.711559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:08.712255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:08.712714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:08.713138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:08.773042 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:08.780642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-238dfc9a-a5e7-47bc-b5e4-ef956cbe805a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1261 microversion: 2.1 time: 0.081547 Oct 10 11:42:08.781217 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3468/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:08 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:09.806094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:09.806790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:09.821925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:09.838741 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:09.839640 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:09.840306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:09.841241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:09.841873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:09.842560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:09.936150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:09.944704 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a1889098-7b75-44bc-b253-1af3eeb71074 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1315 microversion: 2.1 time: 0.144128 Oct 10 11:42:09.945683 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3572/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:09 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:10.972522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:10.974111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:10.977903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:10.984326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:10.984907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:10.985729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:10.986604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:10.987109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:10.987540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:11.126706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:11.134549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec7d9b1d-723f-4c0e-9c75-5f67e36cb5b5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.166115 Oct 10 11:42:11.149788 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3469/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:10 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:12.158303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:12.159116 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:12.166322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:12.166840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:12.167363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:12.168177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:12.168866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:12.169396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:12.315173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:12.323493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9ab88521-e0de-44c4-a141-45dd49b8f37e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.169037 Oct 10 11:42:12.324281 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3573/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:12 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:13.345985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:13.346715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:13.353846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:13.354340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:13.355310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:13.356020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:13.356539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:13.356968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:13.503233 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:13.511714 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0deda214-7cf6-4a09-8916-6d27fcc84cbe tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.169534 Oct 10 11:42:13.512308 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3470/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:13 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:14.535781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:14.536485 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:14.539186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:14.545629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:14.546137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:14.546589 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:14.547340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:14.547814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:14.548258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:14.685157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:14.693449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8cd02529-47e7-42d7-a90f-60582bcb7999 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.161488 Oct 10 11:42:14.701475 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3574/7044] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:14 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:15.717799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:15.718353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:15.726535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:15.726732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:15.727058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:15.727776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:15.728231 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:15.728662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:15.875134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:15.883096 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f98c18c8-c75b-4a44-b741-c510f190db1e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.169342 Oct 10 11:42:15.883685 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3471/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:15 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:16.906887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:16.907549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:16.914353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:16.914848 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:16.915330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:16.916032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:16.916499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:16.917447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:17.045693 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:17.053391 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e47f62a8-cd01-458a-b41a-708797f47b42 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.150503 Oct 10 11:42:17.053957 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3575/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:16 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:17.958659 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:18.024339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:18.035676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:18.036166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:18.036604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:18.048832 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] Creating event network-changed:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:42:18.053794 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b0e3ae8a-78d7-4584-82d4-5294ba2580c0 req-01a46564-b3fd-42f9-afe9-48e6f3c44bb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100578 Oct 10 11:42:18.054407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3472/7047] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:18.076895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:18.077540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:18.079555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=10 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:18.086701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:18.087262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:18.087725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:18.088453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:18.089443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:18.089892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:18.224607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:18.233014 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-168202cb-2e21-4c94-800e-5c8dbb867ed7 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.159993 Oct 10 11:42:18.233594 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3576/7048] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:18 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:19.257436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:19.258156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:19.264664 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:19.265161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:19.265606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:19.266312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:19.266777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:19.267237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:19.403773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:19.411624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc8ea653-a6c9-4e85-a580-b09a97e13a56 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.159394 Oct 10 11:42:19.412422 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3473/7049] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:19 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:20.435903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:20.436535 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:20.443597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:20.444096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:20.444546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:20.445249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:20.445718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:20.446161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:20.572229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:20.580623 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0d6d8377-6a8d-4d3d-b62d-21bd0fe2fb92 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.149142 Oct 10 11:42:20.581202 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3577/7050] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:20 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:21.605014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:21.605940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:21.614740 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:21.615362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:21.615980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:21.616890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:21.617421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:21.617936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:21.752693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:21.760598 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc60df1e-371d-46aa-a166-16a678c1e6a6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.160868 Oct 10 11:42:21.762022 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3474/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:21 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:22.783918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:22.784451 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:22.791274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:22.791775 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:22.792904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:22.793635 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:22.794111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:22.794547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:22.925033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:22.932773 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26409cde-9f14-44a7-8b4d-fa606fc21627 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.152833 Oct 10 11:42:22.933362 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3578/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:22 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:23.235774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "name": "network-vif-plugged", "status": "completed", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:23.246806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:23.247304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:23.247734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:23.258807 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] Creating event network-vif-plugged:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:42:23.265142 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4a194dad-1d01-4561-b291-06b143fbbc14 req-8bac0e48-86fa-4b26-9ba5-d87b37a630b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090966 Oct 10 11:42:23.265739 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3475/7053] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:23.956198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:23.956829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:23.963601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:23.964631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:23.965079 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:23.965780 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:23.966247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:23.966682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:24.096748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:24.105134 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d542726e-0b48-40a3-b5b5-3803cb3727c5 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1357 microversion: 2.1 time: 0.152392 Oct 10 11:42:24.105738 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3579/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:23 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:25.128755 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:25.129464 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:25.136925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.137407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.137845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.138544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.139025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.139455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.270150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:25.278021 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7be2cc58-589a-489d-8f67-780fde7f9585 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1547 microversion: 2.1 time: 0.153529 Oct 10 11:42:25.278615 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3476/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:25 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:25.300967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:25.301602 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:25.309256 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.309753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.310210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.310912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.311408 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.311851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.438457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:25.446220 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-09698e4f-f661-4155-a539-af7f5bfbdea6 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1547 microversion: 2.1 time: 0.149135 Oct 10 11:42:25.446801 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3580/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:25 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:25.469000 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:25.473801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:25.474541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Searching by: {'deleted': False, 'project_id': '73b3b96c70004420a542ffbd48f77b49'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 11:42:25.480988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.481466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.481901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.482626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.483113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.483566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.507025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 11:42:25.534114 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-425c1393-661b-4b22-aef5-1c6f60d89f18 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.070019 Oct 10 11:42:25.534700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3477/7057] 10.222.0.16 () {58 vars in 1125 bytes} [Mon Oct 10 11:42:25 2022] GET /compute/v2.1/servers => generated 341 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:25.547383 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:25.548025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:25.553955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.554456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.554913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.555649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:25.556129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:25.556572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:25.686823 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:25.694624 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da6fc6fd-513e-4026-bdb2-4442c9beca04 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1547 microversion: 2.1 time: 0.151123 Oct 10 11:42:25.695225 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3581/7058] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:25 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:27.211274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcf56627-e9d5-4c48-9cb5-9309dd97486a"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:27.213638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:27.220889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:27.221377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:27.221816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:27.222527 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:27.222966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:27.223434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:27.460533 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0eb997d7-a2a9-44ac-8322-31ef71ec0675 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253146 Oct 10 11:42:27.461188 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3478/7059] 10.222.0.16 () {60 vars in 1323 bytes} [Mon Oct 10 11:42:27 2022] POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:38.237310 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:38.237952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:38.240392 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 11:42:38.240971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=19 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:38.241633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=62 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:38.248157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:38.248655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:38.249108 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:38.249813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:38.250288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:38.250729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:38.378236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:38.387226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2f5907d6-9107-4851-883c-ade0f62075ae tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1593 microversion: 2.1 time: 0.153970 Oct 10 11:42:38.387794 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3582/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:38 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:39.946437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:39.948421 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:39.949138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:39.954272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:39.966537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:39.967360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:39.967798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:39.980589 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] Creating event network-changed:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:42:39.985663 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f741e38e-d7d7-44b5-ad13-5c078304fea8 req-0183802c-722e-4c15-8918-fdf98ed5b941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041073 Oct 10 11:42:39.986340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3479/7061] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:41.209338 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1750622824"}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:41.209841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:41.218834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:41.219382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:41.219842 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:41.220564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:41.221042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:41.221497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:41.227313 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43782. Oct 10 11:42:41.349878 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.network.security_group_api [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Adding security group 7ee3a04b-9211-431a-ad33-1426732e65b2 to port 04901bb3-c7e7-429e-8dea-51bf954ea1e6 Oct 10 11:42:41.653556 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b68fae4c-ceaf-4ad6-9d57-b3a6fd98404d tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action" status: 202 len: 0 microversion: 2.1 time: 0.448487 Oct 10 11:42:41.654331 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3583/7062] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:42:41 2022] POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:42:41.664782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:41.665653 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:41.673300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:41.673918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:41.674493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:41.675328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:41.676665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:41.676665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:41.825793 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:41.834741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5885651-cc48-4bde-902d-61965455a3de tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1759 microversion: 2.1 time: 0.176075 Oct 10 11:42:41.835353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3480/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:41 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:42:42.002554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:42.013088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:42.013940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:42.014392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:42.027337 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] Creating event network-changed:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:42:42.032767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-147c818b-789b-420a-aa18-83f545546b0a req-70a4e5f3-8071-44be-88c7-2f795bfb9654 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033944 Oct 10 11:42:42.033800 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3584/7064] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:42:56.882245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:42:56.884546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:56.887641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:56.888443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:56.894089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:56.894576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:56.895041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:56.895741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:56.896201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:56.896636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:56.967709 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdd33464-45ab-4410-8be8-41203885a2ee tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action" status: 202 len: 0 microversion: 2.1 time: 0.089202 Oct 10 11:42:56.968339 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3481/7065] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:42:56 2022] POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:42:56.974744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:56.975536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:42:56.979844 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:56.981716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:56.989339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:56.989850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:56.990305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:56.991063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:56.991540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:56.991984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:57.136992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:57.145108 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f1180a8d-0497-4fbf-9bd0-d18372a8e5b0 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1751 microversion: 2.1 time: 0.172300 Oct 10 11:42:57.145689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3585/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:56 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:58.171557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:58.172271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:58.178440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:58.178926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:58.179389 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:58.180079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:58.180537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:58.180969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:58.332106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:58.341020 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00d5ee54-8941-483e-b9f9-785e363a5a1f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.175592 Oct 10 11:42:58.341595 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3482/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:58 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:42:59.365428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:42:59.365980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:42:59.372840 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:59.373349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:59.373811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:59.374540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:42:59.375036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:42:59.375490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:42:59.520039 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:42:59.528935 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f2c7e3ee-f7ab-4325-a9b7-0d1d8bf8d35a tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.167587 Oct 10 11:42:59.529506 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3586/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:42:59 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:00.551699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:00.552316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:00.559188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:00.559676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:00.560113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:00.560800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:00.561253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:00.561676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:00.745153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:00.754424 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1bc7ced-81af-4957-9ec4-21df22b3c431 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.206648 Oct 10 11:43:00.755023 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3483/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:00 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:01.781986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:01.782666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:01.789595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:01.790106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:01.790599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:01.791352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:01.791836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:01.792321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:01.934793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:01.943215 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-480352f3-4293-4950-8646-f3d25e16e955 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.165230 Oct 10 11:43:01.943796 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3587/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:01 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:02.967599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:02.968595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:02.975861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:02.976345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:02.977170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:02.977460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:02.977918 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:02.978342 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:03.118622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:03.126961 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-722af7ba-7b41-49e0-9708-9e0caf231954 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.163609 Oct 10 11:43:03.127556 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3484/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:02 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:04.149688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:04.150359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:04.157571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:04.158074 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:04.158528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:04.159286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:04.159759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:04.160203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:04.302258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:04.312054 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e5f2fad-3947-4663-8882-209d3212f9e2 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.166254 Oct 10 11:43:04.312633 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3588/7072] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:04 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:05.335322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:05.335946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:05.343305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:05.343799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:05.344240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:05.344937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:05.345400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:05.345829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:05.489590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:05.498582 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-615f1bf3-8965-4f4d-a140-cbd064b0e9bc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.167236 Oct 10 11:43:05.499179 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3485/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:05 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:06.521892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:06.522527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:06.530508 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:06.531035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:06.531491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:06.532205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:06.532678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:06.533119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:06.679076 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:06.687517 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c1ba97c0-360f-4211-95c2-0f7b01e3728c tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.169580 Oct 10 11:43:06.688089 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3589/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:06 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:07.710556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:07.711221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:07.718772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:07.719284 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:07.719715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:07.720405 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:07.720857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:07.721278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:07.863450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:07.872047 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5ac76c3-24d2-48b2-971e-cd7d06397ef9 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1756 microversion: 2.1 time: 0.165389 Oct 10 11:43:07.872619 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3486/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:07 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:08.895831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:08.896498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:08.904456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:08.904960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:08.905415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:08.906127 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:08.906605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:08.907077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:09.053288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:09.061611 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ac0f799f-baa8-464c-aae7-f3ffa5961e3b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1759 microversion: 2.1 time: 0.169744 Oct 10 11:43:09.062196 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3590/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:08 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:41.344792 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1750622824"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:43:41.345386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:41.347823 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:43:41.348475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:43:41.354805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:41.355322 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:41.355763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:41.356494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:41.357845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:41.358316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:41.798741 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Removing security group 7ee3a04b-9211-431a-ad33-1426732e65b2 from port 04901bb3-c7e7-429e-8dea-51bf954ea1e6 Oct 10 11:43:42.096281 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-552bd02e-c342-4dbd-afb8-c74aee741e44 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action" status: 202 len: 0 microversion: 2.1 time: 0.755907 Oct 10 11:43:42.106153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:43:42.107282 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3487/7077] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:43:41 2022] POST /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:43:42.116501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=12 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:43:42.117482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:43:42.120236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:42.120889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:42.122155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:42.136642 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] Creating event network-changed:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:43:42.144023 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-91a90b47-ae97-41f6-ad27-f349b6781f78 req-2c124a39-2786-4f0b-ba39-0ce36114431a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041274 Oct 10 11:43:42.144986 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3591/7078] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:43:43.271771 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:43.272302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:43.278330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:43.279326 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:43.279778 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:43.280561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:43.281025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:43.281457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:43.375308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lazy-loading 'services' on Instance uuid 3b82b5c6-71a7-436d-b830-bbe6af820b70 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:43:43.449507 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae5dcb76-5c49-4128-9542-36754c043f51 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments/bcf56627-e9d5-4c48-9cb5-9309dd97486a" status: 202 len: 0 microversion: 2.1 time: 0.182847 Oct 10 11:43:43.450524 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3488/7079] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:43:43 2022] DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments/bcf56627-e9d5-4c48-9cb5-9309dd97486a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:43:43.461329 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:43.463843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:43.473756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:43.474465 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:43.475064 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:43.475886 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:43.476370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:43.476816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:43.508545 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c0cf590d-ed6f-4344-b87c-3726fd5ccfbc tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052628 Oct 10 11:43:43.509117 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3592/7080] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:43 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:44.246398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:43:44.261073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:44.261559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:44.261999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:44.274733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] Creating event network-changed:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:43:44.280367 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-934c6945-657c-4aac-8acf-95fab6959539 req-7360f37c-e0f8-4168-a65f-f77a4669ecf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121923 Oct 10 11:43:44.281286 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3489/7081] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:44.522021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:44.525361 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:44.532881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:44.533587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:44.534119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:44.535262 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:44.535806 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:44.536314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:44.571589 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a230bd33-9269-482d-bc14-713773613b58 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053520 Oct 10 11:43:44.572312 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3593/7082] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:44 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:45.586802 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:45.589169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:45.596305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:45.596797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:45.597236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:45.597934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:45.598391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:45.598826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:45.631724 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76104afe-428a-4ef2-a933-2928d0c21c59 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050104 Oct 10 11:43:45.632218 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3490/7083] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:45 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:46.644745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:46.646962 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:46.655864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:46.656376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:46.656837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:46.657557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:46.658063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:46.658514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:46.688320 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b53a015-61e6-4136-9f10-56647ffe732f tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Oct 10 11:43:46.688904 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3594/7084] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:46 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:47.700458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:47.702660 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:47.705607 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:43:47.705764 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments (ip 10.222.0.16) !!! Oct 10 11:43:47.713502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:47.713993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:47.714437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:47.715170 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:47.715635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:47.716068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:47.747601 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0146f699-5e86-4f84-ae93-21b91dd7ed03 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051137 Oct 10 11:43:47.748340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3491/7085] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:47 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:48.759766 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:48.761929 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:48.768904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:48.769407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:48.769862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:48.770576 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:48.771066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:48.771536 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:48.800923 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6b2039fc-a593-452d-9ead-f7a97dd05556 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045460 Oct 10 11:43:48.801488 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3595/7086] 10.222.0.16 () {58 vars in 1302 bytes} [Mon Oct 10 11:43:48 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 11:43:48.813317 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:48.813899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:48.820642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:48.821123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:48.821562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:48.822251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:48.822702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:48.823159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:48.897245 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] HTTP exception thrown: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 is not attached to volume bcf56627-e9d5-4c48-9cb5-9309dd97486a Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Request method failure captured: Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments/bcf56627-e9d5-4c48-9cb5-9309dd97486a HTTP/1.1 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAQS8P4liLqKiR--wtF1WcFnzLRmr8AjQdDdJsCFKs7iJzzVxQyAlH-Rc3caPoixj4vwZU85qiuIFl0pDJ1DD1w1Dig5TyMJ3Etev6fPp_WtbQM6xAH0jQOiayeMZNHRBeJjtayiBhVB0gbzEs6gQanScWpNodS5vU8G56KIZZrUrIs Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73b3b96c70004420a542ffbd48f77b49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73b3b96c70004420a542ffbd48f77b49"}]}] Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf929e7dd45d433592226eb45bc984c4 Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 is not attached to volume bcf56627-e9d5-4c48-9cb5-9309dd97486a Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'server_id': '3b82b5c6-71a7-436d-b830-bbe6af820b70', 'id': 'bcf56627-e9d5-4c48-9cb5-9309dd97486a'} Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bcf56627-e9d5-4c48-9cb5-9309dd97486a. Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 is not attached to volume bcf56627-e9d5-4c48-9cb5-9309dd97486a Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:43:48.898891 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 is not attached to volume bcf56627-e9d5-4c48-9cb5-9309dd97486a Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Returning 404 to user: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 is not attached to volume bcf56627-e9d5-4c48-9cb5-9309dd97486a {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47b3415b-8757-4421-bc33-74fdfdb7c09b tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments/bcf56627-e9d5-4c48-9cb5-9309dd97486a" status: 404 len: 154 microversion: 2.1 time: 0.091853 Oct 10 11:43:48.903466 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3492/7087] 10.222.0.16 () {58 vars in 1416 bytes} [Mon Oct 10 11:43:48 2022] DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70/os-volume_attachments/bcf56627-e9d5-4c48-9cb5-9309dd97486a => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:43:52.154193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:52.154744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:52.161692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:52.162200 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:52.162664 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:52.163407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:52.163893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:52.164344 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:52.190489 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:43:52.268991 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59da5702-c4e5-4529-a735-89b961910d0e tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 204 len: 0 microversion: 2.1 time: 0.118553 Oct 10 11:43:52.274064 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3596/7088] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:43:52 2022] DELETE /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:43:52.279618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:52.280314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:52.288432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:52.288919 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:52.289355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:52.290090 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:52.290543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:52.290964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:52.426529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:52.434683 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f35e6927-ada4-496e-8481-a1ed81146c45 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1553 microversion: 2.1 time: 0.159824 Oct 10 11:43:52.435343 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3493/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:52 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:43:53.458668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:53.459435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:53.467865 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:53.468366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:53.468817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:53.469517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:53.469986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:53.470428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:53.603290 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:53.611716 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c4b787cd-f4d5-4808-88d3-195267e31f76 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1553 microversion: 2.1 time: 0.157603 Oct 10 11:43:53.612292 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3597/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:53 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:54.365257 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b82b5c6-71a7-436d-b830-bbe6af820b70", "name": "network-vif-deleted", "tag": "04901bb3-c7e7-429e-8dea-51bf954ea1e6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:43:54.379199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:54.380015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:54.380604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:54.396184 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] Creating event network-vif-deleted:04901bb3-c7e7-429e-8dea-51bf954ea1e6 for instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 on n-h1-860687-2 Oct 10 11:43:54.401600 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fab4ee49-6e02-4d3a-96df-8af4e55755fd req-984da8b5-4839-4250-9d7b-020c90e4d5a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040123 Oct 10 11:43:54.402471 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3494/7091] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:43:54.634686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:54.635352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:54.643219 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:54.643737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:54.644193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:54.644933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:54.645404 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:54.645852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:54.680002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:54.680520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:54.680969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:54.681443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lazy-loading 'fault' on Instance uuid 3b82b5c6-71a7-436d-b830-bbe6af820b70 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:43:54.725091 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf929e7dd45d433592226eb45bc984c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b3b96c70004420a542ffbd48f77b49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:43:54.733966 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fb205319-27df-4248-85cb-bb4669806794 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 200 len: 1347 microversion: 2.1 time: 0.103046 Oct 10 11:43:54.735868 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3598/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:54 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:43:55.759330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:55.759986 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] [instance: 3b82b5c6-71a7-436d-b830-bbe6af820b70] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:43:55.767821 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:55.768308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:55.768748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:55.769439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:43:55.769898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:43:55.770329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:43:55.783494 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] HTTP exception thrown: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Request method failure captured: Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 HTTP/1.1 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAQS8P4liLqKiR--wtF1WcFnzLRmr8AjQdDdJsCFKs7iJzzVxQyAlH-Rc3caPoixj4vwZU85qiuIFl0pDJ1DD1w1Dig5TyMJ3Etev6fPp_WtbQM6xAH0jQOiayeMZNHRBeJjtayiBhVB0gbzEs6gQanScWpNodS5vU8G56KIZZrUrIs Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73b3b96c70004420a542ffbd48f77b49", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73b3b96c70004420a542ffbd48f77b49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73b3b96c70004420a542ffbd48f77b49"}]}] Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 73b3b96c70004420a542ffbd48f77b49 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1120931238 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: bf929e7dd45d433592226eb45bc984c4 Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1120931238-project Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '3b82b5c6-71a7-436d-b830-bbe6af820b70'} Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:43:55.785141 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Returning 404 to user: Instance 3b82b5c6-71a7-436d-b830-bbe6af820b70 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a63f1b3-a1fc-40cc-a6b6-edb698af0443 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70" status: 404 len: 111 microversion: 2.1 time: 0.031558 Oct 10 11:43:55.789610 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3495/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:43:55 2022] GET /compute/v2.1/servers/3b82b5c6-71a7-436d-b830-bbe6af820b70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:43:55.795707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7eaf1a24-1a55-4f03-ab04-a5d9e48d2917 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] Calling method '.version_select at 0x7f6780c9f5e0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:43:55.815999 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7eaf1a24-1a55-4f03-ab04-a5d9e48d2917 tempest-TestMinimumBasicScenario-1120931238 tempest-TestMinimumBasicScenario-1120931238-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1338445340" status: 202 len: 0 microversion: 2.1 time: 0.024352 Oct 10 11:43:55.816567 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3599/7094] 10.222.0.16 () {58 vars in 1272 bytes} [Mon Oct 10 11:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1338445340 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:44:04.684096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e09d4a72-3de2-4705-a221-247d39870b53 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: .version_select at 0x7f6780cc5280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1002067391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwBY0UvBQiGmjdvG4e9SpBY6qgXwbZDTDVlZ2wabDDbd+u2UHWuJvJaubZQrJCi3ykd1k52WTcyW635l/NBwzOuICJimIrKVjNYENdsgRQlE8jvsDZx/U8nKfxCsiU/mA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:04.703836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e09d4a72-3de2-4705-a221-247d39870b53 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:44:04.709103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e09d4a72-3de2-4705-a221-247d39870b53 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:44:04.733014 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e09d4a72-3de2-4705-a221-247d39870b53 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.210542 Oct 10 11:44:04.733627 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3496/7095] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:44:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:44:10.765163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-318390076", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "b1d098a5-04f5-4c18-acb2-5f273fa2b54e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1002067391", "security_groups": [{"name": "tempest-secgroup-smoke-357480928"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:10.780053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:10.781181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:10.902157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] validate_networks() for [('b1d098a5-04f5-4c18-acb2-5f273fa2b54e', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:44:11.364874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:44:11.365317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:44:11.365813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:44:11.366250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:44:11.366687 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:44:11.382696 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:11.383471 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:11.383936 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:11.384699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:11.385203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:11.385653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:11.402836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:44:11.408308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:44:11.421469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:44:11.423869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:44:11.473124 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-708c0bdb-2e37-4341-b14b-95f6263cadcc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712976 Oct 10 11:44:11.474188 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3600/7096] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:44:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:44:11.484625 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:11.489545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0da88c6-65e3-4471-9271-555a89074e6f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:11.492416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0da88c6-65e3-4471-9271-555a89074e6f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:11.495633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:11.562128 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0da88c6-65e3-4471-9271-555a89074e6f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:11.570425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0da88c6-65e3-4471-9271-555a89074e6f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1266 microversion: 2.1 time: 0.088764 Oct 10 11:44:11.575211 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3497/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:11 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:12.594184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:12.594940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:12.603978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:12.604503 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:12.604958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:12.605745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:12.606770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:12.607255 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:12.701675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:12.711297 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fad3cdf6-8949-4723-b4d1-ec8b7d06d281 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1318 microversion: 2.1 time: 0.121210 Oct 10 11:44:12.712462 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3601/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:12 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:13.738069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:13.739477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:13.747337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:13.747928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:13.748382 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:13.749099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:13.749567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:13.749999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:13.889851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:13.899733 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a14e63c9-503b-45fd-a060-35ea2e6969cd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.165731 Oct 10 11:44:13.900329 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3498/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:13 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:14.193984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62b693f-57f5-4d28-9022-8ac7e29bc268", "tag": "dd666b94-dbd2-401a-81e7-985225413e0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:14.206145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:14.206735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:14.207308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:14.219406 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] Creating event network-changed:dd666b94-dbd2-401a-81e7-985225413e0d for instance c62b693f-57f5-4d28-9022-8ac7e29bc268 on n-h2-860687-2 Oct 10 11:44:14.224408 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-86ac4aac-5be9-463b-b09b-8d176c6769ea req-ea1a8bd9-de33-4015-9373-30023c36abe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034980 Oct 10 11:44:14.225250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3602/7100] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:44:14.924887 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:14.925515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:14.932229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:14.932727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:14.933179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:14.933880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:14.935155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:14.935682 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:15.068889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:15.077239 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ac944cd-e6b6-47e3-b935-9fa5ac66ca47 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.156556 Oct 10 11:44:15.077823 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3499/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:14 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:44:16.100969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:16.101723 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:16.108605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:16.109113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:16.109577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:16.110296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:16.110781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:16.111257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:16.244950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:16.252762 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7be5e7f8-2c39-4ac5-9511-8879e767303d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.156924 Oct 10 11:44:16.253334 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3603/7102] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:16 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:17.276786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:17.277311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:17.284628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:17.285118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:17.285561 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:17.286260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:17.286720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:17.287186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:17.422217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:17.429941 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-792d2d2d-b25c-4759-bbc9-4fffa3b75e29 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.157278 Oct 10 11:44:17.430510 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3500/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:17 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:18.453753 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:18.454382 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:18.461492 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:18.461990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:18.462440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:18.463275 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:18.463743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:18.464187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:18.607579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:18.615259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b45ca4c5-c71e-4625-9c87-448322b32926 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.166136 Oct 10 11:44:18.615870 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3604/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:18 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:19.639379 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:19.640029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:19.646851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:19.647386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:19.647822 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:19.648514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:19.648970 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:19.649395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:19.727497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62b693f-57f5-4d28-9022-8ac7e29bc268", "name": "network-vif-plugged", "status": "completed", "tag": "dd666b94-dbd2-401a-81e7-985225413e0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:19.742882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:19.743407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:19.743850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:19.756190 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] Creating event network-vif-plugged:dd666b94-dbd2-401a-81e7-985225413e0d for instance c62b693f-57f5-4d28-9022-8ac7e29bc268 on n-h2-860687-2 Oct 10 11:44:19.763606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6069b35a-03eb-4cf3-aed0-a6fc5cfa777a req-c5b1b830-7681-45a7-8e8c-5bc64a2d6be7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039572 Oct 10 11:44:19.764420 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3605/7105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:44:19.806240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:19.814951 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49218fc4-ab57-4842-9dbe-b46c588355d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.179633 Oct 10 11:44:19.815601 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3501/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:19 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:20.839333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:20.841048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:20.849158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:20.849756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:20.850486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:20.851247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:20.851953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:20.852730 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:21.006903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:21.015764 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-19bf93aa-2d73-4110-89ca-3175d7dafc79 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1391 microversion: 2.1 time: 0.181463 Oct 10 11:44:21.016445 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3606/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:20 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:22.039748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:22.040370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:22.043125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:22.048691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:22.049274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:22.049718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:22.050449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:22.051115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:22.051634 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:22.189946 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:22.197716 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c264b72-24e9-4180-b095-314c7a7fe74b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1563 microversion: 2.1 time: 0.161928 Oct 10 11:44:22.198299 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3502/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:22 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:22.222575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:22.223249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:22.225230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:22.226043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:22.232845 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:22.233357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:22.233821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:22.234542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:22.235046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:22.235501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:22.368621 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:22.377304 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-54c8d5cd-9864-4258-aa15-a00981b67290 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1563 microversion: 2.1 time: 0.158566 Oct 10 11:44:22.377903 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3607/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:22 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:23.954876 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:23.955528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:23.963881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62b693f-57f5-4d28-9022-8ac7e29bc268", "tag": "dd666b94-dbd2-401a-81e7-985225413e0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:23.972781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:23.973539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:23.974204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:23.974916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:23.975408 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:23.975784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:23.975914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:23.976285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:23.976735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:23.989448 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] Creating event network-changed:dd666b94-dbd2-401a-81e7-985225413e0d for instance c62b693f-57f5-4d28-9022-8ac7e29bc268 on n-h2-860687-2 Oct 10 11:44:23.994943 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-51cd7c3d-095e-4f30-a289-e3b0eef3605a req-27e94334-f949-446c-a94b-ba956a9ca563 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034636 Oct 10 11:44:23.995611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3608/7110] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:44:24.124328 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:24.132634 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b402844-85bf-4def-bcfb-9879333c89ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1563 microversion: 2.1 time: 0.182045 Oct 10 11:44:24.133244 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3503/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:23 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:45.378829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:45.380208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=38 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:45.385129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:45.387522 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:45.395606 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:45.396109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:45.396562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:45.397286 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:45.397738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:45.398176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:45.450548 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-58966f1a-c79e-48bb-9d34-5e92843ca2eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action" status: 200 len: 24570 microversion: 2.1 time: 0.073619 Oct 10 11:44:45.451205 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3609/7112] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:44:45 2022] POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:44:56.493540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:56.494107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:56.496787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=15 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:56.497460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:56.502853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:56.503397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:56.503832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:56.504541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:56.505004 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:56.505442 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:56.573023 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb25c33a-49fc-4b57-894b-304868412ff1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action" status: 202 len: 0 microversion: 2.1 time: 0.083453 Oct 10 11:44:56.574200 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3504/7113] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:44:56 2022] POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:44:56.583794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:56.584516 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:56.587499 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:56.588166 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:44:56.594104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:56.594699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:56.595191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:56.595913 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:56.596427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:56.596871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:56.733050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:56.741105 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93baf457-ab8a-4bbc-97c8-8b22381e84c5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1686 microversion: 2.1 time: 0.161863 Oct 10 11:44:56.741701 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3610/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:56 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:57.767058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:57.767763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:57.773865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:57.774356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:57.774787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:57.775497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:57.775952 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:57.777033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:57.908975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:57.916718 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87cb3977-cca2-45e4-a690-7086bc48ce00 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1666 microversion: 2.1 time: 0.155853 Oct 10 11:44:57.917803 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3505/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:57 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:44:59.014447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:59.016666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:59.023105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.023609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.024062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.024829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.025305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.025751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.076111 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f3ed372-9148-4211-92a3-949c88500c4b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action" status: 200 len: 32645 microversion: 2.1 time: 0.065789 Oct 10 11:44:59.076773 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3611/7116] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:44:59 2022] POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:44:59.088718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:44:59.089925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:59.096672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.097155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.097594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.098283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.098738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.099204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.165033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e8ee335-2562-48e9-b38d-c44e8ade0ca3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action" status: 202 len: 0 microversion: 2.1 time: 0.079987 Oct 10 11:44:59.165719 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3506/7117] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:44:59 2022] POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:44:59.175268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:44:59.175993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:44:59.183068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.183738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.184216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.184934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:44:59.185409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:44:59.185852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:44:59.322940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:44:59.332161 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8569b006-ec6e-461c-9c0a-8d8c34671aeb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1673 microversion: 2.1 time: 0.161241 Oct 10 11:44:59.332751 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3612/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:44:59 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:00.357849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:00.358605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:00.364964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:00.365457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:00.365904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:00.366630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:00.367110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:00.367566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:00.502391 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:00.511162 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d439a2b2-dba8-48e4-8909-80a16534d60f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1681 microversion: 2.1 time: 0.158424 Oct 10 11:45:00.512393 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3507/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:00 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:00.607229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:00.609550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:00.617185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:00.617688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:00.618147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:00.618864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:00.619370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:00.619817 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:00.669226 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-73c4dba3-7e21-4b8a-a6c6-e9619f5aee65 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action" status: 200 len: 38412 microversion: 2.1 time: 0.066622 Oct 10 11:45:00.669875 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3613/7120] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:45:00 2022] POST /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268/action => generated 38412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:45:01.649524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:01.650597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:01.651959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62b693f-57f5-4d28-9022-8ac7e29bc268", "tag": "dd666b94-dbd2-401a-81e7-985225413e0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:01.659217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:01.660003 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:01.660663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:01.661933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:01.662772 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:01.663543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:01.663946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:01.664595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:01.665048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:01.676871 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] Creating event network-changed:dd666b94-dbd2-401a-81e7-985225413e0d for instance c62b693f-57f5-4d28-9022-8ac7e29bc268 on n-h2-860687-2 Oct 10 11:45:01.681881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-bc493b31-c3b1-40f3-8f41-52fed76f3dfe req-f016671e-93d7-4c1e-90eb-d7b733c080af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033862 Oct 10 11:45:01.682726 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3614/7121] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:45:01.694329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:45:01.793703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a66ba0a-ab15-4c5f-a938-a3bb0f748504 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 204 len: 0 microversion: 2.1 time: 0.147707 Oct 10 11:45:01.796583 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3508/7122] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:45:01 2022] DELETE /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:01.806574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:01.807509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:01.814903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:01.815457 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:01.815922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:01.816651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:01.817299 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:01.818036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:01.966476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:01.974440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d1a4168-e57c-4bf7-8a5f-bc6b287586dd tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1687 microversion: 2.1 time: 0.173184 Oct 10 11:45:01.975039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3615/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:01 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:03.000022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:03.000901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:03.008071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:03.008616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:03.009064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:03.009770 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:03.010435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:03.010646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:03.156590 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:03.165012 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-215d02c3-493a-4912-997b-e0fc2782e6c0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1687 microversion: 2.1 time: 0.169974 Oct 10 11:45:03.165607 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3509/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:02 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:03.774187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62b693f-57f5-4d28-9022-8ac7e29bc268", "name": "network-vif-deleted", "tag": "dd666b94-dbd2-401a-81e7-985225413e0d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:03.787604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:03.788031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:03.788480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:03.800562 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] Creating event network-vif-deleted:dd666b94-dbd2-401a-81e7-985225413e0d for instance c62b693f-57f5-4d28-9022-8ac7e29bc268 on n-h2-860687-2 Oct 10 11:45:03.805164 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d4cf78ab-1451-4948-9dc8-7ae584f4c11d req-a7bc0fd8-1eb6-43bc-8d81-0d5787eb25bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035466 Oct 10 11:45:03.805750 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3616/7125] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:45:04.190729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:04.191799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:04.198870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:04.199521 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:04.200708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:04.201496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:04.202333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:04.202767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:04.235642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:04.236126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:04.236571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:04.237032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lazy-loading 'fault' on Instance uuid c62b693f-57f5-4d28-9022-8ac7e29bc268 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:45:04.280371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:04.287391 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-029cc5d4-a1da-410a-b3c8-13f4c9d1571e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 200 len: 1356 microversion: 2.1 time: 0.100636 Oct 10 11:45:04.287966 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3510/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:04 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:05.312534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:05.313186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: c62b693f-57f5-4d28-9022-8ac7e29bc268] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:05.319537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:05.320046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:05.320538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:05.321250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:05.321729 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:05.322183 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:05.336870 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] HTTP exception thrown: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Request method failure captured: Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 HTTP/1.1 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAWD91prSd6fyNeCxdnt8lLgn6gFXLUBlDvZPmZrMY6G2A0VxgnIB9nc8PO0OIwbUApZC4hcr81_D8TozNGpA4TRircP2DQlbvETim0gTpPFXTcJ49800Hwq1xVHHDmF1BJcIO5UX59rDFowIbXDyiiARepiQrXty2YNxLVdj4DnSWs Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e37c02f22a0b4f119264b30218bd7e68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e37c02f22a0b4f119264b30218bd7e68"}]}] Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 5ed82ea1d3cc4f28a041a6c2fb646820 Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': 'c62b693f-57f5-4d28-9022-8ac7e29bc268'} Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:45:05.338548 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Returning 404 to user: Instance c62b693f-57f5-4d28-9022-8ac7e29bc268 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6a5b881b-83c4-450e-abe9-c76aaa1d3491 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268" status: 404 len: 111 microversion: 2.1 time: 0.032767 Oct 10 11:45:05.344145 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3617/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:05 2022] GET /compute/v2.1/servers/c62b693f-57f5-4d28-9022-8ac7e29bc268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:45:08.706976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3cb63294-36d3-45e7-8939-82f344cc05cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '.version_select at 0x7f677c3ae430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:08.726706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3cb63294-36d3-45e7-8939-82f344cc05cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1002067391" status: 202 len: 0 microversion: 2.1 time: 0.023921 Oct 10 11:45:08.727327 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3511/7128] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Oct 10 11:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1002067391 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:45:08.748641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-577dbb3d-41de-463a-ad48-59450fe416ef tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: .version_select at 0x7f67778b54c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-943145459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIic6zMa5HE7OP5+QImbmv1wl2cRfsBtt+U00J7Wj64UcTaPP2ya4NKgYR9aDGCXW9FKgYGcKsOwivp8rVaAizl/neWY82+0loan2A6ylIks3VJ/ddRe0YvQW6s+o80chg=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:08.765686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-577dbb3d-41de-463a-ad48-59450fe416ef tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:45:08.771750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-577dbb3d-41de-463a-ad48-59450fe416ef tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:45:08.794910 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-577dbb3d-41de-463a-ad48-59450fe416ef tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050808 Oct 10 11:45:08.795541 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3618/7129] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:45:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:45:14.491579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1442851364", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "4fcb2dee-7056-41f7-aee8-354eecaf1294"}], "key_name": "tempest-TestNetworkAdvancedServerOps-943145459", "security_groups": [{"name": "tempest-secgroup-smoke-1055935844"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:14.521602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:14.618363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] validate_networks() for [('4fcb2dee-7056-41f7-aee8-354eecaf1294', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:45:15.091111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:45:15.091652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:45:15.092364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:45:15.093256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:45:15.093765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:45:15.110256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:15.110990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:15.111484 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:15.112430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:15.112941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:15.113440 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:15.132374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:45:15.138104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:45:15.151143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:45:15.154311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:45:15.213625 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1db93541-715e-40ef-9a0c-f92352784817 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726939 Oct 10 11:45:15.214549 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3512/7130] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:45:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:45:15.227409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4588171d-4f4c-4cc0-96be-9a8340ba11ba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:15.228630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4588171d-4f4c-4cc0-96be-9a8340ba11ba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:15.286309 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4588171d-4f4c-4cc0-96be-9a8340ba11ba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:15.293662 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4588171d-4f4c-4cc0-96be-9a8340ba11ba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1266 microversion: 2.1 time: 0.070284 Oct 10 11:45:15.294247 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3619/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:15 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:16.321934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:16.323429 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:16.334630 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:16.335618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:16.336225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:16.337126 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:16.337742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:16.338329 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:16.430104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:16.439109 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a826a20f-09b6-48ed-a2f9-df9e8acd293c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1336 microversion: 2.1 time: 0.122921 Oct 10 11:45:16.439711 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3513/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:16 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:17.464803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:17.466831 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:17.469222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=32 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:17.477397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:17.478268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:17.478826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:17.479749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:17.482778 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:17.483755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:17.748820 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:17.757723 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb33b982-8a2f-43f2-bd27-c87fce481d0d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1392 microversion: 2.1 time: 0.297921 Oct 10 11:45:17.758313 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3620/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:17 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:17.911779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bef2792-69fb-4e92-bd4e-20ed0dda4fc3", "tag": "b8dbf023-70b9-441d-8bc7-39d7d53d1aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:17.924544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:17.925330 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:17.925940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:17.938063 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] Creating event network-changed:b8dbf023-70b9-441d-8bc7-39d7d53d1aa5 for instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 on n-h2-860687-2 Oct 10 11:45:17.942912 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-72cd042e-486e-4f74-8e2e-5e60f6c45efa req-72ad1201-9fe0-4d6c-aef1-0923be2b65bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Oct 10 11:45:17.943555 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3514/7134] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:45:18.781910 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:18.782537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:18.789526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:18.790023 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:18.790474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:18.791216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:18.791688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:18.792129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:18.921145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:18.928865 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f11dcda-58b0-45c7-ab59-716cb28fe65a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1392 microversion: 2.1 time: 0.150838 Oct 10 11:45:18.929438 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3621/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:18 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:19.953670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:19.954663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:19.960958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:19.961457 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:19.961900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:19.962599 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:19.963099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:19.963535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:20.098641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:20.106616 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8808eb24-456c-414a-8615-1f2c8eea2d1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1392 microversion: 2.1 time: 0.158560 Oct 10 11:45:20.107157 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3515/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:19 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:21.129459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:21.130090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:21.137560 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:21.138094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:21.138546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:21.139303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:21.139754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:21.140191 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:21.278140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:21.285851 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-95eeec27-e831-4729-a056-7cb847dfcaad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1392 microversion: 2.1 time: 0.160345 Oct 10 11:45:21.286443 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3622/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:21 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:21.992830 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bef2792-69fb-4e92-bd4e-20ed0dda4fc3", "name": "network-vif-plugged", "status": "completed", "tag": "b8dbf023-70b9-441d-8bc7-39d7d53d1aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:22.007943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:22.008803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:22.009338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:22.022990 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] Creating event network-vif-plugged:b8dbf023-70b9-441d-8bc7-39d7d53d1aa5 for instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 on n-h2-860687-2 Oct 10 11:45:22.029302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ee557b6d-e455-44a5-a3d2-3ac9927f080c req-51e5c958-92f1-4f13-a41a-16af55e4f2f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040891 Oct 10 11:45:22.030319 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3516/7138] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:45:22.309301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:22.309847 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:22.316833 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:22.317331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:22.317789 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:22.318495 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:22.318974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:22.319444 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:22.772968 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:22.780738 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6d97129f-ea83-444b-9106-fb99de22a1e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1392 microversion: 2.1 time: 0.476026 Oct 10 11:45:22.781343 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3623/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:22 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1392 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:23.804603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:23.805225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:23.812940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:23.813369 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:23.813814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:23.814506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:23.814958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:23.815469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:23.949719 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:23.957829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8246e8f-2148-4a1a-adf2-aa4edeb9c2ad tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1565 microversion: 2.1 time: 0.157574 Oct 10 11:45:23.958407 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3517/7140] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:23 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:23.979960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:23.980578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:23.987620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:23.988119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:23.988565 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:23.989267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:23.989737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:23.990175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:24.121717 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:24.130115 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c28d5a13-d710-470f-8c15-5870fc75511b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1565 microversion: 2.1 time: 0.154011 Oct 10 11:45:24.130684 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3624/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:23 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:25.705557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:25.710654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bef2792-69fb-4e92-bd4e-20ed0dda4fc3", "tag": "b8dbf023-70b9-441d-8bc7-39d7d53d1aa5"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:25.716987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:25.719453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:25.722354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:25.723129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:25.729131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:25.729633 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:25.730085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:25.739236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:25.739746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:25.740194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:25.740907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:25.741373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:25.741806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:25.742948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] Creating event network-changed:b8dbf023-70b9-441d-8bc7-39d7d53d1aa5 for instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 on n-h2-860687-2 Oct 10 11:45:25.748363 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-4a8e6b6a-ff72-404a-8d8e-c7c2ac38e086 req-54c0b854-2592-41b1-af79-30a6659f2a36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041231 Oct 10 11:45:25.749307 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3625/7142] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:45:25.970305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:25.978312 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9861b4d-733d-4a43-897a-fb68a5c50b2c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1565 microversion: 2.1 time: 0.277135 Oct 10 11:45:25.979050 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3518/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:25 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1565 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:47.229707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.230557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=32 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.234931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:47.237244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:47.245353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:47.245862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:47.246325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:47.247111 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:47.247596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:47.248046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:47.298312 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2357ad00-47b9-4841-97af-28f993c57538 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action" status: 200 len: 24573 microversion: 2.1 time: 0.071048 Oct 10 11:45:47.298952 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3626/7144] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:45:47 2022] POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:45:58.236436 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:45:58.238723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:58.241430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.242184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.248187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:58.248681 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:58.249115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:58.249808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:58.250266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:58.250690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:58.323471 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-205fba3d-f4d9-4d93-a45f-d95ca6956952 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.091436 Oct 10 11:45:58.324118 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3519/7145] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:45:58 2022] POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:45:58.334566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:58.335396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:58.338428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.339122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.346351 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:58.346857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:58.347341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:58.348063 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:58.348534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:58.348974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:58.662507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:58.670566 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-96ba50ae-6af1-49fe-a8ce-e3bb45b117a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1676 microversion: 2.1 time: 0.340267 Oct 10 11:45:58.671250 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3627/7146] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:58 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1676 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:59.696394 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:45:59.697022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:45:59.704469 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:59.704992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:59.705463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:59.706152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:45:59.706607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:45:59.707059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:45:59.842196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:45:59.849819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-513ab758-d76d-4423-9b94-a7ac013d1071 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.158812 Oct 10 11:45:59.850385 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3520/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:45:59 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:00.874883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:00.875555 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:00.883233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:00.883735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:00.884189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:00.884903 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:00.885370 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:00.885809 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:01.015388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:01.023186 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a7daed71-ca42-47e7-91ec-1e2b7cc882ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.152378 Oct 10 11:46:01.023760 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3628/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:00 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:02.046193 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:02.046819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:02.053819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:02.054311 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:02.054773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:02.055500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:02.055960 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:02.056387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:02.186528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:02.194308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f62d038-c81e-4409-bbeb-53c9a6b2948d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.152251 Oct 10 11:46:02.194879 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3521/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:02 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:03.219335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:03.219973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:03.226870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:03.227520 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:03.227973 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:03.228685 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:03.229160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:03.229603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:03.363898 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:03.371817 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-28492faa-b1dd-4b10-bae4-a7ff64ac301b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.157353 Oct 10 11:46:03.372887 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3629/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:03 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:04.396117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:04.396733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:04.403727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:04.404194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:04.404628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:04.405321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:04.405777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:04.406204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:04.539480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:04.548352 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41cbc78c-6885-4b87-96d8-9200a7e68e0f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.156086 Oct 10 11:46:04.548929 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3522/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:04 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:05.572358 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:05.572990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:05.580872 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:05.581372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:05.581880 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:05.582718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:05.583253 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:05.583699 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:05.720467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:05.728334 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6502fe73-e39d-4811-8174-4d75cecc9e3d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.159936 Oct 10 11:46:05.728931 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3630/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:05 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:06.752262 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:06.752816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:06.759601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:06.760093 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:06.760535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:06.761226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:06.761687 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:06.762117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:06.893610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:06.901284 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecb0e37d-7b73-44e5-98f4-d9198e8803d4 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.153065 Oct 10 11:46:06.901855 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3523/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:06 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:07.925498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:07.926135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:07.933041 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:07.933547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:07.934004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:07.935208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:07.935692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:07.936140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:08.071196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:08.080049 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61e90cf2-509c-49f9-9600-fd0e50ccc48a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.158458 Oct 10 11:46:08.080636 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3631/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:07 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:09.104475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:09.105154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:09.112140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:09.112638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:09.113085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:09.113786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:09.114252 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:09.114686 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:09.251650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:09.259402 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb4cac8a-5071-459f-8f46-0b8acf153ff7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.158809 Oct 10 11:46:09.259973 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3524/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:09 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:10.283592 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:10.284257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:10.291501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:10.292005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:10.293048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:10.293815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:10.294482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:10.294931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:10.425315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:10.433139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-450adf0c-f928-4f96-acf8-c07b0d1c97dc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.153576 Oct 10 11:46:10.433710 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3632/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:10 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:11.457304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:11.457927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:11.464780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:11.465272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:11.466359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:11.467070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:11.467532 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:11.467963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:11.601801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:11.609819 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6c42b0e-011f-461a-8d10-2aadbf8746f5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.156646 Oct 10 11:46:11.610394 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3525/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:11 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:12.634120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:12.634655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:12.642773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:12.643308 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:12.643763 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:12.644467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:12.644939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:12.645380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:12.776988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:12.785177 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9996b4a9-e93d-4cc7-ac5d-807828658338 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.155104 Oct 10 11:46:12.785781 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3633/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:12 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:13.809587 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:13.810154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:13.817123 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:13.817666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:13.818163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:13.818862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:13.819350 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:13.819780 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:13.961473 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:13.970284 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99d478cc-d7c7-4bbd-b6db-4a4e9686d6d6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1681 microversion: 2.1 time: 0.165014 Oct 10 11:46:13.970851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3526/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:13 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:14.993697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:14.994334 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:15.001600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:15.002105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:15.002564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:15.003313 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:15.003794 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:15.004241 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:15.134317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:15.142659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a51738a3-c64f-4ea0-a8d4-eae459521799 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1684 microversion: 2.1 time: 0.152928 Oct 10 11:46:15.143276 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3634/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:14 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:39.331548 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:46:39.333717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:39.336475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.337376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.344541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:39.345038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:39.345486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:39.346184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:39.346650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:39.347105 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:39.406540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-515fbfb2-c8ca-44f7-9a4c-8cbdb6445ff0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action" status: 200 len: 69504 microversion: 2.1 time: 0.079380 Oct 10 11:46:39.407249 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3527/7161] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:46:39 2022] POST /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3/action => generated 69504 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:46:46.478724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:46.479352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:46.480868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bef2792-69fb-4e92-bd4e-20ed0dda4fc3", "tag": "b8dbf023-70b9-441d-8bc7-39d7d53d1aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:46:46.483790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=16 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.484641 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=48 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.489196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:46.489783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:46.490171 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:46.490899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:46.491649 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:46.492205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:46.493038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:46.493727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:46.493957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:46.506314 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] Creating event network-changed:b8dbf023-70b9-441d-8bc7-39d7d53d1aa5 for instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 on n-h2-860687-2 Oct 10 11:46:46.511262 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0cac8d11-97bb-4570-9bba-ef4e30cf8176 req-b88c7860-9398-4d6c-8965-f679b007c079 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034346 Oct 10 11:46:46.512176 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3528/7162] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:46:46.522323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:46:46.623145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5b497919-3ab3-4fc2-8f32-acf28d848751 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 204 len: 0 microversion: 2.1 time: 0.148339 Oct 10 11:46:46.624185 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3635/7163] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:46:46 2022] DELETE /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:46.635511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:46.636435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:46.643933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:46.644504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:46.645020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:46.645846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:46.646370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:46.647022 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:46.791069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:46.799283 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9c89858-3f94-46d5-8333-c75d1c592fa7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1690 microversion: 2.1 time: 0.169960 Oct 10 11:46:46.799860 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3529/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:46 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:47.823897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:47.824615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:47.832591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:47.833096 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:47.833544 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:47.834257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:47.834724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:47.835195 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:48.001521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:48.009290 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e386141-9cdd-4058-9a79-6c832d20c564 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1690 microversion: 2.1 time: 0.190034 Oct 10 11:46:48.009859 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3636/7165] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:47 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:48.609845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bef2792-69fb-4e92-bd4e-20ed0dda4fc3", "name": "network-vif-deleted", "tag": "b8dbf023-70b9-441d-8bc7-39d7d53d1aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:46:48.622505 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:48.623534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:48.623958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:48.637182 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] Creating event network-vif-deleted:b8dbf023-70b9-441d-8bc7-39d7d53d1aa5 for instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 on n-h2-860687-2 Oct 10 11:46:48.643330 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-51a0faaf-cd64-409b-8498-5908f4de011f req-ee4983ce-03ba-437c-9866-2cfcb5613eee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Oct 10 11:46:48.643941 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3530/7166] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:46:49.033396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:49.034101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:49.041077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:49.041594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:49.042100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:49.042861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:49.043368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:49.043821 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:49.080050 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:49.081343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:49.081846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:49.082328 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lazy-loading 'fault' on Instance uuid 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:46:49.125974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:46:49.133127 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3a70f002-c503-47e6-b4e2-e11c8baa6e12 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 200 len: 1356 microversion: 2.1 time: 0.103883 Oct 10 11:46:49.133645 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3637/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:49 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:50.158253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:50.158961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:46:50.165165 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:50.165657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:50.166107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:50.166805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:50.167294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:50.167732 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:50.181308 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] HTTP exception thrown: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Request method failure captured: Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 HTTP/1.1 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAWD91prSd6fyNeCxdnt8lLgn6gFXLUBlDvZPmZrMY6G2A0VxgnIB9nc8PO0OIwbUApZC4hcr81_D8TozNGpA4TRircP2DQlbvETim0gTpPFXTcJ49800Hwq1xVHHDmF1BJcIO5UX59rDFowIbXDyiiARepiQrXty2YNxLVdj4DnSWs Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e37c02f22a0b4f119264b30218bd7e68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e37c02f22a0b4f119264b30218bd7e68"}]}] Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5ed82ea1d3cc4f28a041a6c2fb646820 Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '9bef2792-69fb-4e92-bd4e-20ed0dda4fc3'} Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:46:50.182930 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Returning 404 to user: Instance 9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0211b41e-b17b-4693-bef4-86cd6ba79ef9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3" status: 404 len: 111 microversion: 2.1 time: 0.031442 Oct 10 11:46:50.188475 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3531/7168] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:46:50 2022] GET /compute/v2.1/servers/9bef2792-69fb-4e92-bd4e-20ed0dda4fc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:46:53.555869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e0e54213-132c-4941-9ea0-386e331f4d92 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '.version_select at 0x7f677c05c550>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:46:53.579511 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e0e54213-132c-4941-9ea0-386e331f4d92 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-943145459" status: 202 len: 0 microversion: 2.1 time: 0.027673 Oct 10 11:46:53.580314 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3638/7169] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 11:46:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-943145459 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:46:53.609654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45436546-be82-4f27-992e-b4f03e6f400c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: .version_select at 0x7f6777a05af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1052002201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE35fiOi7rUD0gQ3WYuA/db5FW5ws/XuLEH0H6IYrijoNU50UUxngMyZ9KElHZ9AdDMsncxUl8C++aAj9+TF75vKykXn8y6L5VyoiTB1gbZ9dwIiSoAZCIKGi4JvopLScg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:46:53.626618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-45436546-be82-4f27-992e-b4f03e6f400c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:46:53.632635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-45436546-be82-4f27-992e-b4f03e6f400c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:46:53.661703 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45436546-be82-4f27-992e-b4f03e6f400c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056672 Oct 10 11:46:53.662318 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3532/7170] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:46:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:46:58.780374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1306223804", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "0eaa9bf8-f420-404a-8a3c-eeb1edc1f9c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1052002201", "security_groups": [{"name": "tempest-secgroup-smoke-1873978660"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:46:58.910117 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] validate_networks() for [('0eaa9bf8-f420-404a-8a3c-eeb1edc1f9c4', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:46:59.132377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.369004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:46:59.369459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:46:59.369930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:46:59.370912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:46:59.371636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:46:59.387532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:59.389530 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:59.390001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:59.390781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:46:59.391289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:46:59.392088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:46:59.421203 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:46:59.427930 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:46:59.443020 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:46:59.445467 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:46:59.493676 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [d60a5dfe-28e2-4f67-ab61-2da9702fa889] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:47:00.502362 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [d60a5dfe-28e2-4f67-ab61-2da9702fa889] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44442. Oct 10 11:47:00.506453 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ed1f5799-f5d3-4da8-ae9c-8a13c0e87aba tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.731559 Oct 10 11:47:00.508452 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3639/7171] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:46:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:47:00.516871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.522294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aad46cb8-3165-47d4-8d78-9e44a91705d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:00.523082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aad46cb8-3165-47d4-8d78-9e44a91705d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:00.637976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aad46cb8-3165-47d4-8d78-9e44a91705d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:00.652072 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aad46cb8-3165-47d4-8d78-9e44a91705d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1267 microversion: 2.1 time: 0.136930 Oct 10 11:47:00.653244 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3533/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:00 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:01.677630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:01.678321 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:01.685992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:01.686496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:01.686960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:01.687737 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:01.688223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:01.688668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:01.766257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:01.776449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0370e851-b54a-4826-842b-804d92f863ae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1337 microversion: 2.1 time: 0.103964 Oct 10 11:47:01.786043 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3640/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:01 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:02.801438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:02.802079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:02.810110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:02.810640 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:02.811184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:02.811910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:02.812370 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:02.812801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:02.952909 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:02.961502 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f1d38a2-d32f-49f7-a5b6-84636c1745f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.164123 Oct 10 11:47:02.962087 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3534/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:02 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:03.342167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:03.353056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:03.353486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:03.353932 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:03.366410 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] Creating event network-changed:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h1-860687-2 Oct 10 11:47:03.371462 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-acebe864-f2a8-4d16-9bb7-95c41d8afd06 req-ecf08a30-2b33-4a5e-835d-45895e0ea8a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 Oct 10 11:47:03.372089 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3641/7175] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:47:03.986111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:03.986673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:03.993544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:03.994032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:03.994477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:03.995236 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:03.995731 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:03.996166 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:04.132571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:04.140888 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bca0753-cc3b-4303-8bd4-0fb4e47adaa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.159124 Oct 10 11:47:04.141468 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3535/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:03 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:05.165762 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:05.166484 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:05.173551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:05.174053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:05.174507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:05.175246 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:05.175716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:05.176155 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:05.306870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:05.314659 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-10d83c75-eea4-487d-b9e2-4638b804be5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.154036 Oct 10 11:47:05.315269 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3642/7177] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:05 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:06.338127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:06.338796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:06.345900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:06.346399 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:06.346853 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:06.347607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:06.348072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:06.348502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:06.490127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:06.503411 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b0240ae-6b00-405a-b174-2c7850d3d97d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.169042 Oct 10 11:47:06.504328 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3536/7178] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:06 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:07.527547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:07.528197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:07.535462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:07.535978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:07.536438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:07.537222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:07.537736 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:07.538227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:07.671999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:07.680531 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6809b086-ba54-491b-8aca-36016e51a1e8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.157149 Oct 10 11:47:07.681123 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3643/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:07 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:08.453283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "name": "network-vif-plugged", "status": "completed", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:08.464735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:08.465214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:08.465647 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:08.477472 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] Creating event network-vif-plugged:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h1-860687-2 Oct 10 11:47:08.482473 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a8bd81c4-02f2-456e-a64d-03404bed8c8f req-ffd319a2-d026-4231-9f5a-cfa7b6aaaa12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Oct 10 11:47:08.483176 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3537/7180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:47:08.704704 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:08.705335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:08.712169 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:08.712669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:08.713122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:08.713825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:08.714296 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:08.714735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:08.849144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:08.856778 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-55aa4b71-7eb1-4248-aafe-c3aa60b9ecb1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1393 microversion: 2.1 time: 0.156898 Oct 10 11:47:08.857363 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3644/7181] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:08 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:09.882345 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:09.883200 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:09.885534 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.891320 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:09.891951 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:09.892363 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:09.893049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:09.893507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:09.893934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:10.035729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:10.043509 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7f49253-1664-43ad-aa88-c0851909b6a2 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1566 microversion: 2.1 time: 0.167660 Oct 10 11:47:10.044102 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3538/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:09 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:10.067705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:10.068347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:10.070343 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.071057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.078112 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:10.078918 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:10.079461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:10.080196 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:10.080703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:10.081156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:10.211357 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:10.219110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4eb16e4c-d75e-4349-a0dc-f065d1ec6a62 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1566 microversion: 2.1 time: 0.156145 Oct 10 11:47:10.220600 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3645/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:10 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:11.806691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:11.807336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:11.809307 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:11.816792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:11.827758 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:11.828264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:11.829633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:11.830344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:11.830806 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:11.831268 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:11.840991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:11.841668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:11.842319 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:11.854195 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] Creating event network-changed:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h1-860687-2 Oct 10 11:47:11.859629 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-9060b2c7-02bd-4a85-b94f-a2b78a10b2fe req-1085e013-b203-4e67-be16-7b5961d919bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047095 Oct 10 11:47:11.860667 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3646/7184] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:47:11.975639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:11.983341 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dee5a63a-13fc-486a-be01-4c87aaa51f38 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1566 microversion: 2.1 time: 0.180705 Oct 10 11:47:11.984157 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3539/7185] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:11 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:35.227938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.228703 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.233688 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:35.236046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:35.244368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:35.244878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:35.245339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:35.246055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:35.246534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:35.246981 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:35.300902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7ea060a3-74f5-49dd-acaa-767fb63f4151 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action" status: 200 len: 24569 microversion: 2.1 time: 0.074852 Oct 10 11:47:35.301537 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3647/7186] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:47:35 2022] POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:41.700220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:41.702426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:41.704735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.705604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.713068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:41.713588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:41.714035 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:41.714739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:41.715237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:41.715670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:41.757551 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:41.763575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 11:47:41.770794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:47:41.771251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:47:41.771729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:47:41.772143 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:47:41.772562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:47:41.838721 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e0be20c-907a-4dec-95c3-24819f12c3a7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action" status: 202 len: 0 microversion: 2.1 time: 0.142852 Oct 10 11:47:41.839381 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3540/7187] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:47:41 2022] POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:47:41.849303 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:41.851267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:41.858222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:41.858728 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:41.859224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:41.859954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:41.860432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:41.860878 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:41.999928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:42.008266 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7e943e4f-a08c-4f42-a877-9904be89a062 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1693 microversion: 2.1 time: 0.164394 Oct 10 11:47:42.008837 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3648/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:41 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:43.033337 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:43.033864 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:43.041693 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:43.042192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:43.042642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:43.043378 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:43.043850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:43.044273 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:43.178580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:43.186334 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccd6d4df-6b9e-4876-b00c-ca30342f443f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1693 microversion: 2.1 time: 0.158106 Oct 10 11:47:43.186907 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3541/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:43 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:44.211227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:44.211862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:44.219538 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:44.220044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:44.220500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:44.221213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:44.221692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:44.222139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:44.357553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:44.365570 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-875d41b5-8932-49c0-a75c-05da1336d595 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.159218 Oct 10 11:47:44.366144 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3649/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:44 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:45.390591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:45.391240 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:45.397916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:45.398409 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:45.398855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:45.399591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:45.400055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:45.400493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:45.530283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:45.538664 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8e8fdfc-7e88-4e36-bada-1e94e5222dab tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.152268 Oct 10 11:47:45.539271 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3542/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:45 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:46.561979 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:46.562773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:46.570534 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:46.571140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:46.571653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:46.572480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:46.572954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:46.573392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:47.022667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:47.030510 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ffb433a0-424e-4add-a0cd-7fd1133690f7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.472488 Oct 10 11:47:47.031112 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3650/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:46 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:48.053733 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:48.054341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:48.061120 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:48.061605 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:48.062043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:48.062728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:48.063216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:48.063642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:48.193525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:48.201706 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f219d0d1-2a81-4b5e-943f-ed056d8b02d8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.151940 Oct 10 11:47:48.202348 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3543/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:48 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:49.225507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:49.226143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:49.233080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:49.233588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:49.234036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:49.234740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:49.235240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:49.235681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:49.368354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:49.376307 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-816ff36b-7d9b-4bb5-9d85-b2da4c418406 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.155059 Oct 10 11:47:49.377010 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3651/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:49 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:50.400954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:50.401569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:50.408475 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:50.408958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:50.409390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:50.410106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:50.410644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:50.411097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:50.545736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:50.554425 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ec4d496-879b-4d38-996e-f689d1e09133 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.157388 Oct 10 11:47:50.555017 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3544/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:50 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:51.577517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:51.578153 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:51.586268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:51.586774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:51.587265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:51.587978 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:51.588453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:51.588900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:51.722510 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:51.730340 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e76bb3a5-55d2-4c2d-b257-41252efc600e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.156824 Oct 10 11:47:51.730924 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3652/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:51 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:52.754519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:52.755267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:52.762288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:52.762779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:52.763253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:52.763953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:52.764416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:52.764881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:52.904410 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:52.912966 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a67df591-2006-4348-8633-b2dc4aaa863d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.162913 Oct 10 11:47:52.913489 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3545/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:52 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:53.938025 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:53.938654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:53.946274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:53.946776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:53.947263 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:53.950247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:53.951087 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:53.952146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:54.083575 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:54.091395 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d08c11e1-d789-47a1-9e3e-c9eacacb3871 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.157325 Oct 10 11:47:54.091977 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3653/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:53 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:55.114358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:55.114956 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:55.122032 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:55.122516 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:55.122955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:55.123672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:55.124130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:55.124555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:55.259156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:55.266824 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97b5de43-0dc4-40ae-8e93-c693dbf10fd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1698 microversion: 2.1 time: 0.156342 Oct 10 11:47:55.267427 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3546/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:55 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:56.290897 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:56.291618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:56.298322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:56.298824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:56.299317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:56.300033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:56.300643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:56.301235 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:56.402355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "name": "network-vif-unplugged", "status": "completed", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:56.420355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:56.421201 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:56.421862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:56.434752 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Creating event network-vif-unplugged:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h2-860687-2 Oct 10 11:47:56.441499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] Instance 73d37824-cc09-4286-a452-68a7968eafa1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:47:56.454061 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a1b50b24-459a-440f-8b31-eadf64014595 req-7a8f87bb-cd4a-4d35-9bed-c28b23eefeef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130438 Oct 10 11:47:56.454906 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3547/7200] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:47:56.459660 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:56.468000 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-34a45387-85a7-4277-a580-022cf6741741 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1697 microversion: 2.1 time: 0.181023 Oct 10 11:47:56.468940 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3654/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:56 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:57.494838 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:57.495698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:57.501886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:57.502380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:57.502824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:57.503626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:57.504102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:57.504538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:57.645216 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:57.653057 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25a8a281-628a-4c68-857e-d53f21d9a470 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1697 microversion: 2.1 time: 0.163354 Oct 10 11:47:57.653652 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3548/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:57 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:58.482062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:47:58.492658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:58.493149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:58.493596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:58.505636 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Creating event network-changed:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h2-860687-2 Oct 10 11:47:58.510949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] Instance 73d37824-cc09-4286-a452-68a7968eafa1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860687-2', 'n-h1-860687-2'} {{(pid=128800) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 11:47:58.521873 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1cd4f108-3c20-42bf-8d22-16f68e86f3c5 req-acf760ad-5e26-4ffe-ac11-870bb45b9893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043444 Oct 10 11:47:58.522453 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3655/7203] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:47:58.678611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:58.679269 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:58.686186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:58.686677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:58.687147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:58.687850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:58.688316 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:58.688747 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:58.831184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:47:58.839405 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e0cb881-e42b-4812-a8b2-7d6170915c74 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1695 microversion: 2.1 time: 0.165212 Oct 10 11:47:58.839988 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3549/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:58 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:59.865443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:47:59.866197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:47:59.873435 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:59.873943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:59.874638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:47:59.875701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:47:59.876184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:47:59.876636 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.011274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:00.019811 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d7f150e0-c2a6-49fb-9f46-a61f664e368b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1692 microversion: 2.1 time: 0.158747 Oct 10 11:48:00.020513 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3656/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:47:59 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:00.043115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:00.043662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:00.050957 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.051501 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.051936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.052637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.053103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.053537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.114642 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f762cdf8-c569-491a-8536-08cf72f901e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action" status: 204 len: 0 microversion: 2.1 time: 0.075231 Oct 10 11:48:00.115337 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3550/7206] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:48:00 2022] POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:00.125038 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:00.125620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:00.132167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.132759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.133352 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.134239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.134788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.135496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.287690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:00.297529 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e3a9787e-0cb2-43b9-b2e9-65aa450cf17f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1692 microversion: 2.1 time: 0.177802 Oct 10 11:48:00.298468 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3657/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:00 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:00.324341 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:00.325124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:00.333226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.333724 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.334407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.335154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:00.335623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:00.336059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:00.484600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:00.493345 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27ae5850-ad99-46cb-83cb-ef09e03570ff tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1692 microversion: 2.1 time: 0.173346 Oct 10 11:48:00.493884 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3551/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:00 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:01.517238 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:01.517813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:01.524793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:01.525307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:01.525770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:01.526488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:01.526970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:01.527448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:01.662047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:01.669907 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2db4156b-5c69-4cba-b183-0fde58c6454c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1684 microversion: 2.1 time: 0.156769 Oct 10 11:48:01.670486 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3658/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:01 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:02.882072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "name": "network-vif-plugged", "status": "completed", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:02.891718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:02.892194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:02.892623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:02.904458 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] Creating event network-vif-plugged:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h2-860687-2 Oct 10 11:48:02.909338 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e470ecaf-3758-48f1-9742-a85dcfbfa476 req-ab0fc64d-c8e0-4856-a611-0bd65e7fc364 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088808 Oct 10 11:48:02.910335 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3552/7210] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:48:23.850927 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:23.853192 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:23.856029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.856701 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=68 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.862224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:23.862725 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:23.863240 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:23.863952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:23.865365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:23.865818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:23.919136 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-11ae180f-a08f-43ed-9dbd-944745e50be5 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action" status: 200 len: 24565 microversion: 2.1 time: 0.072363 Oct 10 11:48:23.920011 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3659/7211] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:48:23 2022] POST /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1/action => generated 24565 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:30.945333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:30.946053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:30.948818 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:30.949254 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.949988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.956992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:30.957513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:30.957979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:30.958689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:30.959177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:30.959606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:30.962975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:30.963751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:30.964249 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:30.977343 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] Creating event network-changed:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h2-860687-2 Oct 10 11:48:30.982728 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2d135552-fd75-48f1-848e-5017a032ad1f req-051539fe-4e99-4e3f-90a5-fea135bf74e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038224 Oct 10 11:48:30.983441 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3660/7212] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:30.988487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:48:31.076849 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3685283b-d0f0-41d0-a95b-e29fb555ca6a tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 204 len: 0 microversion: 2.1 time: 0.136578 Oct 10 11:48:31.077700 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3553/7213] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:48:30 2022] DELETE /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:31.088550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:31.089556 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:31.097226 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:31.097826 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:31.098387 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:31.099316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:31.099792 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:31.100236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:31.248970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:31.257652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a727451c-70d9-4bd6-be6c-32063cae54f8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1690 microversion: 2.1 time: 0.174724 Oct 10 11:48:31.258452 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3661/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:31 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:32.282140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:32.282848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:32.290318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:32.290813 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:32.291277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:32.291983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:32.292434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:32.292860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:32.504914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:32.512646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db96d658-f83c-4d6d-8794-899adf12b1e1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 200 len: 1690 microversion: 2.1 time: 0.234730 Oct 10 11:48:32.513249 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3554/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:32 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:32.997995 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d37824-cc09-4286-a452-68a7968eafa1", "name": "network-vif-deleted", "tag": "1753c9f5-6b5a-4297-b832-6dbb57c5732d"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:33.008921 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:33.009421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:33.009873 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:33.020847 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] Creating event network-vif-deleted:1753c9f5-6b5a-4297-b832-6dbb57c5732d for instance 73d37824-cc09-4286-a452-68a7968eafa1 on n-h2-860687-2 Oct 10 11:48:33.025710 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-d2f09c72-8c77-46e4-a2bd-345d7cc369eb req-32fa1450-c370-477d-8072-cce8e2a31f9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 Oct 10 11:48:33.026239 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3662/7216] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:33.536525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:33.537196 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 73d37824-cc09-4286-a452-68a7968eafa1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:33.544604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:33.545088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:33.545525 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:33.546213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:33.546666 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:33.547142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:33.561091 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] HTTP exception thrown: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Request method failure captured: Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 HTTP/1.1 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAWD91prSd6fyNeCxdnt8lLgn6gFXLUBlDvZPmZrMY6G2A0VxgnIB9nc8PO0OIwbUApZC4hcr81_D8TozNGpA4TRircP2DQlbvETim0gTpPFXTcJ49800Hwq1xVHHDmF1BJcIO5UX59rDFowIbXDyiiARepiQrXty2YNxLVdj4DnSWs Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e37c02f22a0b4f119264b30218bd7e68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e37c02f22a0b4f119264b30218bd7e68"}]}] Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5ed82ea1d3cc4f28a041a6c2fb646820 Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '73d37824-cc09-4286-a452-68a7968eafa1'} Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:48:33.562725 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Returning 404 to user: Instance 73d37824-cc09-4286-a452-68a7968eafa1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9333fbf9-6db8-4691-aebe-9205153317bf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1" status: 404 len: 111 microversion: 2.1 time: 0.032231 Oct 10 11:48:33.567882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3555/7217] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:33 2022] GET /compute/v2.1/servers/73d37824-cc09-4286-a452-68a7968eafa1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:48:36.778354 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a91ad2f8-70e9-449c-9b61-abc73e31c54c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '.version_select at 0x7f6777822dc0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:36.804796 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a91ad2f8-70e9-449c-9b61-abc73e31c54c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1052002201" status: 202 len: 0 microversion: 2.1 time: 0.031540 Oct 10 11:48:36.805475 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3663/7218] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Oct 10 11:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1052002201 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:48:36.829115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d168eed0-4acf-4eee-802f-3656d8e7c7e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: .version_select at 0x7f677c548670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-595481934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvs6JoY4u4Bz+G5ktmrMrGuHxz5z8p9aP2FwNLM9BdqOTZVSSV8lAfxAshsXnI/Dcd5IQScUmV/n187wkmYD23CQEgPMsVB61ymlfrnb+sf2SCodAFD62hZ3SmSVfMKow=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:36.847303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d168eed0-4acf-4eee-802f-3656d8e7c7e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:48:36.852638 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d168eed0-4acf-4eee-802f-3656d8e7c7e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:48:36.878841 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d168eed0-4acf-4eee-802f-3656d8e7c7e0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054460 Oct 10 11:48:36.880268 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3556/7219] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:48:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:42.356811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-620657952", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "f7e6155f-0533-49c9-a935-761cb842cc39"}], "key_name": "tempest-TestNetworkAdvancedServerOps-595481934", "security_groups": [{"name": "tempest-secgroup-smoke-25218290"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:42.472956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] validate_networks() for [('f7e6155f-0533-49c9-a935-761cb842cc39', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:48:42.912331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:48:42.912702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:48:42.913212 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:48:42.913650 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:48:42.914078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:48:42.923513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:42.924022 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:42.924476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:42.925223 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:42.925692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:42.926720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:42.963570 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:48:42.972225 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:48:42.987644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:48:42.990615 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:48:43.048207 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1bbb9815-a358-4d78-9700-6aeac46893d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.696661 Oct 10 11:48:43.048867 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3664/7220] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:48:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 11:48:43.063137 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1de0fed-1158-495a-aa31-baf530759a2d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:43.063769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1de0fed-1158-495a-aa31-baf530759a2d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:43.145367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1de0fed-1158-495a-aa31-baf530759a2d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:43.155624 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1de0fed-1158-495a-aa31-baf530759a2d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1265 microversion: 2.1 time: 0.098721 Oct 10 11:48:43.156216 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3557/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:43 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:44.184937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:44.186205 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:44.200425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:44.201356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:44.202139 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:44.203764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:44.204473 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:44.205122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:44.293081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:44.303037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f70af7bd-c499-4ee9-bca3-fc43780de5e9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1325 microversion: 2.1 time: 0.122361 Oct 10 11:48:44.304330 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3665/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:44 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1325 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:45.330365 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:45.331739 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:45.339474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.341654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:45.342380 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:45.343107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:45.344361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:45.345221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:45.345963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:45.615015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:45.627836 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-298fd6b8-d4bb-4330-a0cd-c02acf45ec60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.303188 Oct 10 11:48:45.628648 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3558/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:45 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:45.830104 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1042de31-5b3b-4283-9b8b-cdb68af349cb", "tag": "ad5b7188-cc91-4742-88c7-835a740b06fb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:45.840667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:45.841244 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:45.841760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:45.852944 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] Creating event network-changed:ad5b7188-cc91-4742-88c7-835a740b06fb for instance 1042de31-5b3b-4283-9b8b-cdb68af349cb on n-h2-860687-2 Oct 10 11:48:45.857979 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fd518b73-1e18-4bcd-9af2-6bb0b5b2650a req-86948e71-8bc6-4820-90b2-f82b02de2b79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093556 Oct 10 11:48:45.858586 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3666/7224] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:46.651588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:46.652108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:46.658949 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:46.659468 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:46.659940 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:46.660674 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:46.661142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:46.661577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:46.791270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:46.798879 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8aa6268d-2184-48d2-8f7f-a79f6af57ada tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.151321 Oct 10 11:48:46.799486 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3559/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:46 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:47.824399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:47.825122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:47.832625 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:47.833282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:47.833751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:47.834509 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:47.835032 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:47.835531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:47.971975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:47.979650 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd0d9e0c-757a-4bf4-98c9-1ab95bc02f1d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.160472 Oct 10 11:48:47.980227 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3667/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:47 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:49.003146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:49.003917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:49.011492 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:49.012065 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:49.012519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:49.013225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:49.013689 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:49.014124 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:49.152540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:49.161420 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c772635d-776f-416a-8653-1e0782f3ce07 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.162013 Oct 10 11:48:49.161861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3560/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:48 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:50.184557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:50.185197 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:50.192174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:50.192679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:50.193136 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:50.193850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:50.194327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:50.194773 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:50.325996 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:50.335334 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d04e93cc-4b04-4cf7-8b2c-91b5209d11eb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.154674 Oct 10 11:48:50.335917 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3668/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:50 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:51.102251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1042de31-5b3b-4283-9b8b-cdb68af349cb", "name": "network-vif-plugged", "status": "completed", "tag": "ad5b7188-cc91-4742-88c7-835a740b06fb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:51.114103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:51.115278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:51.115723 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:51.127381 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] Creating event network-vif-plugged:ad5b7188-cc91-4742-88c7-835a740b06fb for instance 1042de31-5b3b-4283-9b8b-cdb68af349cb on n-h2-860687-2 Oct 10 11:48:51.133445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e55bd327-6c09-409a-aba5-c4cda146bd8b req-55406d11-2b16-425e-b135-90b5e2515af7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Oct 10 11:48:51.134184 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3561/7229] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:51.358511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:51.359193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:51.366825 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:51.367362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:51.367824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:51.368549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:51.369028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:51.369475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:51.498900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:51.507128 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d1ec177d-7e3c-4a7a-b323-ca229de566b8 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1389 microversion: 2.1 time: 0.152590 Oct 10 11:48:51.507703 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3669/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:51 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:52.530359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:52.531026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:52.538677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:52.539267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:52.539704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:52.540393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:52.540849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:52.541278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:52.674481 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:52.682248 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24f20945-9d19-4f58-999a-386d5b9e3c82 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1562 microversion: 2.1 time: 0.156297 Oct 10 11:48:52.682824 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3562/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:52 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:52.705331 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:52.705965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:52.712993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:52.713497 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:52.713951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:52.714661 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:52.715204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:52.715651 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:52.846946 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:52.854784 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bab1233b-d318-46b7-b01b-b6c1e46bbebf tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1562 microversion: 2.1 time: 0.153548 Oct 10 11:48:52.855388 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3670/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:52 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:54.504377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:48:54.505187 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:48:54.506062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1042de31-5b3b-4283-9b8b-cdb68af349cb", "tag": "ad5b7188-cc91-4742-88c7-835a740b06fb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:48:54.508393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.511608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.513306 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.515257 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.517824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:54.518668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:54.519435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:54.520601 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:54.521377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:54.522044 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:54.524648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:48:54.525336 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:48:54.525793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:48:54.530756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=49 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.540454 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] Creating event network-changed:ad5b7188-cc91-4742-88c7-835a740b06fb for instance 1042de31-5b3b-4283-9b8b-cdb68af349cb on n-h2-860687-2 Oct 10 11:48:54.545849 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1b621681-25df-4852-89fe-847130b2d3b0 req-10d8cad9-8d26-4c3c-b6f7-c022df62322f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043800 Oct 10 11:48:54.547186 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3671/7233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:48:54.772717 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:48:54.780791 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5849411a-3c07-4cce-9a74-059546c73aa3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1562 microversion: 2.1 time: 0.281868 Oct 10 11:48:54.781513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3563/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:48:54 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:49:16.028339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:16.076832 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:49:16.079545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:16.090324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:16.090837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:16.091324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:16.092042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:16.092515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:16.092959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:16.147222 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bd21c6ab-268c-4f3d-995a-4da883b93169 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action" status: 200 len: 24571 microversion: 2.1 time: 0.120603 Oct 10 11:49:16.147840 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3672/7235] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:49:16 2022] POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action => generated 24571 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:27.156266 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:49:27.158455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:27.159210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:27.166406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:27.166889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:27.167353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:27.191242 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 11:49:27.233751 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b589384-a355-4c50-ac22-a55d61aa9b03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action" status: 202 len: 0 microversion: 2.1 time: 0.081369 Oct 10 11:49:27.234361 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3564/7236] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:49:27 2022] POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:49:27.244030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:27.244777 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:27.248740 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:27.249480 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:27.254518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:27.255086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:27.255533 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:27.256359 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:27.256829 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:27.257267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:27.391073 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:27.398783 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a350350b-8820-49d4-9630-27d9a8893dd1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.159094 Oct 10 11:49:27.399383 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3673/7237] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:27 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:49:28.424312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:28.425043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:28.432145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:28.432639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:28.433085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:28.433784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:28.434247 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:28.434679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:28.570482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:28.578639 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-941c4dfd-cbb2-4f0a-bb68-4be53386f76b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.158679 Oct 10 11:49:28.579270 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3565/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:28 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:29.602954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:29.603768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:29.610494 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:29.610987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:29.611474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:29.613229 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:29.613739 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:29.614185 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:29.743103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:29.750926 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-99d6f86a-f283-4294-9d59-6f1be52b2704 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.151850 Oct 10 11:49:29.751536 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3674/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:29 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:30.773982 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:30.774591 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:30.781452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:30.781928 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:30.782364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:30.783072 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:30.783609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:30.783988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:30.913769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:30.921445 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab05e8aa-1244-4071-8c8e-2d3b4a0f9b80 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.151430 Oct 10 11:49:30.922016 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3566/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:30 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:31.944461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:31.945090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:31.951900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:31.952399 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:31.953102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:31.953803 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:31.954273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:31.954712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:32.087841 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:32.095897 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1737a639-f471-4740-bf75-1bb5acbfa0f9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.155276 Oct 10 11:49:32.097088 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3675/7241] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:31 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:33.120285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:33.120925 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:33.128814 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:33.129303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:33.129741 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:33.130439 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:33.130895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:33.131349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:33.340327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:33.349230 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10ebd95b-644b-46c4-b225-3cea7b2d963b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.233337 Oct 10 11:49:33.349818 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3567/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:33 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:34.373422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:34.374098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:34.381402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:34.381760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:34.382222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:34.382944 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:34.383476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:34.383931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:34.519857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:34.527739 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-93c78f34-a87a-4100-9494-8a17a0d9a7a9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.158254 Oct 10 11:49:34.528321 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3676/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:34 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:35.552169 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:35.552714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:35.559639 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:35.560129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:35.560572 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:35.561267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:35.561727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:35.562158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:35.691890 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:35.699629 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea273697-e83c-44ae-9cfd-f5564c4f3c97 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.152021 Oct 10 11:49:35.700205 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3568/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:35 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:36.724028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:36.724654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:36.731667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:36.732167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:36.732622 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:36.733320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:36.733788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:36.734233 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:36.869870 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:36.877815 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6340e5be-0109-4e9d-b6c7-fea7e6010d5f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.158265 Oct 10 11:49:36.878388 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3677/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:36 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:37.902318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:37.902945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:37.909900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:37.910395 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:37.910836 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:37.911562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:37.912023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:37.912480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:38.040759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:38.048538 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ee0cd6e-ad81-4189-a8c4-20eab2f790b0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.150216 Oct 10 11:49:38.049638 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3569/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:37 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:39.073152 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:39.073745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:39.081129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:39.081629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:39.082082 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:39.082787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:39.084095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:39.084726 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:39.223365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:39.231234 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e9102d55-21e2-4df7-a78d-896da887fffe tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.161996 Oct 10 11:49:39.231844 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3678/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:39 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:40.254585 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:40.255219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:40.261828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:40.262313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:40.262750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:40.263510 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:40.263944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:40.264367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:40.399588 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:40.407302 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c34b6e8b-ad61-4d46-8e50-7cc42bd79862 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.156631 Oct 10 11:49:40.407877 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3570/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:40 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:49:41.430980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:41.431639 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:41.438676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:41.439157 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:41.440193 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:41.440907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:41.441378 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:41.441819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:41.571517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:41.579614 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4d549caa-e70b-4f19-bb54-b20e3efa3d01 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1691 microversion: 2.1 time: 0.152514 Oct 10 11:49:41.580233 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3679/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:41 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:42.601759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:42.602425 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:42.609482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:42.609978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:42.610420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:42.611737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:42.612367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:42.612808 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:42.750359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:42.759535 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31697b30-7f00-432b-9be1-89324f90c06d tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1668 microversion: 2.1 time: 0.161578 Oct 10 11:49:42.760121 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3571/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:42 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:43.853799 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:49:43.856162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:43.863922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:43.864431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:43.864887 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:43.865597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:43.866066 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:43.866507 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:43.915976 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-16c3ef54-66c4-44b3-a285-0f72db3a6d60 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action" status: 200 len: 38392 microversion: 2.1 time: 0.065971 Oct 10 11:49:43.916609 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3680/7251] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:49:43 2022] POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action => generated 38392 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:43.929635 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:49:43.936569 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:43.937049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:43.937489 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:43.961282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 11:49:44.000913 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9329953b-81c5-4ad3-ae6e-cbad11ee75a0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action" status: 202 len: 0 microversion: 2.1 time: 0.075125 Oct 10 11:49:44.001513 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3572/7252] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:49:43 2022] POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:49:44.011021 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:44.011774 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:44.019756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:44.020322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:44.020864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:44.021596 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:44.022075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:44.022523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:44.247477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:44.256084 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-17bf1bff-f20a-42a5-85de-6ccff0a2485e tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1677 microversion: 2.1 time: 0.249386 Oct 10 11:49:44.256672 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3681/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:44 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:49:45.281274 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:49:45.281964 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:49:45.288934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:45.289427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:45.289860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:45.290545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:49:45.291020 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:49:45.291445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:49:45.427667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:49:45.435556 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71c8a150-a5f1-47f6-acec-cb3ca814f0d0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1681 microversion: 2.1 time: 0.159277 Oct 10 11:49:45.436093 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3573/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:49:45 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:09.621365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:09.623595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:09.626838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=18 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:09.627527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=52 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:09.633311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:09.633750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:09.634232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:09.634945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:09.635441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:09.635883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:09.690822 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f77faf32-4886-405a-920a-13f4a55c0945 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action" status: 200 len: 62951 microversion: 2.1 time: 0.073449 Oct 10 11:50:09.691613 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3682/7255] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:50:09 2022] POST /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb/action => generated 62951 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:50:16.689613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:16.690149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:16.692304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=20 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:16.693085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:16.693814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1042de31-5b3b-4283-9b8b-cdb68af349cb", "tag": "ad5b7188-cc91-4742-88c7-835a740b06fb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:16.699282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:16.699775 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:16.700212 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:16.700913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:16.701542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:16.702135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:16.707221 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:16.707914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:16.708491 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:16.721125 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] Creating event network-changed:ad5b7188-cc91-4742-88c7-835a740b06fb for instance 1042de31-5b3b-4283-9b8b-cdb68af349cb on n-h2-860687-2 Oct 10 11:50:16.727329 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-50a8cf02-cbd8-49fc-9dee-b52a1b9a3507 req-7f4b89fa-c20c-4518-be61-4c323bb05e54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039535 Oct 10 11:50:16.728611 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3683/7256] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:50:16.730264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:50:16.820281 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3564e8cf-54bb-4df7-bcf4-b965f54a20f1 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 204 len: 0 microversion: 2.1 time: 0.135152 Oct 10 11:50:16.821280 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3574/7257] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:50:16 2022] DELETE /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:50:16.830442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:16.831470 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:16.839680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:16.840528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:16.841245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:16.842276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:16.843085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:16.843781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:17.015439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:17.024119 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-de279523-9caa-4cb0-807b-305197186034 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1687 microversion: 2.1 time: 0.198543 Oct 10 11:50:17.024704 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3684/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:16 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:18.049024 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:18.049737 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:18.056622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:18.057118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:18.057560 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:18.058260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:18.058722 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:18.059179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:18.270610 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:18.278554 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f2a8e0f-1cdf-4811-8f52-b813f09b7e03 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1687 microversion: 2.1 time: 0.234356 Oct 10 11:50:18.279166 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3575/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:18 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1687 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:19.035018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1042de31-5b3b-4283-9b8b-cdb68af349cb", "name": "network-vif-deleted", "tag": "ad5b7188-cc91-4742-88c7-835a740b06fb"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:19.046007 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:19.046500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:19.046943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:19.065292 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] Creating event network-vif-deleted:ad5b7188-cc91-4742-88c7-835a740b06fb for instance 1042de31-5b3b-4283-9b8b-cdb68af349cb on n-h2-860687-2 Oct 10 11:50:19.070609 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-48176d40-23bb-4d4c-b6f5-8bf5dc33703d req-98ce6952-528f-470b-9f71-a3f1d6d118d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039367 Oct 10 11:50:19.071265 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3685/7260] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:50:19.301899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:19.302412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:19.309204 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:19.309690 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:19.310127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:19.310816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:19.311310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:19.311726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:19.343645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:19.344225 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:19.344672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:19.345111 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lazy-loading 'fault' on Instance uuid 1042de31-5b3b-4283-9b8b-cdb68af349cb {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:50:19.385491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:19.393281 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ade10ed1-c365-4dbc-997e-e9cba5ec8cfc tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 200 len: 1355 microversion: 2.1 time: 0.095423 Oct 10 11:50:19.393851 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3576/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:19 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 1355 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:20.418417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:20.419163 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 1042de31-5b3b-4283-9b8b-cdb68af349cb] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:20.425385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:20.425881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:20.426333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:20.427056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:20.427526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:20.427964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:20.441619 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] HTTP exception thrown: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Request method failure captured: Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb HTTP/1.1 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAWD91prSd6fyNeCxdnt8lLgn6gFXLUBlDvZPmZrMY6G2A0VxgnIB9nc8PO0OIwbUApZC4hcr81_D8TozNGpA4TRircP2DQlbvETim0gTpPFXTcJ49800Hwq1xVHHDmF1BJcIO5UX59rDFowIbXDyiiARepiQrXty2YNxLVdj4DnSWs Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e37c02f22a0b4f119264b30218bd7e68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e37c02f22a0b4f119264b30218bd7e68"}]}] Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 5ed82ea1d3cc4f28a041a6c2fb646820 Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '1042de31-5b3b-4283-9b8b-cdb68af349cb'} Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:50:20.443293 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Returning 404 to user: Instance 1042de31-5b3b-4283-9b8b-cdb68af349cb could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d6f41589-e61c-4121-9ff0-3d95f39215b7 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb" status: 404 len: 111 microversion: 2.1 time: 0.031681 Oct 10 11:50:20.448715 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3686/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:20 2022] GET /compute/v2.1/servers/1042de31-5b3b-4283-9b8b-cdb68af349cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:50:23.786513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27022c56-3c84-4dde-8088-7d1f919abba6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '.version_select at 0x7f677c82fd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:23.808469 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27022c56-3c84-4dde-8088-7d1f919abba6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-595481934" status: 202 len: 0 microversion: 2.1 time: 0.025659 Oct 10 11:50:23.808965 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3577/7263] 10.222.0.16 () {58 vars in 1281 bytes} [Mon Oct 10 11:50:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-595481934 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:50:23.842236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6df7eeac-c49f-4cda-ae12-437b59afac15 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: .version_select at 0x7f677cfd7af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1963188967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuR+kZ0ac1fvH/lWzgtkbRRDmOQ3xo/hqFIVmldTERNgoxmSwF8f9eiQOw8qlMivEO/x8P6UaP4PRIdZLzfCEW5NbY3S1iwJTUPlGl8GVv1mqA9qYTCLwCoBd1HRXsVzA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:23.859055 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6df7eeac-c49f-4cda-ae12-437b59afac15 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:50:23.864784 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-6df7eeac-c49f-4cda-ae12-437b59afac15 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:50:23.888598 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6df7eeac-c49f-4cda-ae12-437b59afac15 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050152 Oct 10 11:50:23.889121 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3687/7264] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:50:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:50:29.502915 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-252604159", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "networks": [{"uuid": "866a1df6-9913-419e-8882-b94ee8acb64d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1963188967", "security_groups": [{"name": "tempest-secgroup-smoke-1652422682"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:29.528856 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:29.640285 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] validate_networks() for [('866a1df6-9913-419e-8882-b94ee8acb64d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:50:30.112482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:50:30.112944 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:50:30.113455 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:50:30.113874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:50:30.114293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:50:30.123243 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:30.123738 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:30.124185 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:30.124924 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:30.125402 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:30.125900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:30.145668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:50:30.151130 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Getting quotas for user 5ed82ea1d3cc4f28a041a6c2fb646820 and project e37c02f22a0b4f119264b30218bd7e68. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:50:30.164835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:50:30.167296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:50:30.213050 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:50:31.223264 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [dc9ca1c6-da77-4264-9df7-39699b9e69e0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44874. Oct 10 11:50:31.228415 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66ffe3e5-88b0-4ed5-b7bf-ec938d1ee0da tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.730096 Oct 10 11:50:31.235881 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3578/7265] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:50:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:50:31.238702 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=16 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:31.243422 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d7a09f8c-64f3-4011-ae5c-5277578a29bb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:31.244406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d7a09f8c-64f3-4011-ae5c-5277578a29bb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:31.342731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d7a09f8c-64f3-4011-ae5c-5277578a29bb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:31.357472 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d7a09f8c-64f3-4011-ae5c-5277578a29bb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1266 microversion: 2.1 time: 0.120425 Oct 10 11:50:31.367153 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3688/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:31 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:32.390070 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:32.390990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:32.418976 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:32.419843 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:32.420622 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:32.422278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:32.423071 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:32.423704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:32.518797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:32.526611 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-260bdfdb-aca0-4ba6-adce-a71a6a19357c tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1336 microversion: 2.1 time: 0.144203 Oct 10 11:50:32.527237 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3579/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:32 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1336 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:50:33.550273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:33.550991 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:33.559490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:33.560009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:33.560463 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:33.561179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:33.561858 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:33.562974 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:33.694356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:33.702621 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03c8c08b-6a35-4151-9b69-a44bcc396218 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1392 microversion: 2.1 time: 0.156393 Oct 10 11:50:33.703499 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3689/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:33 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:33.765144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b7675b-96d9-46bd-b2df-c04a4ea34e9c", "tag": "6c438070-1bbe-4bd7-96b0-82f9ff4f92c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:33.776676 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:33.777172 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:33.778912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:33.792091 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] Creating event network-changed:6c438070-1bbe-4bd7-96b0-82f9ff4f92c4 for instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c on n-h2-860687-2 Oct 10 11:50:33.798646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-119b4201-c4a6-4dcc-8a6b-d47ea6355be5 req-a04b8ae5-46a2-4fd3-bf3c-16c4c869494d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037654 Oct 10 11:50:33.799286 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3580/7269] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:50:34.726098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:34.726675 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:34.733588 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:34.734439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:34.735035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:34.735750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:34.736224 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:34.736668 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:34.872053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:34.880498 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-da04cc13-7959-4b8b-b6e3-5661b3b05e16 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1392 microversion: 2.1 time: 0.158410 Oct 10 11:50:34.881113 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3690/7270] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:34 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:35.904581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:35.905282 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:35.912145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:35.912633 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:35.913073 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:35.913764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:35.914224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:35.914648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:36.049250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:36.056839 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e81cf038-7b42-4a20-a4f3-97681c9e6fb6 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1392 microversion: 2.1 time: 0.157498 Oct 10 11:50:36.057412 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3581/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:35 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:37.080795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:37.081432 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:37.088277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:37.088781 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:37.089250 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:37.089965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:37.090441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:37.090888 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:37.225948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:37.233825 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-805ab41e-7518-483f-929e-f9c88c378808 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1392 microversion: 2.1 time: 0.157952 Oct 10 11:50:37.234449 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3691/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:37 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:37.387113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b7675b-96d9-46bd-b2df-c04a4ea34e9c", "name": "network-vif-plugged", "status": "completed", "tag": "6c438070-1bbe-4bd7-96b0-82f9ff4f92c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:37.399313 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:37.399878 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:37.400412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:37.414143 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] Creating event network-vif-plugged:6c438070-1bbe-4bd7-96b0-82f9ff4f92c4 for instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c on n-h2-860687-2 Oct 10 11:50:37.419279 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b947bd92-3589-4be5-acbf-416d912ea14b req-9e9594a0-cf53-432e-95dc-ed268873f1e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Oct 10 11:50:37.419805 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3582/7273] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:50:38.256750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:38.257385 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:38.264368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:38.264857 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:38.266215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:38.266937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:38.267442 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:38.267890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:38.399340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:38.407583 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-03cf4dd9-f056-47b5-8809-294b34dc7ade tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1392 microversion: 2.1 time: 0.154797 Oct 10 11:50:38.408151 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3692/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:38 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:39.430985 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:39.431726 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:39.438828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.439353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.439829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.440528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.440988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.441416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.572559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:39.581369 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ac5caf7-53a7-4142-8593-05f866af5d64 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1564 microversion: 2.1 time: 0.154784 Oct 10 11:50:39.581943 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3583/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:39 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:39.603464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:39.604097 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:39.611645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.612145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.612605 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.613315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:39.613788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:39.614232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:39.750834 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:39.758653 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d76b08ae-7141-428e-86c5-8c7dcbb6a6cb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1564 microversion: 2.1 time: 0.159193 Oct 10 11:50:39.759262 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3693/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:39 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:50:41.342819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:50:41.344125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:50:41.346554 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b7675b-96d9-46bd-b2df-c04a4ea34e9c", "tag": "6c438070-1bbe-4bd7-96b0-82f9ff4f92c4"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:50:41.347362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:41.348424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:41.353132 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:41.353892 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:41.354339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:41.355332 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:41.355797 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:41.356260 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:41.360068 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:41.361416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:41.366401 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:50:41.367371 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:50:41.368178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:50:41.388257 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] Creating event network-changed:6c438070-1bbe-4bd7-96b0-82f9ff4f92c4 for instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c on n-h2-860687-2 Oct 10 11:50:41.395228 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-6eefcc6d-eda6-46b5-bd0d-934c7dfa3e65 req-99176ef2-e0c4-4192-850d-c0809de8aa88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054488 Oct 10 11:50:41.396169 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3694/7277] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:50:41.509524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:50:41.517936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-115d925b-48ac-4a60-a361-4bddeeeeff05 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1564 microversion: 2.1 time: 0.179215 Oct 10 11:50:41.519036 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3584/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:50:41 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:02.772684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=32 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:02.773376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:02.774571 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:51:02.774722 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action (ip 10.222.0.16) !!! Oct 10 11:51:02.780322 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:02.782864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:02.791426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:02.791940 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:02.792407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:02.793128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:02.793609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:02.794061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:02.859404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7807f30e-4091-45c3-9878-016315041911 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action" status: 200 len: 24573 microversion: 2.1 time: 0.088542 Oct 10 11:51:02.860068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3695/7279] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:51:02 2022] POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action => generated 24573 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:13.943462 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:13.944060 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:13.945922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:13.946710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:13.954759 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:13.955270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:13.955708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:13.956397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:13.956861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:13.957306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:13.984289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lazy-loading 'flavor' on Instance uuid 51b7675b-96d9-46bd-b2df-c04a4ea34e9c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:51:14.052754 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-425262a4-4a94-4578-a555-c93dd091aa06 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action" status: 202 len: 0 microversion: 2.1 time: 0.113325 Oct 10 11:51:14.053417 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3585/7280] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:51:13 2022] POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:51:14.062655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:14.063407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:14.066314 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:14.067131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:14.073474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:14.073986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:14.074443 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:14.075274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:14.075783 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:14.077090 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:14.259350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:14.268205 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-72780542-f209-49c2-8c87-93dd2528e552 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1690 microversion: 2.1 time: 0.210354 Oct 10 11:51:14.268782 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3696/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:14 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:15.294014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:15.294709 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:15.301595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:15.302076 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:15.302495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:15.303214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:15.303665 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:15.304088 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:15.435147 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:15.443102 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdab9e26-e545-4784-acbf-a1babb386788 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1673 microversion: 2.1 time: 0.154126 Oct 10 11:51:15.443677 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3586/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:15 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:16.537937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:16.541318 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:16.549616 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.550114 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.550564 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.551300 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.551770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.552208 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.603346 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02555e02-9d6f-4e4a-bcc7-164bd057b2d9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action" status: 200 len: 38424 microversion: 2.1 time: 0.069928 Oct 10 11:51:16.603981 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3697/7283] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:51:16 2022] POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action => generated 38424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:16.616533 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:16.617079 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:16.624131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.624773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.625297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.626082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.626623 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.627077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.693101 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5931b55e-c2d4-4c94-9a0d-d7cd69a067b3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action" status: 202 len: 0 microversion: 2.1 time: 0.080302 Oct 10 11:51:16.693655 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3587/7284] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:51:16 2022] POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:51:16.703796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:16.704524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:16.712004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.712511 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.712975 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.713692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:16.714167 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:16.714609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:16.854864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:16.863719 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c6a78607-53c9-4dcd-b81d-afe16178b98f tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1679 microversion: 2.1 time: 0.165286 Oct 10 11:51:16.864307 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3698/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:16 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:51:17.889499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:17.890211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:17.896573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:17.897059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:17.897499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:17.898192 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:17.898650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:17.899099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:18.039536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:18.048362 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1452d12-fb41-4de1-907c-2f0ca6150ab9 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1679 microversion: 2.1 time: 0.164647 Oct 10 11:51:18.048951 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3588/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:17 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:19.072243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:19.072875 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:19.081009 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:19.081515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:19.081969 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:19.082680 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:19.083194 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:19.083642 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:19.219629 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:19.227502 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6fca8b90-879a-4d14-a2a4-72753b0bbccb tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1682 microversion: 2.1 time: 0.159196 Oct 10 11:51:19.228095 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3699/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:19 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:51:19.320692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:19.323066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:19.330352 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:19.330835 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:19.331310 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:19.332002 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:19.332467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:19.332880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:19.372282 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17bd5447-8955-4c6b-83f8-a5a450709d33 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action" status: 200 len: 38424 microversion: 2.1 time: 0.055338 Oct 10 11:51:19.372952 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3589/7288] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:51:19 2022] POST /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c/action => generated 38424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:20.346734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:20.348074 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b7675b-96d9-46bd-b2df-c04a4ea34e9c", "tag": "6c438070-1bbe-4bd7-96b0-82f9ff4f92c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:20.353080 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:20.359445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:20.360189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:20.360801 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:20.362571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:20.363237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:20.363755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:20.364584 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:20.365141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:20.365662 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:20.373900 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] Creating event network-changed:6c438070-1bbe-4bd7-96b0-82f9ff4f92c4 for instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c on n-h2-860687-2 Oct 10 11:51:20.381740 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e9f180b5-cffd-44ce-b1b7-5e9e0711668e req-81643294-2c3c-4085-bc51-f06de86db640 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039847 Oct 10 11:51:20.382308 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3590/7289] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:51:20.395926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:51:20.479881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cbc7cd5e-fb08-4004-9248-45f93bf24c39 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 204 len: 0 microversion: 2.1 time: 0.142570 Oct 10 11:51:20.480556 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3700/7290] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:51:20 2022] DELETE /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:51:20.490339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:20.491351 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:20.498479 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:20.499156 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:20.499604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:20.500511 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:20.500975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:20.501435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:20.642288 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:20.650170 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b5b1724-2b1c-4750-ad2c-009478c5e0f3 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1688 microversion: 2.1 time: 0.164703 Oct 10 11:51:20.650735 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3591/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:20 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:21.675254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:21.676061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:21.683033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:21.683572 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:21.684036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:21.684756 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:21.685230 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:21.686242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:21.826547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:21.834881 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2fd17d92-f9b0-4197-9a12-a27873ba5bae tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1688 microversion: 2.1 time: 0.164134 Oct 10 11:51:21.835498 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3701/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:21 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:22.747036 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b7675b-96d9-46bd-b2df-c04a4ea34e9c", "name": "network-vif-deleted", "tag": "6c438070-1bbe-4bd7-96b0-82f9ff4f92c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:22.760514 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:22.760992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:22.761420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:22.775156 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] Creating event network-vif-deleted:6c438070-1bbe-4bd7-96b0-82f9ff4f92c4 for instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c on n-h2-860687-2 Oct 10 11:51:22.780570 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9b8b73c1-f215-4687-9cc1-51443edeedda req-4596c256-63c8-46a2-8005-993a2cd323af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Oct 10 11:51:22.781209 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3592/7293] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:51:22.859869 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:22.860500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:22.867604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:22.868181 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:22.868674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:22.869400 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:22.869879 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:22.870327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:22.901854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:22.902350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:22.902796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:22.903447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lazy-loading 'fault' on Instance uuid 51b7675b-96d9-46bd-b2df-c04a4ea34e9c {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:51:22.949368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed82ea1d3cc4f28a041a6c2fb646820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37c02f22a0b4f119264b30218bd7e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:22.957493 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ecfe9e73-a609-4591-b2ec-c05e60b52574 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 200 len: 1356 microversion: 2.1 time: 0.102380 Oct 10 11:51:22.959401 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3702/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:22 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:23.981503 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:23.982390 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] [instance: 51b7675b-96d9-46bd-b2df-c04a4ea34e9c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:23.989683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:23.990179 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:23.990626 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:23.991360 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:23.991825 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:23.992259 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:24.005660 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] HTTP exception thrown: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Request method failure captured: Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c HTTP/1.1 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAWD91prSd6fyNeCxdnt8lLgn6gFXLUBlDvZPmZrMY6G2A0VxgnIB9nc8PO0OIwbUApZC4hcr81_D8TozNGpA4TRircP2DQlbvETim0gTpPFXTcJ49800Hwq1xVHHDmF1BJcIO5UX59rDFowIbXDyiiARepiQrXty2YNxLVdj4DnSWs Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e37c02f22a0b4f119264b30218bd7e68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e37c02f22a0b4f119264b30218bd7e68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e37c02f22a0b4f119264b30218bd7e68"}]}] Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: e37c02f22a0b4f119264b30218bd7e68 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1235898784 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 5ed82ea1d3cc4f28a041a6c2fb646820 Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1235898784-project Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '51b7675b-96d9-46bd-b2df-c04a4ea34e9c'} Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:51:24.007321 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Returning 404 to user: Instance 51b7675b-96d9-46bd-b2df-c04a4ea34e9c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84dd67ac-c81b-4515-86c2-60a944750b0b tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c" status: 404 len: 111 microversion: 2.1 time: 0.031499 Oct 10 11:51:24.012646 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3593/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:23 2022] GET /compute/v2.1/servers/51b7675b-96d9-46bd-b2df-c04a4ea34e9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:51:27.281109 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-2a74947f-2857-440e-be20-92a8992f03f0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] Calling method '.version_select at 0x7f67778391f0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:27.308730 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-2a74947f-2857-440e-be20-92a8992f03f0 tempest-TestNetworkAdvancedServerOps-1235898784 tempest-TestNetworkAdvancedServerOps-1235898784-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1963188967" status: 202 len: 0 microversion: 2.1 time: 0.031940 Oct 10 11:51:27.310143 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3703/7296] 10.222.0.16 () {58 vars in 1284 bytes} [Mon Oct 10 11:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1963188967 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:51:38.410097 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.411293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.643565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5c20f74-44d6-476e-91c3-fe52ac039697 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'create', calling method: .version_select at 0x7f6780d77ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-196690064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkOT87eqN++P4qQyLe9krhTUTVkDk3ZeH8cj6iAbGA03b+ep6RU8KNN2HHJO1Ck112AHyTXPbqNGBoYySGRRblYsBkcvnAq0Snvr/5gmyB7m6+16YvXbJ4Rm7QTsESczg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:38.660272 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a5c20f74-44d6-476e-91c3-fe52ac039697 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for project 9dab82014b634fc682ab38d61f5a648b. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:51:38.666934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a5c20f74-44d6-476e-91c3-fe52ac039697 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for user 39327f171a7b45e2890043720fe24000 and project 9dab82014b634fc682ab38d61f5a648b. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:51:38.695129 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5c20f74-44d6-476e-91c3-fe52ac039697 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290998 Oct 10 11:51:38.695734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3594/7297] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:51:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:51:39.719403 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:39.720317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:39.724590 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-339918242", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-196690064", "security_groups": [{"name": "tempest-secgroup-smoke-1490188222"}], "networks": [{"uuid": "73e76462-8157-4338-99b8-29d125a31fc1"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:39.848671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] validate_networks() for [('73e76462-8157-4338-99b8-29d125a31fc1', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:51:40.329368 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:51:40.329881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:51:40.330655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:51:40.331140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:51:40.331963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:51:40.343029 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:40.343846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:40.344270 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:40.345158 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:40.345966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:40.346416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:40.366474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for project 9dab82014b634fc682ab38d61f5a648b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:51:40.372048 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for user 39327f171a7b45e2890043720fe24000 and project 9dab82014b634fc682ab38d61f5a648b. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:51:40.386061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:51:40.388519 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:51:40.438324 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-792a7880-1d3f-4157-b5c1-490fc5e9ac13 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720575 Oct 10 11:51:40.439042 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3704/7298] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:51:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:51:40.452110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f3dceaf-ce44-4883-bb0c-07bcc728e5ef tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:40.452816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f3dceaf-ce44-4883-bb0c-07bcc728e5ef tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:40.510467 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f3dceaf-ce44-4883-bb0c-07bcc728e5ef tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:40.520585 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f3dceaf-ce44-4883-bb0c-07bcc728e5ef tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1245 microversion: 2.1 time: 0.074146 Oct 10 11:51:40.521809 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3595/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:40 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:41.547899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:41.549340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:41.557475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:41.558099 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:41.558623 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:41.559718 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:41.560710 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:41.561161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:41.682854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:41.695175 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4e8b1183-904a-4027-899f-effbe5c640dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1305 microversion: 2.1 time: 0.155055 Oct 10 11:51:41.710901 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3705/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:41 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:42.718563 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:42.719788 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:42.727553 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:42.728265 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:42.729482 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:42.730188 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:42.730841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:42.731312 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:42.999289 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:43.008421 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d6de286-9946-40f3-8f5e-7b0bd97ac3f7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.293800 Oct 10 11:51:43.009155 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3596/7301] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:42 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:43.228925 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:43.241036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:43.241676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:43.242137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:43.258932 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] Creating event network-changed:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h2-860687-2 Oct 10 11:51:43.265444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c98dc54a-60da-4a0e-a799-d614c136d9cf req-9cc7819f-dc3d-4e0b-aa5b-4e9dcfc33b7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040403 Oct 10 11:51:43.266071 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3706/7302] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:51:44.031145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:44.031697 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:44.038798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:44.039333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:44.039779 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:44.040488 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:44.040950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:44.041387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:44.181184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:44.189936 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5578afd-f391-426b-99f6-259e43063628 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.162939 Oct 10 11:51:44.190504 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3597/7303] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:44 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:45.214419 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:45.215028 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:45.221768 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:45.222272 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:45.222742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:45.223487 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:45.223954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:45.224396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:45.360643 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:45.368489 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-61b2ebbb-9bc3-4cda-b0ed-1db2b39375c2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.159295 Oct 10 11:51:45.369058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3707/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:45 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:46.392228 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:46.392850 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:46.400276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:46.400855 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:46.401304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:46.402040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:46.402600 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:46.403052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:46.540929 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:46.549486 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b04d8c7-fe96-48bb-bc4f-1f3a3bcf4ab0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.161559 Oct 10 11:51:46.550076 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3598/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:46 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:47.572926 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:47.573474 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:47.581173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:47.581672 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:47.582121 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:47.583100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:47.583307 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:47.583745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:47.720010 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:47.727691 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ab4d24f5-2ff8-450d-93ac-41b81ff344dd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.158725 Oct 10 11:51:47.728477 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3708/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:47 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:47.742229 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "name": "network-vif-plugged", "status": "completed", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:47.754184 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:47.755486 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:47.755950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:47.767729 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] Creating event network-vif-plugged:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h2-860687-2 Oct 10 11:51:47.773220 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-64617c29-a22e-4922-9e5f-59c126216c91 req-ee09ec22-5feb-47bd-8880-6104cd56dd1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Oct 10 11:51:47.774009 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3599/7307] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:51:48.751600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:48.752232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:48.759045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:48.759547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:48.759999 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:48.760697 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:48.761165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:48.761604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:48.897278 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:48.906118 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-53d91515-ded0-4294-a648-ecacb5d6c119 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1371 microversion: 2.1 time: 0.158735 Oct 10 11:51:48.906711 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3709/7308] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:48 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:49.929557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:49.930295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:49.937583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:49.938069 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:49.938515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:49.939256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:49.939721 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:49.940161 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:50.073211 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:50.082295 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91bff7af-900d-4cf3-bcf5-cc36501c2097 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1556 microversion: 2.1 time: 0.157043 Oct 10 11:51:50.082882 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3600/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:49 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:50.105440 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:51:50.106587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:51:50.113513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:50.114014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:50.114469 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:50.115207 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:50.115684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:50.116128 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:50.252164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:51:50.259905 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-683dee65-95ab-469c-9986-0addd2741b22 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1556 microversion: 2.1 time: 0.158288 Oct 10 11:51:50.260480 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3710/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:51:50 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:51:51.907727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:51:51.912800 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:51.919595 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:51:51.920149 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:51:51.920589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:51:51.931780 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] Creating event network-changed:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h2-860687-2 Oct 10 11:51:51.937264 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-712753f8-5587-40c6-bf51-1680df4632a1 req-f5cd70a0-2bd6-4991-b4c6-8880a378389f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033772 Oct 10 11:51:51.937861 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3601/7311] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:53:47.318499 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 11:53:47.319088 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.319691 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.320772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.321518 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=34 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.326655 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:53:47.327243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:47.336992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:47.337566 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:47.338120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:47.338824 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:47.339320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:47.339760 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:47.365679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lazy-loading 'flavor' on Instance uuid 60e830fe-a2ee-44b3-8703-a5e2392e057f {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:53:47.554160 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba2a1971-08bf-4c94-887d-a29831f8626e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f/action" status: 202 len: 0 microversion: 2.1 time: 0.238853 Oct 10 11:53:47.554755 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3711/7312] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:53:47 2022] POST /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 11:53:47.561451 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 10 11:53:47.562371 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 10 11:53:47.562926 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.563832 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:47.565651 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 11:53:47.565824 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f (ip 10.222.0.16) !!! Oct 10 11:53:47.567622 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:53:47.567622 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f (ip 10.222.0.16) !!! Oct 10 11:53:47.574297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:47.575186 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:47.586338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:47.586831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:47.587298 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:47.588033 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:47.588495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:47.588923 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:47.787309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:47.795650 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3fc0fe8-eed4-465b-9992-a3660d5ae33f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.235953 Oct 10 11:53:47.796207 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3602/7313] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:47 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:48.821838 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:48.822476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:48.830850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:48.831380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:48.831836 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:48.832715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:48.833289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:48.833722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:48.839186 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45196. Oct 10 11:53:48.972922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:48.980756 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d13404f8-c02b-48f4-9ae7-aa0a61800153 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.165064 Oct 10 11:53:48.981344 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3712/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:48 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:50.004870 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:50.005540 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:50.018191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:50.018694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:50.019207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:50.021007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:50.021480 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:50.021947 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:50.026387 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45200. Oct 10 11:53:50.029391 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45202. Oct 10 11:53:50.153567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:50.161606 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7cdd480-0fbf-4ac1-bde9-548076b9a037 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.161321 Oct 10 11:53:50.162176 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3603/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:49 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:51.185409 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:51.186072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:51.193405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:51.193919 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:51.194380 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:51.195119 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:51.195600 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:51.196046 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:51.330003 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:51.338496 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-41ad6e19-8ea7-4a6d-9d9c-797c2532633b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.157087 Oct 10 11:53:51.339092 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3713/7316] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:51 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:52.362545 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:52.363116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:52.371017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:52.371523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:52.371967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:52.372678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:52.373142 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:52.373611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:52.503829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:52.512130 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af4d9ec0-9121-4d8c-a46e-17c63fb26d3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.153535 Oct 10 11:53:52.512708 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3604/7317] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:52 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:53.536679 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:53.537320 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:53.544288 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:53.544788 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:53.545243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:53.545977 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:53.546452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:53.546895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:53.680493 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:53.688289 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-290d14f6-3ac0-4fcb-807b-5164605cd05e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.155946 Oct 10 11:53:53.688863 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3714/7318] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:53 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:54.713667 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:54.714214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:54.721011 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:54.721490 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:54.721922 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:54.722628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:54.723133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:54.723575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:54.852831 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:54.860574 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-555b9d4e-66eb-4e89-abae-02e6c02fe99e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.150912 Oct 10 11:53:54.861149 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3605/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:54 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:55.884120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:55.884822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:55.891852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:55.892360 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:55.892822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:55.893578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:55.894061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:55.894512 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:56.024811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:56.032561 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cb934965-5401-4341-b632-1c1f4c302b87 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.152376 Oct 10 11:53:56.033141 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3715/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:55 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:57.055824 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:57.056451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:57.063283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:57.063773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:57.064214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:57.064902 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:57.065362 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:57.065789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:57.197301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:57.205463 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4297d9e7-b017-4ebd-bd30-486d1107fc66 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.153508 Oct 10 11:53:57.206048 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3606/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:57 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:58.230363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:58.230993 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:58.238005 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:58.239682 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:58.240149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:58.240864 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:58.241340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:58.241787 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:58.373388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:58.381275 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-71f7e1c1-2dac-4fd8-b2bc-7d735e0b4377 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1701 microversion: 2.1 time: 0.154762 Oct 10 11:53:58.381776 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3716/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:58 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:53:59.405543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:53:59.406162 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:53:59.413899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:59.414387 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:59.414828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:59.415555 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:53:59.416015 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:53:59.416443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:53:59.556735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:53:59.564621 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5dc509de-f6c4-4871-b33e-896e0091842f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1701 microversion: 2.1 time: 0.162946 Oct 10 11:53:59.565139 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3607/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:53:59 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:00.589372 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:00.591120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:00.600098 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:00.601398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:00.602101 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:00.606805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:00.608215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:00.608683 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:00.776705 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:00.786259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-413b7fe4-aea8-4b0e-abe6-bba473c54d77 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.200194 Oct 10 11:54:00.787442 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3717/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:00 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:00.834504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "name": "network-vif-plugged", "status": "completed", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:54:00.853556 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:00.853955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:00.854582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:00.869829 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] Creating event network-vif-plugged:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h2-860687-2 Oct 10 11:54:00.873714 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] [b4031ee1-a95f-4d2b-99a8-ae022837f7a2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:54:01.819089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:01.820587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:01.827970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:01.828478 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:01.828931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:01.829648 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:01.830145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:01.830620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:01.881955 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] [b4031ee1-a95f-4d2b-99a8-ae022837f7a2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45256. Oct 10 11:54:01.886171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f9d94b94-4a4e-41b6-a3b0-d7a808795088 req-1b7507f6-5d41-4c5f-a069-cf2a750cc119 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.143288 Oct 10 11:54:01.886793 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3608/7325] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:54:01.990220 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:01.999082 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-0abb4b9b-de36-4cea-8d5d-d9b6712eb941 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.184010 Oct 10 11:54:02.007039 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3718/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:01 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:54:03.028597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:03.029742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:03.037829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:03.038426 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:03.039154 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:03.039969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:03.040445 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:03.040884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:03.196117 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:03.204540 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70aeb3cb-1719-4439-9193-aba23aca4ae8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.181589 Oct 10 11:54:03.205330 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3609/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:03 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:04.229578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:04.230311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:04.237546 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:04.238045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:04.240094 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:04.240992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:04.241477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:04.241931 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:04.388276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:04.396837 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-3ba171fe-c040-4e30-b612-e4b493df5e03 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.171305 Oct 10 11:54:04.397981 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3719/7328] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:04 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:05.420597 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:05.421416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:05.430250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:05.430744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:05.431432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:05.432144 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:05.432602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:05.433059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:05.579424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:05.591299 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbf6e89c-84d4-4fc3-8d32-e6848cb38b6e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.174654 Oct 10 11:54:05.592797 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3610/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:05 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:06.616517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:06.617162 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:06.624405 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:06.624909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:06.625418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:06.626061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:06.626527 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:06.626965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:06.770397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:06.779801 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a25cdbbf-00f8-4f50-8088-b5e577fe7cae tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.167300 Oct 10 11:54:06.791093 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3720/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:06 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:07.803670 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:07.804507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:07.811920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:07.812504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:07.813059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:07.814007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:07.814606 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:07.815224 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:07.973279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:07.984339 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0c85f8e-c125-4668-b0e8-77baec449191 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.184591 Oct 10 11:54:07.985098 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3611/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:07 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:09.010972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:09.011647 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:09.019015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:09.019755 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:09.020733 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:09.021540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:09.022120 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:09.022656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:09.168866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:09.179392 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-89756858-bcae-4041-a193-083be6e5c04f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1696 microversion: 2.1 time: 0.172176 Oct 10 11:54:09.195974 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3721/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:09 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:10.204657 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:10.205515 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:10.212910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:10.213398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:10.213848 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:10.214544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:10.215026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:10.215476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:10.460245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:10.468022 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdb48dbb-81ec-4206-874e-032e20ef8170 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1678 microversion: 2.1 time: 0.267524 Oct 10 11:54:10.468599 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3612/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:10 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:11.492431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:11.493058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:11.499952 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:11.500449 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:11.500895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:11.501594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:11.502060 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:11.502496 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:11.631822 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:11.639606 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b081a620-5898-463b-bb1c-4f02e9af1858 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1678 microversion: 2.1 time: 0.151204 Oct 10 11:54:11.640181 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3722/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:11 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:12.594366 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "name": "network-vif-unplugged", "status": "completed", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:54:12.607153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.607645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.608081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:12.621997 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] Creating event network-vif-unplugged:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h2-860687-2 Oct 10 11:54:12.627649 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2d225f54-bc51-45ee-803b-afc1dcb70403 req-bedd7a9d-16bd-4526-82ca-0b46f0b32aae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037020 Oct 10 11:54:12.628255 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3613/7335] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:54:12.665757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:12.666294 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:12.673189 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.673695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.674161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:12.674868 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.675366 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.676277 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:12.809638 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:12.817444 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4f2fa479-0bc7-40d8-a03b-07cb7c3f9ed8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1681 microversion: 2.1 time: 0.158423 Oct 10 11:54:12.818013 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3723/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:12 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:12.842905 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:54:12.843767 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:12.850783 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.851302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.851828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:12.852614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.853077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.853508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:12.911253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 11:54:12.979301 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1a0d477-79e8-4bd6-b655-816a0e092495 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f/action" status: 202 len: 0 microversion: 2.1 time: 0.140659 Oct 10 11:54:12.983137 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3614/7337] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:54:12 2022] POST /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:54:12.989591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:12.990348 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:12.998065 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:12.998614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:12.999126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:13.000002 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:13.000607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:13.001178 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:13.141828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:13.150596 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-790f0bde-34ac-4946-81f5-ff405f15c16e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1629 microversion: 2.1 time: 0.166077 Oct 10 11:54:13.151222 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3724/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:12 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1629 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:14.174662 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:14.175308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:14.181950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:14.182423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:14.182857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:14.183575 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:14.184029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:14.184451 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:14.317210 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:14.325132 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd331481-fab8-4854-9c23-ab0630177360 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.155353 Oct 10 11:54:14.325706 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3615/7339] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:14 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:15.249406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:54:15.260164 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:15.260656 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:15.261095 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:15.273413 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] Creating event network-changed:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h1-860687-2 Oct 10 11:54:15.278440 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-a943bb1e-7c1b-4925-8b51-d19f0333f09d req-1d5869c0-0f7f-4c86-a142-8d82b09eaefc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098410 Oct 10 11:54:15.279068 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3725/7340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 11:54:15.349333 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:15.349955 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:15.357195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:15.357700 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:15.358171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:15.358885 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:15.359381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:15.359809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:15.498984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:15.508426 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6139314e-b274-4c9a-9e3c-0c2d5a004894 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.163539 Oct 10 11:54:15.508939 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3616/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:15 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:16.533477 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:16.534190 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:16.551883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:16.557611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:16.558500 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:16.559540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:16.560239 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:16.560892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:16.567573 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:16.736125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:16.745901 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5898382b-f23f-411d-858c-4e0b8ce1badb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.217554 Oct 10 11:54:16.746895 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3726/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:16 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:17.770386 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:17.771081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:17.773904 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:17.779961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:17.780466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:17.780912 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:17.781620 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:17.782256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:17.782851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:17.786529 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:17.948646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:17.957544 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39e89f95-f164-4278-876d-a58371dbb2d3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.191623 Oct 10 11:54:17.958665 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3617/7343] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:17 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:18.981618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:18.982254 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:18.984674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=33 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:18.990350 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:18.990846 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:18.991333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:18.992042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:18.992513 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:18.992964 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:19.135472 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:19.143555 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b4d698cd-c75c-4be8-920a-aa1bbe958e2c tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.165636 Oct 10 11:54:19.144135 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3727/7344] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:18 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:20.167109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:20.168558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:20.175438 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:20.176276 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:20.177637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:20.178632 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:20.179353 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:20.180006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:20.323356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:20.332737 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edc1f362-f924-4d7a-b29d-12af5b45129f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.169581 Oct 10 11:54:20.343055 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3618/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:20 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:21.356251 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:21.356907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:21.365881 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:21.366506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:21.367078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:21.367849 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:21.368327 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:21.368776 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:21.534448 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:21.545994 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be91ad72-e3a5-467d-b042-207cdee7c348 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.193693 Oct 10 11:54:21.546587 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3728/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:21 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:22.572868 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:22.573476 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:22.580517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:22.580997 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:22.581430 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:22.582112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:22.582566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:22.583031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:22.740618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:22.749805 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4bc52250-8b5d-49bb-b3cb-ab08f2f36433 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.180814 Oct 10 11:54:22.750594 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3619/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:22 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:23.773867 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:23.774750 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:23.781896 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:23.782402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:23.782860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:23.783695 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:23.784174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:23.784619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:24.017866 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:24.027270 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c50c55b-2b81-4ccb-9fe0-23dddda16e27 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.257378 Oct 10 11:54:24.028171 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3729/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:23 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:25.050745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:25.051377 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:25.058975 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:25.059496 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:25.059939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:25.060644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:25.061109 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:25.061546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:25.195641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:25.204087 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b4a344e-3137-4f5a-b6a4-fc5452a42721 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.157270 Oct 10 11:54:25.204678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3620/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:25 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:26.228293 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:26.228956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:26.235851 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:26.236353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:26.236904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:26.237609 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:26.238084 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:26.238528 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:26.375199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:26.383626 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4351ed78-9c45-4b03-84cd-d9afd3e89944 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.159884 Oct 10 11:54:26.384209 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3730/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:26 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:27.406220 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:27.406827 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:27.413816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:27.414297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:27.414729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:27.415448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:27.415899 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:27.416325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:27.546359 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:27.554634 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-810e217d-a6da-48f5-a70d-b64fdb69268d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.152275 Oct 10 11:54:27.555235 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3621/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:27 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:28.571709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "name": "network-vif-plugged", "status": "completed", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:54:28.580058 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:28.581704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:28.584186 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:28.584690 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:28.585143 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:28.588901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:28.589624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:28.590066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:28.590764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:28.591280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:28.591704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:28.600449 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] Creating event network-vif-plugged:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h1-860687-2 Oct 10 11:54:28.605656 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e56628d6-d98e-47a5-a0a2-eb47162a45c6 req-c014b981-3247-469f-aa3a-9659221ff5dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038576 Oct 10 11:54:28.606594 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3731/7352] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:54:28.728764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:28.736791 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0add3bd3-14a2-43b4-b796-ff7a6bbf5a0a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.161940 Oct 10 11:54:28.737374 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3622/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:28 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:54:29.762092 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:29.762811 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:29.768971 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:29.769475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:29.769928 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:29.770863 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:29.771137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:29.771579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:29.912871 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:29.920767 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-874b130d-ecdc-4294-89de-5d673568c296 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1687 microversion: 2.1 time: 0.163908 Oct 10 11:54:29.921709 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3732/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:29 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:54:30.945013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:54:30.945618 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:54:30.952799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:30.953315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:30.953751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:30.954431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:54:30.954881 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:54:30.955338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:54:31.085715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:54:31.093377 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7428de32-d94a-42d7-baff-5707eeba4137 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1674 microversion: 2.1 time: 0.152890 Oct 10 11:54:31.093948 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3623/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:54:30 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:55:41.698904 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=11 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:41.700259 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=36 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:41.700857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=13 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:41.701833 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:55:41.701983 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:55:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f (ip 10.222.0.16) !!! Oct 10 11:55:41.702110 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=41 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:41.703649 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 11:55:41.703777 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:55:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f (ip 10.222.0.16) !!! Oct 10 11:55:41.713531 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:55:41.714077 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:55:41.723384 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:41.723895 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:41.724362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:41.725754 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:41.726599 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:41.727081 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:41.757161 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Going to try to terminate instance {{(pid=128800) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 11:55:41.771135 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:55:41.781874 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:41.782708 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:41.783171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:41.795256 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] Creating event network-changed:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h1-860687-2 Oct 10 11:55:41.802493 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ccb97c6-7868-441e-9dae-9f9908f1804b req-9bb62f8f-9593-475f-8397-38478b50101c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102619 Oct 10 11:55:41.803387 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3624/7356] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:55:41.841324 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cfd7e308-6bb9-4c12-831c-74b45cb5c685 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 204 len: 0 microversion: 2.1 time: 0.144193 Oct 10 11:55:41.845305 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3733/7357] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 11:55:41 2022] DELETE /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 11:55:41.856245 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:55:41.858202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:55:41.865805 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:41.866437 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:41.866871 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:41.867641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:41.868089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:41.868512 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:42.011374 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:55:42.019357 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3aefa71-8c70-4bbc-bbbb-79c84fcde72e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.169363 Oct 10 11:55:42.020024 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3625/7358] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:55:41 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:55:43.042532 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:55:43.043301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:55:43.050374 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:43.050890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:43.051425 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:43.052147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:43.052630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:43.053122 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:43.225853 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:55:43.236037 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9626a8a7-25c0-4887-8cf9-bade61e36338 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 200 len: 1680 microversion: 2.1 time: 0.197930 Oct 10 11:55:43.236721 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3734/7359] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:55:43 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:55:43.817789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e830fe-a2ee-44b3-8703-a5e2392e057f", "name": "network-vif-deleted", "tag": "1e621f27-4452-45fe-99d2-1d906f20bf45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:55:43.828636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:43.829107 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:43.829535 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:43.840282 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] Creating event network-vif-deleted:1e621f27-4452-45fe-99d2-1d906f20bf45 for instance 60e830fe-a2ee-44b3-8703-a5e2392e057f on n-h1-860687-2 Oct 10 11:55:43.845033 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-342fca6c-c7cb-4378-aeb6-1ac52b92fdf8 req-5ac2fab2-13ea-4a0f-ab74-6cb1e4e7493a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Oct 10 11:55:43.845608 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3626/7360] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:55:44.261581 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:55:44.262145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 60e830fe-a2ee-44b3-8703-a5e2392e057f] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:55:44.269072 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:44.269578 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:44.270036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:44.270759 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:55:44.271273 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:55:44.271721 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:55:44.286428 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] HTTP exception thrown: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Request method failure captured: Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f HTTP/1.1 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAdFy8YJLlnJ0T3Fkzo_QXam-rkUnSlMYVPKf4SDT38-wEtBMqNB-Lan5y8FczFKTrKqnFOvOloaMrt6yeg_2C_mDc5o_83Lwzs-tDsQe12-yMzAAfyjpv9kp7Z-2-DahG7GjJ87udeRPUSo3Mh_L85GHR1agOUsQmbvCGP4Yflwghk Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 9dab82014b634fc682ab38d61f5a648b Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestShelveInstance-1866318891 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dab82014b634fc682ab38d61f5a648b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dab82014b634fc682ab38d61f5a648b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dab82014b634fc682ab38d61f5a648b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dab82014b634fc682ab38d61f5a648b"}]}] Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestShelveInstance-1866318891 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 9dab82014b634fc682ab38d61f5a648b Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestShelveInstance-1866318891 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestShelveInstance-1866318891-project Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: 39327f171a7b45e2890043720fe24000 Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestShelveInstance-1866318891-project Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '60e830fe-a2ee-44b3-8703-a5e2392e057f'} Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 11:55:44.288258 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Returning 404 to user: Instance 60e830fe-a2ee-44b3-8703-a5e2392e057f could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5ac106cb-218c-45fc-8a02-1ae61e368c3e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f" status: 404 len: 111 microversion: 2.1 time: 0.032173 Oct 10 11:55:44.293459 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3735/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:55:44 2022] GET /compute/v2.1/servers/60e830fe-a2ee-44b3-8703-a5e2392e057f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 11:55:44.456990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5716f9ad-6eb0-46a8-9997-4d9aefd26fb7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '.version_select at 0x7f6780cd6820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:55:44.480728 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5716f9ad-6eb0-46a8-9997-4d9aefd26fb7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-196690064" status: 202 len: 0 microversion: 2.1 time: 0.028201 Oct 10 11:55:44.481345 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3627/7362] 10.222.0.16 () {58 vars in 1251 bytes} [Mon Oct 10 11:55:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-196690064 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:55:44.505970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-36e5e115-ed91-4d6d-b8a7-839a9be15c25 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'create', calling method: .version_select at 0x7f6780c7d790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1578255422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAChXq+VsWOH/nL2hZH37ai0OeOkwa+UObunxYyKPq3BtuvKG046bPynT8RYf1XTh3cgWU+QRZIQNzs/NfZCP743txO1AoYjwx252fsZzYXpYgCA2yXpMAxvW3uGPPIMLA=="}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:55:44.521297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-36e5e115-ed91-4d6d-b8a7-839a9be15c25 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for project 9dab82014b634fc682ab38d61f5a648b. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:55:44.526456 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-36e5e115-ed91-4d6d-b8a7-839a9be15c25 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for user 39327f171a7b45e2890043720fe24000 and project 9dab82014b634fc682ab38d61f5a648b. Resources: {'key_pairs'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:55:44.553902 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-36e5e115-ed91-4d6d-b8a7-839a9be15c25 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.051497 Oct 10 11:55:44.554434 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3736/7363] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 11:55:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:56:00.710554 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:00.711474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:00.717651 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-888137075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1578255422", "security_groups": [{"name": "tempest-secgroup-smoke-890675531"}], "networks": [{"uuid": "73e76462-8157-4338-99b8-29d125a31fc1"}], "block_device_mapping_v2": [{"uuid": "9319105f-00e2-4e6b-93f4-5a2f6b8fe280", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:56:00.842734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] validate_networks() for [('73e76462-8157-4338-99b8-29d125a31fc1', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 11:56:01.338594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 11:56:01.339059 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 11:56:01.339538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 11:56:01.339979 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 11:56:01.341246 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 11:56:01.352052 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:01.352536 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:01.352984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:01.353720 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:01.354336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:01.354774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:01.375774 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for project 9dab82014b634fc682ab38d61f5a648b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 11:56:01.382177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Getting quotas for user 39327f171a7b45e2890043720fe24000 and project 9dab82014b634fc682ab38d61f5a648b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 11:56:01.450901 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 11:56:01.453558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9319105f-00e2-4e6b-93f4-5a2f6b8fe280',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 11:56:01.585925 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bf9acb7-a6fc-4415-abf4-f1a28c0cdc73 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.877213 Oct 10 11:56:01.586586 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3628/7364] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 11:56:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 11:56:01.595804 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:01.596692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=4 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:01.597265 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:01.602363 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8600ef06-601b-4ca6-8bce-eae84ffc7dbc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:01.603026 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8600ef06-601b-4ca6-8bce-eae84ffc7dbc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:01.663966 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8600ef06-601b-4ca6-8bce-eae84ffc7dbc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:01.671362 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8600ef06-601b-4ca6-8bce-eae84ffc7dbc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1088 microversion: 2.1 time: 0.077391 Oct 10 11:56:01.671938 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3737/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:01 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:02.696068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:02.696837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:02.704495 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:02.705077 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:02.705715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:02.706518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:02.707106 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:02.707654 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:02.812171 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:02.821552 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea1b6024-bca4-46c5-8783-c2cd094c5615 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1204 microversion: 2.1 time: 0.130225 Oct 10 11:56:02.828923 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3629/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:02 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1204 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:03.846669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:03.847711 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:03.855765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:03.856911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:03.857397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:03.858311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:03.858992 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:03.859461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:04.063398 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:04.072320 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-d221af9f-0d2a-48fa-9b0c-648d7526038d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1271 microversion: 2.1 time: 0.229981 Oct 10 11:56:04.087613 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3738/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:03 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:04.091916 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:56:04.105485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:04.106642 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:04.107383 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:04.121732 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] Creating event network-changed:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h2-860687-2 Oct 10 11:56:04.127250 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6fa4e949-57d7-4515-9d82-a560a6b234ea req-826f5190-bf25-44cb-a36b-41b2bfc1f4db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043900 Oct 10 11:56:04.128204 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3630/7368] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:56:05.096067 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:05.096724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:05.104850 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:05.105353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:05.105805 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:05.106515 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:05.106986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:05.107479 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:05.245135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:05.253186 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-be8ef849-a4bf-406f-b572-ca01dd95d2b2 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1271 microversion: 2.1 time: 0.160972 Oct 10 11:56:05.253774 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3739/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:05 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:56:06.277582 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:06.278287 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:06.284616 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:06.285103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:06.285543 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:06.286235 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:06.286692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:06.287769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:06.425786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:06.434419 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ff9fccc-4ddf-4958-b9c0-273817c69229 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1271 microversion: 2.1 time: 0.161907 Oct 10 11:56:06.435120 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3631/7370] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:06 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:56:07.457889 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:07.458617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:07.465827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:07.466464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:07.466954 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:07.467744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:07.468236 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:07.468681 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:07.609860 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:07.617981 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e05d38a7-8bd4-4bea-aab9-e267ca4169dc tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1271 microversion: 2.1 time: 0.163948 Oct 10 11:56:07.618583 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3740/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:07 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:08.641596 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:08.642226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:08.648990 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:08.649477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:08.649910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:08.650594 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:08.651075 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:08.651499 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:08.779434 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:08.787166 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-742b2823-eead-45a8-b884-215b20d4096a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.149470 Oct 10 11:56:08.787724 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3632/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:08 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:09.809743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:09.810392 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:09.817302 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:09.817812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:09.818807 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:09.819557 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:09.820047 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:09.820843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:09.954311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:09.962689 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-83e04315-8ea2-4943-b58c-3642d0cdd1b7 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.156894 Oct 10 11:56:09.963300 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3741/7373] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:09 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:10.985684 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:10.986302 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:10.993466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:10.993954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:10.994400 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:10.995125 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:10.995581 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:10.996007 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:11.126880 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:11.135111 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a0f4b82-b2d3-46cf-8f84-33d43abddaa4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.152927 Oct 10 11:56:11.135301 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3633/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:10 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:56:12.157920 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:12.158549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:12.161289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:12.166466 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:12.166963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:12.167439 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:12.168141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:12.168607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:12.169044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:12.299597 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:12.307766 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-b722649c-d6f4-4769-9204-a65593f0f823 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.153734 Oct 10 11:56:12.308337 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3742/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:12 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:13.331487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:13.332023 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:13.334008 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:13.334754 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:13.341872 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:13.342354 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:13.342789 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:13.343504 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:13.343954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:13.344373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:13.483528 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:13.491332 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56632f7b-d79b-4751-98f5-cf70e0b4b213 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.164340 Oct 10 11:56:13.493089 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3634/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:13 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:14.515017 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:14.515652 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:14.522423 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:14.523571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:14.524106 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:14.524808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:14.525276 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:14.525715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:14.724452 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:14.732388 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-9889eb34-7b5f-405c-a037-15155ea9d799 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.221359 Oct 10 11:56:14.732965 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3743/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:14 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:15.755934 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:15.756558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:15.763593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:15.764082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:15.764519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:15.765218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:15.765677 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:15.766103 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:15.895424 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:15.903952 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4a10c35-8587-42a8-a7c6-33fed06adf57 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.151929 Oct 10 11:56:15.904833 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3635/7378] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:15 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:16.927949 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:16.928579 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:16.936396 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:16.936907 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:16.937454 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:16.938165 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:16.938637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:16.939118 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:17.071056 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:17.079145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33eff27d-6c53-40d1-983c-d2ab31caf6d4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.155019 Oct 10 11:56:17.079727 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3744/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:16 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:17.202131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "name": "network-vif-plugged", "status": "completed", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:56:17.213267 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:17.213760 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:17.214194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:17.225329 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] Creating event network-vif-plugged:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h2-860687-2 Oct 10 11:56:17.234514 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2c65aab0-1c27-407b-b7bb-405c6692f390 req-77f7e81c-e16d-4bc2-934c-e779b230f5c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Oct 10 11:56:17.235344 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3636/7380] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:56:18.102231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:18.102861 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:18.109751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:18.110247 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:18.110694 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:18.111431 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:18.111899 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:18.112335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:18.564506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:18.572501 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-45b1ca01-b157-43d0-ad0a-13e8f9cb8fd3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1259 microversion: 2.1 time: 0.474737 Oct 10 11:56:18.573075 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3745/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:18 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1259 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:19.597283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:19.597995 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:19.605336 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:19.605828 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:19.606271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:19.606966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:19.607452 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:19.607884 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:19.736232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:19.744161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19cc1c61-4e52-49f3-ad73-03f12c30eecd tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1444 microversion: 2.1 time: 0.151994 Oct 10 11:56:19.744730 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3637/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:19 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:19.766475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:56:19.767130 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:56:19.774427 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:19.774923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:19.775436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:19.776135 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:19.776604 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:19.777042 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:19.908356 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:56:19.916921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-57d9d51c-dd7a-419b-a777-1ddb8323574f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1444 microversion: 2.1 time: 0.154271 Oct 10 11:56:19.917505 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3746/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:56:19 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:56:21.524903 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:56:21.534487 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:56:21.534974 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:56:21.535427 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:56:21.546653 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] Creating event network-changed:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h2-860687-2 Oct 10 11:56:21.551734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e579ea4c-99b8-4234-bbe3-a029f6157c5a req-578d70f9-9e80-44c3-b70d-a5ab31854b08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Oct 10 11:56:21.552340 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3638/7384] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:58:16.658436 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 11:58:16.659377 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae54b8db-78d8-49ee-b350-67dfad20890c] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 11:58:16.660210 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=22 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:16.660961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=54 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:16.662316 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 11:58:16.662467 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 11:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395/action (ip 10.222.0.16) !!! Oct 10 11:58:16.729671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:58:16.730222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:16.736173 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:16.736666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:16.737274 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:16.737816 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:16.738614 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:16.738744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:16.762937 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.objects.instance [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lazy-loading 'flavor' on Instance uuid 94208657-3ebf-4cc1-8b49-aae844612395 {{(pid=128800) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 11:58:16.836368 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6c6f7097-6eb5-4494-9680-554eda826daa tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395/action" status: 202 len: 0 microversion: 2.1 time: 0.179495 Oct 10 11:58:16.836972 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3747/7385] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:58:16 2022] POST /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:58:16.843410 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:58:16.844225 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 11:58:16.844810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:16.845541 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=50 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:16.847476 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 11:58:16.848170 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 11:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 (ip 10.222.0.16) !!! Oct 10 11:58:16.854776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:16.855648 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:16.865412 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:16.865896 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:16.866364 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:16.867095 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:16.867562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:16.867980 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:17.006299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:17.014039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3413a77-0b63-41a0-9480-88d951b43b4a tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.172685 Oct 10 11:58:17.014613 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3639/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:16 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:18.040086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:18.040815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:18.049676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:18.050175 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:18.051476 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:18.052213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:18.052684 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:18.053129 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:18.059755 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45730. Oct 10 11:58:18.069936 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae54b8db-78d8-49ee-b350-67dfad20890c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45732. Oct 10 11:58:18.189004 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:18.197036 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-db4efcf1-8e0a-4ab8-8ce8-56bfce04a675 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.162941 Oct 10 11:58:18.197615 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3748/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:18 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:19.220576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:19.221173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:19.232012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:19.232493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:19.232927 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:19.233619 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:19.234098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:19.234519 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:19.238952 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45736. Oct 10 11:58:19.241945 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45738. Oct 10 11:58:19.367085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:19.375037 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c714e31b-fc38-44d6-b9a2-1ddf5f3637ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.158374 Oct 10 11:58:19.375618 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3640/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:19 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:20.397674 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:20.398305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:20.405144 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:20.405667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:20.406113 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:20.406808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:20.407305 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:20.407744 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:20.544429 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:20.552980 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-00510cca-d012-42d0-9e01-940174e6e1ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.159204 Oct 10 11:58:20.553559 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3749/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:20 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:21.576502 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:21.577122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:21.585013 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:21.585497 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:21.585933 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:21.586624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:21.587138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:21.587566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:21.724448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:21.732390 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38aa4415-1b06-49f6-be2d-bbbe012d7b7b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.159766 Oct 10 11:58:21.732971 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3641/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:21 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:22.755852 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:22.756389 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:22.763245 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:22.763743 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:22.764187 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:22.764884 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:22.765347 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:22.765808 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:22.900709 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:22.908482 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7a03cf4c-f87e-4764-b912-051322e2337e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.156808 Oct 10 11:58:22.909058 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3750/7391] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:22 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:23.932238 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:23.932851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:23.939718 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.940195 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.940680 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:23.942305 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:23.942765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:23.943219 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:24.072435 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:24.080568 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94694378-7c33-44ad-9a4a-2ac9626f1592 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.152241 Oct 10 11:58:24.081147 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3642/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:23 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:25.104377 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:25.105013 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:25.111770 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:25.112268 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:25.112722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:25.113634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:25.114100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:25.114539 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:25.242486 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:25.250235 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-59cc7517-8466-4314-afef-c8bc1434e9c1 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.149761 Oct 10 11:58:25.250804 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3751/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:25 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:26.272939 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:26.273567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:26.280900 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:26.281392 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:26.281829 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:26.282584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:26.283068 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:26.283500 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:26.418463 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:26.426894 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-688fd972-e759-4766-9a66-f0ac30c517eb tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.158031 Oct 10 11:58:26.427483 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3643/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:26 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 11:58:27.449885 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:27.450562 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:27.458438 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:27.458938 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:27.459413 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:27.460126 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:27.460595 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:27.461030 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:27.597379 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:27.605780 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a00c4ef0-7fe6-4322-9f72-31f4bb86ac7e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.159915 Oct 10 11:58:27.606361 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3752/7395] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:27 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:28.629661 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:28.630279 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:28.637251 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:28.637679 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:28.638116 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:28.638834 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:28.639356 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:28.639769 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:28.774416 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:28.782361 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99ddbec0-8f0a-4f7c-86ff-9b37972289c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.157184 Oct 10 11:58:28.782944 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3644/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:28 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:29.805862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:29.806523 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:29.814188 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:29.814752 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:29.815234 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:29.816574 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:29.817045 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:29.817482 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:29.950376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:29.959129 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-facab47a-e0a7-435f-a2bc-0f4826764f30 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.157152 Oct 10 11:58:29.959711 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3753/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:29 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:30.982867 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:30.983443 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:30.990897 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:30.991422 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:30.991862 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:30.992559 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:30.993026 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:30.993453 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.130085 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:31.138086 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2d857c1-3c02-4682-9be7-20ef49453b52 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1570 microversion: 2.1 time: 0.159203 Oct 10 11:58:31.138663 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3645/7398] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:30 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:31.161626 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:58:31.162231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:31.169093 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:31.169591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:31.170035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.170734 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:31.171237 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:31.171678 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.248667 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128800) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 11:58:31.313438 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-ba5f5551-1de2-4798-8587-b7eee92dd251 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "POST /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395/action" status: 202 len: 0 microversion: 2.1 time: 0.156567 Oct 10 11:58:31.314057 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3754/7399] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 11:58:31 2022] POST /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 11:58:31.322816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:31.323456 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:31.329656 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:31.330138 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:31.330573 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.331324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:31.332460 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:31.332883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.465558 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:31.473433 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76787876-a225-4000-aa1e-7725311180ee tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1518 microversion: 2.1 time: 0.154634 Oct 10 11:58:31.474014 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3646/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:31 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:31.803550 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "name": "network-vif-unplugged", "status": "completed", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:58:31.814955 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:31.815498 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:31.816540 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:31.828745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.compute.server_external_events [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] Unable to find a host for instance 94208657-3ebf-4cc1-8b49-aae844612395. Dropping event network-vif-unplugged {{(pid=128800) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 11:58:31.829661 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2c142898-f20b-4d11-a474-c2d37114233e req-b3f93ea0-066b-46d3-90dd-42c17f17990e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030170 Oct 10 11:58:31.830258 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3755/7401] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 11:58:32.497401 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:32.498016 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:32.505098 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:32.505578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:32.506030 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:32.506698 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:32.507189 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:32.507613 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:32.639820 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:32.648200 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-962c7f4a-b9b1-46e1-9508-23d425f3ddb0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1518 microversion: 2.1 time: 0.154613 Oct 10 11:58:32.648772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3647/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:32 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:33.672611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:33.673243 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:33.680970 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:33.681488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:33.681984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:33.682956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:33.683453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:33.683892 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:33.817814 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:33.825553 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-8e3a4623-6e0c-43e5-b5c2-b69df4095ce0 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1518 microversion: 2.1 time: 0.156929 Oct 10 11:58:33.826128 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3756/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:33 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:34.850549 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:34.851202 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:34.858194 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:34.858688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:34.859207 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:34.860038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:34.860506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:34.860936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:34.993776 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:35.001652 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66630dcf-2177-4549-b603-cc81539bc89f tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1518 microversion: 2.1 time: 0.156265 Oct 10 11:58:35.002230 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3648/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:34 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:36.026462 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:36.027035 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:36.033998 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:36.034506 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:36.034959 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:36.035707 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:36.036177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:36.036617 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:36.173001 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:36.181140 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f142203a-0efb-484c-a356-64db7f18ccf3 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1520 microversion: 2.1 time: 0.158685 Oct 10 11:58:36.181725 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3757/7405] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:36 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:37.205509 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:37.206119 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:37.213809 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:37.214296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:37.214763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:37.215494 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:37.215971 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:37.216397 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:37.356728 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:37.365171 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a909d66-a794-4357-9c48-3d5546e1bc23 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1520 microversion: 2.1 time: 0.163749 Oct 10 11:58:37.365772 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3649/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:37 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:38.388810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:38.389418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:38.396475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.396972 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.397420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.398137 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.398591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.399053 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.528653 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:38.537056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-c671d3c7-74f9-47a8-a323-d1c401d08b5e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1520 microversion: 2.1 time: 0.152186 Oct 10 11:58:38.537630 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3758/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:38 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:39.559910 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:39.560531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:39.568217 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:39.568711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:39.569152 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:39.569847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:39.570304 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:39.570734 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:39.710029 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:39.718265 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e99d3803-f662-4a87-9e3d-a73142bc746d tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1520 microversion: 2.1 time: 0.162280 Oct 10 11:58:39.718849 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3650/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:39 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:40.741994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:40.742676 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:40.749601 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:40.750176 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:40.750722 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:40.751526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:40.752062 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:40.752580 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:40.890271 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:40.898908 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a8a2bc5a-e0cc-4aed-acc8-b9b9d619e618 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1520 microversion: 2.1 time: 0.161065 Oct 10 11:58:40.899698 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3759/7409] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:40 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:41.921907 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:41.922636 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:41.931992 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:41.932491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:41.932931 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:41.933637 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:41.934091 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:41.934518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:42.184323 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:42.192682 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-843f3992-fdc6-45c1-966a-9c96366afdca tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.274733 Oct 10 11:58:42.193276 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3651/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:41 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:42.390018 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:58:42.401700 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:42.402339 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:42.402782 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:42.414503 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] Creating event network-changed:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h1-860687-2 Oct 10 11:58:42.420789 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-677e910e-a18f-4099-a831-c009c5a624f3 req-7f11250e-2a82-47b4-b210-0206219d8793 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033651 Oct 10 11:58:42.420789 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3760/7411] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:58:43.216624 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:43.217241 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:43.224508 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:43.224993 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:43.225428 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:43.226114 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:43.226567 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:43.226988 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:43.397466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:43.405342 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68c7ae45-3b2c-410c-a014-772731ff3b72 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.192622 Oct 10 11:58:43.406121 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3652/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:43 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:44.430654 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:44.431341 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:44.437517 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:44.438012 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:44.438459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:44.439198 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:44.439666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:44.440102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:44.571441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:44.575015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:44.580369 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-02e078c1-746e-43fd-9c73-7f373267c502 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.155004 Oct 10 11:58:44.580935 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3761/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:44 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:45.603751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:45.604373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:45.611371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:45.611865 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:45.612309 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:45.613646 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:45.614118 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:45.614552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:45.745917 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:45.753948 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71a325cb-cdc6-4ff8-adb4-42deb54b104b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.153935 Oct 10 11:58:45.754542 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3653/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:45 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:46.777751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:46.778317 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:46.780934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:46.787445 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:46.787943 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:46.788388 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:46.789086 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:46.789549 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:46.789985 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:46.926724 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:46.934575 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-e71ff6ed-29f3-4659-ab96-1def697cc3ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.161417 Oct 10 11:58:46.935164 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3762/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:46 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:47.957930 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:47.958542 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:47.961271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=31 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:47.966787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:47.967306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:47.967748 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:47.968447 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:47.968941 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:47.969371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:47.974099 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=91 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:48.145576 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:48.153365 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f0f3c5b-a1d0-4b84-b9f1-4b066a831e05 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.199887 Oct 10 11:58:48.153940 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3654/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:47 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:49.177044 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:49.177673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:49.184102 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:49.184607 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:49.185061 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:49.185772 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:49.186242 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:49.186686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:49.325346 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:49.334110 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a06d8b4c-615d-4faf-b090-f2d6043136d5 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.160967 Oct 10 11:58:49.334689 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3763/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:49 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:50.358006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:50.358729 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:50.365371 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:50.365863 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:50.366299 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:50.366991 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:50.367471 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:50.367898 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:50.500131 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:50.508523 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ed9d9b1-bdbe-4ae5-9443-165ecd1212c6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.154724 Oct 10 11:58:50.509102 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3655/7418] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:50 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:51.532024 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:51.532666 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:51.539757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:51.540261 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:51.540716 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:51.541450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:51.541923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:51.542393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:51.677326 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:51.685259 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a345b11f-5dc7-4d54-81a2-a392a3312f6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.157154 Oct 10 11:58:51.686147 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3764/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:51 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:52.709031 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:52.709564 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:52.716477 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:52.716969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:52.717413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:52.718104 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:52.718565 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:52.719014 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:52.850571 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:52.858327 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d61e20e7-607b-44c2-915c-d0d1d48d7d28 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.153857 Oct 10 11:58:52.858900 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3656/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:52 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:53.770793 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "name": "network-vif-plugged", "status": "completed", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 11:58:53.781450 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:53.781950 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:53.782415 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:53.794411 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] Creating event network-vif-plugged:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h1-860687-2 Oct 10 11:58:53.799565 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-f8b1e874-bd4b-4c2a-9e1b-a02563c8c46c req-6c54a92d-89aa-4f29-8558-e1fbb250f17f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Oct 10 11:58:53.800183 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3765/7421] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 11:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:58:53.882603 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:53.883278 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:53.890255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:53.890777 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:53.891458 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:53.892160 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:53.892621 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:53.893064 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:54.079840 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:54.087743 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77464862-53fb-4215-8588-9abb70cfd11e tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1576 microversion: 2.1 time: 0.209449 Oct 10 11:58:54.088322 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3657/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:53 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 11:58:55.115692 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:55.116436 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 11:58:55.122608 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:55.123146 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:55.123603 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:55.124316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:55.124791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:55.125231 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:55.256813 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 11:58:55.264549 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-37fd9771-3227-4d43-9452-548e479165d6 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1563 microversion: 2.1 time: 0.156133 Oct 10 11:58:55.265124 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3766/7423] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 11:58:55 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:08.700883 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=9 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.703376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.704551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=26 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.705250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=23 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.706588 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:00:08.706735 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 12:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 (ip 10.222.0.16) !!! Oct 10 12:00:08.709753 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:00:08.709890 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 12:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 10 12:00:08.711743 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:00:08.711872 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 12:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 (ip 10.222.0.16) !!! Oct 10 12:00:08.716984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:08.737237 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:08.737742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:08.749324 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:08.749817 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:08.749984 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:08.750253 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:08.750376 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:08.750819 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:08.750936 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:08.751419 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:08.751844 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:08.765393 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] Creating event network-changed:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h1-860687-2 Oct 10 12:00:08.770679 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-47e8aee4-6e44-456a-a0ee-c1ff5d8230e7 req-d08bc22d-bf55-4645-85a2-3e25e032f364 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072528 Oct 10 12:00:08.772092 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3767/7424] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:08.779706 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:00:08.869937 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5725b5f1-9268-4a62-a32c-6410c86b1f14 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "DELETE /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 204 len: 0 microversion: 2.1 time: 0.172156 Oct 10 12:00:08.869937 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3658/7425] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 12:00:08 2022] DELETE /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:00:08.879154 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:08.880149 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:08.888407 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:08.889141 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:08.889764 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:08.890671 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:08.891406 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:08.892011 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:09.029375 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:09.037590 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-94b3f0df-0319-42fb-9dd9-f056193127ce tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.163046 Oct 10 12:00:09.038264 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3768/7426] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:08 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:10.062181 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:10.063089 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:10.069999 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.070491 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.070937 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.071675 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.072129 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.072562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.221742 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:10.230130 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cccc75b6-bef2-43fe-83d1-232c02e3ab6b tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1569 microversion: 2.1 time: 0.172235 Oct 10 12:00:10.230709 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3659/7427] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:10 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:10.886553 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94208657-3ebf-4cc1-8b49-aae844612395", "name": "network-vif-deleted", "tag": "152d2e52-77bb-467a-b56e-5108f3f5e7da"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:10.896953 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:10.897453 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:10.897905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:10.909143 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] Creating event network-vif-deleted:152d2e52-77bb-467a-b56e-5108f3f5e7da for instance 94208657-3ebf-4cc1-8b49-aae844612395 on n-h1-860687-2 Oct 10 12:00:10.914172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-2475e265-d991-4cb5-b939-585e21962cb4 req-375c6bca-7f0f-4b1b-9f9a-1e7b3cb15bcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084777 Oct 10 12:00:10.914766 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3769/7428] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:11.253837 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:11.254461 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:11.261557 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.262053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.262493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.263280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:11.263744 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:11.264177 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:11.326849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:11.335685 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-307c9232-3a0e-448c-aae8-b99024f89249 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1219 microversion: 2.1 time: 0.085765 Oct 10 12:00:11.336270 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3660/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:11 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:12.360637 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:12.361475 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:12.368397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.368905 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.369397 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.370156 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:12.370631 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:12.371105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:12.437994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:12.447559 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-eae4835b-f109-4b6a-93e3-0973ffaae3c4 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1219 microversion: 2.1 time: 0.092224 Oct 10 12:00:12.448165 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3770/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:12 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:13.471966 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:13.472736 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:13.479652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.480133 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.480566 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:13.481250 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:13.481704 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:13.482178 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:13.546393 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:13.554927 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-320e7b95-b1b4-4095-a990-8eda9c0893d8 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1219 microversion: 2.1 time: 0.086928 Oct 10 12:00:13.555544 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3661/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:13 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:14.578323 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:14.579232 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:14.586393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:14.586890 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:14.587365 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:14.588078 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:14.588547 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:14.588986 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:14.654812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39327f171a7b45e2890043720fe24000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dab82014b634fc682ab38d61f5a648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:14.663404 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-f5953969-6e80-4fd8-8ee5-cc2e03613584 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 200 len: 1219 microversion: 2.1 time: 0.088971 Oct 10 12:00:14.663989 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3771/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:14 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:15.687053 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:15.687671 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] [instance: 94208657-3ebf-4cc1-8b49-aae844612395] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:15.695277 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:15.695763 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:15.696199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:15.696920 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:15.697373 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:15.697796 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:15.711956 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] HTTP exception thrown: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Request method failure captured: Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 HTTP/1.1 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Accept: application/json Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Connection: close Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Content-Length: 0 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Content-Type: application/json Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Host: 10.222.0.16 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjRAdFy8YJLlnJ0T3Fkzo_QXam-rkUnSlMYVPKf4SDT38-wEtBMqNB-Lan5y8FczFKTrKqnFOvOloaMrt6yeg_2C_mDc5o_83Lwzs-tDsQe12-yMzAAfyjpv9kp7Z-2-DahG7GjJ87udeRPUSo3Mh_L85GHR1agOUsQmbvCGP4Yflwghk Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Id: None Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Domain-Name: None Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Id: 9dab82014b634fc682ab38d61f5a648b Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Project-Name: tempest-TestShelveInstance-1866318891 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Role: member,reader Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Roles: member,reader Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dab82014b634fc682ab38d61f5a648b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9dab82014b634fc682ab38d61f5a648b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9dab82014b634fc682ab38d61f5a648b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9dab82014b634fc682ab38d61f5a648b"}]}] Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant: tempest-TestShelveInstance-1866318891 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Id: 9dab82014b634fc682ab38d61f5a648b Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestShelveInstance-1866318891 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-User: tempest-TestShelveInstance-1866318891-project Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-User-Id: 39327f171a7b45e2890043720fe24000 Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: X-User-Name: tempest-TestShelveInstance-1866318891-project Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: method: > Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: exception: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: action_args: {'id': '94208657-3ebf-4cc1-8b49-aae844612395'} Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:00:15.713669 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Returning 404 to user: Instance 94208657-3ebf-4cc1-8b49-aae844612395 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18c536d7-e424-4f57-b57f-afd7444b24ff tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395" status: 404 len: 111 microversion: 2.1 time: 0.031975 Oct 10 12:00:15.722039 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3662/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:15 2022] GET /compute/v2.1/servers/94208657-3ebf-4cc1-8b49-aae844612395 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:00:15.881140 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-33f32529-482e-4f68-8104-5d62dc189014 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] Calling method '.version_select at 0x7f677c0498b0>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:15.909655 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-33f32529-482e-4f68-8104-5d62dc189014 tempest-TestShelveInstance-1866318891 tempest-TestShelveInstance-1866318891-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1578255422" status: 202 len: 0 microversion: 2.1 time: 0.032375 Oct 10 12:00:15.910307 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3772/7434] 10.222.0.16 () {58 vars in 1254 bytes} [Mon Oct 10 12:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1578255422 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:00:33.454773 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.455984 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.682470 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-153274ce-495e-461c-aa54-c9b97ce502ca tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Action: 'create', calling method: .version_select at 0x7f67777e99d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2037906065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1U56xEfHuKYEJisalQ0A83O5yx6PARiMdo+ZopwYUPFUa1XlOXFerhf15AaSiiis5kjL+sDpR5TEdVgZeah5bVVZe1kw2pl99uxaGnsmS/qc3Bov8PXRzJB3Xdd8oZ5w=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:33.699498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-153274ce-495e-461c-aa54-c9b97ce502ca tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:00:33.705735 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-153274ce-495e-461c-aa54-c9b97ce502ca tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for user e2440922d699499f9545dbb3316eaa81 and project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:00:33.740201 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-153274ce-495e-461c-aa54-c9b97ce502ca tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.291216 Oct 10 12:00:33.743215 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3663/7435] 10.222.0.16 () {60 vars in 1159 bytes} [Mon Oct 10 12:00:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:34.751209 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=22 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.751980 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.756894 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1904032583", "imageRef": "b0df75aa-6a93-408c-bf0f-07593ca7536c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2037906065", "security_groups": [{"name": "tempest-secgroup-smoke-1173818501"}], "networks": [{"uuid": "415c398e-9bb3-4d62-a7db-807e5c077e4d"}]}} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:34.867362 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.network.neutron [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] validate_networks() for [('415c398e-9bb3-4d62-a7db-807e5c077e4d', None, None, None, None, None)] {{(pid=128800) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:00:35.291287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Flavor limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:00:35.291815 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Image limits 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:00:35.293043 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Flavor pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:00:35.293577 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Image pref 0:0:0 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:00:35.294089 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.virt.hardware [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128800) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:00:35.304131 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:35.304645 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:35.305170 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:35.305994 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:35.306548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:35.307177 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:35.326545 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:00:35.332501 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.quota [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for user e2440922d699499f9545dbb3316eaa81 and project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=128800) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:00:35.346594 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Going to run 1 instances... {{(pid=128800) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:00:35.349618 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0df75aa-6a93-408c-bf0f-07593ca7536c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128800) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:00:35.405024 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-4c1fa71a-da63-41e0-b5db-6ea4fe1f9c9b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.655615 Oct 10 12:00:35.405690 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3773/7436] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 12:00:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:00:35.417368 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-037c2cc3-839c-407b-ace3-12cc03b0067f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:35.418672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-037c2cc3-839c-407b-ace3-12cc03b0067f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:35.498108 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-037c2cc3-839c-407b-ace3-12cc03b0067f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:35.511595 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-037c2cc3-839c-407b-ace3-12cc03b0067f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1249 microversion: 2.1 time: 0.097551 Oct 10 12:00:35.512201 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3664/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:35 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:36.537289 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:36.537923 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:36.544227 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:36.544731 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:36.545184 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:36.546719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:36.546719 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:36.546963 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:36.612644 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:36.620350 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-cfaf02ac-a797-430c-ac56-90ebe0d1f29b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1301 microversion: 2.1 time: 0.088576 Oct 10 12:00:36.620932 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3774/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:36 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:37.642849 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:37.643485 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:37.651819 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:37.652579 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:37.653199 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:37.654061 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:37.654672 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:37.655339 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:38.008283 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:38.025832 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf5e3772-85c8-43a7-9b7a-62c47678a79a tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.386706 Oct 10 12:00:38.026676 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3665/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:37 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:38.345414 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:38.371790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:38.372284 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:38.372732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:38.386065 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] Creating event network-changed:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:00:38.393841 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7adaf6bc-7ce3-477c-abd7-cc7769b39ce8 req-ad4021d4-280c-4d2b-817e-30912296771b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052225 Oct 10 12:00:38.394538 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3775/7440] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:39.054781 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:39.055381 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:39.062043 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:39.062522 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:39.062953 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:39.063658 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:39.064113 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:39.064552 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:39.204883 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:39.213048 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a576a5e-5392-4e08-9ccb-37abdc23dd18 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.162832 Oct 10 12:00:39.213691 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3666/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:39 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:40.238315 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:40.239103 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:40.246036 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:40.246542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:40.246990 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:40.247727 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:40.248204 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:40.248658 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:40.431958 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:40.439564 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-1ff54a76-65ab-42e6-b95f-1bb83b44780f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.207030 Oct 10 12:00:40.440131 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3776/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:40 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:41.462602 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:41.463300 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:41.470028 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:41.470506 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:41.470935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:41.471644 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:41.472096 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:41.472518 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:41.607086 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:41.614761 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87d1dd1c-0913-4ac4-94d0-5b6e996d77b5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.156177 Oct 10 12:00:41.616030 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3667/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:41 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:42.638147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:42.638571 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:42.645551 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.646057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.647015 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.647745 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:42.648216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:42.648665 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:42.789330 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:42.797145 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-dfda3e18-7f9e-4d0e-8850-07011a140791 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.163137 Oct 10 12:00:42.797931 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3777/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:42 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:43.820049 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:43.820580 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:43.827493 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.827978 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.828420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.829367 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:43.829826 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:43.830255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:43.962066 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:43.969786 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2db9fa4-95fa-443e-b8ad-badf0bea87d2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.154236 Oct 10 12:00:43.970353 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3668/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:43 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:44.461757 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "name": "network-vif-plugged", "status": "completed", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:44.475524 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:44.476019 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:44.476488 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:44.487293 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] Creating event network-vif-plugged:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:00:44.492542 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-7035254d-12cf-43d7-9153-2cd37ef70a2c req-16b2aa4a-3c54-4653-a6f0-64c45a473eb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096581 Oct 10 12:00:44.493133 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3778/7446] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:44.993609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:44.994226 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:45.001055 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:45.001544 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:45.001983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:45.002692 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:45.003176 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:45.003607 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:45.133969 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:45.141637 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6af16cc-4e1c-49d9-8cb3-3cf76421cb33 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1375 microversion: 2.1 time: 0.152463 Oct 10 12:00:45.142206 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3669/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:44 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:46.161428 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:46.163285 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=6 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:46.168630 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:46.169349 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:46.176105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.176612 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.177075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.178947 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.179459 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.179912 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.317269 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:46.325056 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-fd59c3c1-6f67-4bf6-94f2-5f885d8c4c8e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1559 microversion: 2.1 time: 0.164658 Oct 10 12:00:46.325639 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3779/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:46 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:46.347577 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:46.348218 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:00:46.350727 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:46.356791 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.357280 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.357715 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.358407 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:46.358861 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:46.359314 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:46.493935 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:00:46.501734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f84fede5-144f-4a09-964b-1b4d767a219e tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1559 microversion: 2.1 time: 0.158079 Oct 10 12:00:46.502310 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3670/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:00:46 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:48.234180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:48.244180 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:00:48.244771 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:00:48.245298 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:00:48.257306 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] Creating event network-changed:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:00:48.262447 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1696d479-a560-4af1-9e10-23f76f69502b req-1dabdd51-79ae-4cbd-becf-d4107e4b7844 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086282 Oct 10 12:00:48.263145 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3780/7450] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:43.300158 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 12:02:43.301271 n-d-860687-2 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 10 12:02:43.301787 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:43.302589 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:43.308498 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-73258584"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:43.310782 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:43.318315 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:43.318799 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:43.319270 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:43.319962 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:43.320420 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:43.320847 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:43.521734 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9d8c73c-4280-42ce-b9da-4f1e49bc1377 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "POST /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df/action" status: 202 len: 0 microversion: 2.1 time: 0.223308 Oct 10 12:02:43.522376 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3671/7451] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 12:02:43 2022] POST /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 12:02:48.869144 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae54b8db-78d8-49ee-b350-67dfad20890c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 12:02:48.872134 n-d-860687-2 devstack@n-api.service[128800]: ERROR oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 12:02:48.873031 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:48.874335 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=32 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:48.876189 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 10 12:02:48.876389 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 12:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 10 12:02:48.898033 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "name": "network-vif-plugged", "status": "completed", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:48.912791 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:48.914568 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:48.915960 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:48.935683 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] Creating event network-vif-plugged:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:02:48.941593 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-8ba88248-8c65-4ead-ad98-5d3638bd2684 req-f5cac59b-2fde-40c0-a2a9-2ad3a2935985 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074619 Oct 10 12:02:48.942465 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3781/7452] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:57.065702 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:57.066524 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:57.071617 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-645626002", "imageRef": "dab84f0b-4c18-4338-9b17-195c8998bb05", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2037906065", "security_groups": [{"name": "tempest-secgroup-smoke-1173818501"}], "networks": [{"uuid": "415c398e-9bb3-4d62-a7db-807e5c077e4d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:02:57.096487 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed5604f8-0d77-4588-a218-a2c9c173e324] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46250. Oct 10 12:02:57.098971 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [84d1b2ac-492f-4ebe-bc1b-0d3256022989] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46248. Oct 10 12:02:57.184355 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] validate_networks() for [('415c398e-9bb3-4d62-a7db-807e5c077e4d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:02:57.607264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:02:57.607694 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:02:57.608173 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:02:57.608583 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:02:57.609025 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:02:57.617866 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:57.618349 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:57.618786 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:57.619546 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:57.620006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:57.620431 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:57.637691 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:02:57.642845 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Getting quotas for user e2440922d699499f9545dbb3316eaa81 and project 0cf24b916cb146d092f09f2adece9cf0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:02:57.656102 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:02:57.658593 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dab84f0b-4c18-4338-9b17-195c8998bb05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:02:57.707028 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7b57704-5e26-4037-8c9d-f541f9622590 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643375 Oct 10 12:02:57.707703 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3672/7453] 10.222.0.16 () {60 vars in 1147 bytes} [Mon Oct 10 12:02:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:02:57.725466 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [132fc685-6761-407b-a4e8-10c2d3647494] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46266. Oct 10 12:02:57.731882 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-6ddbf40d-589a-4adf-ba65-8ab4fec201e5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:57.732213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-6ddbf40d-589a-4adf-ba65-8ab4fec201e5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:57.740801 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae54b8db-78d8-49ee-b350-67dfad20890c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46264. Oct 10 12:02:57.849222 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-6ddbf40d-589a-4adf-ba65-8ab4fec201e5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:57.857450 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-6ddbf40d-589a-4adf-ba65-8ab4fec201e5 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1248 microversion: 2.1 time: 0.141708 Oct 10 12:02:57.858049 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3782/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:57 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1248 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:58.881950 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:58.882711 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:58.889750 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.890244 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.890688 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.891423 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:02:58.891886 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:02:58.892318 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:02:58.960914 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:02:58.970161 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d8e0bdd-217f-4047-9b46-7695fa7acdad tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1306 microversion: 2.1 time: 0.093354 Oct 10 12:02:58.985734 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3673/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:58 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:59.992797 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:59.993587 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:02:59.997311 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:00.003316 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.003827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.004333 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.005057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:00.005526 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:00.005965 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:00.147956 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:00.157555 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-833a5603-2c59-4f71-9cad-0469cc003e5f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.168569 Oct 10 12:03:00.158158 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3783/7456] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:02:59 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:01.023338 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:01.045159 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.045645 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.046081 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.060244 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] Creating event network-vif-unplugged:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:03:01.065666 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-77606ce4-bf6f-40c6-80f3-747720e03736 req-adf5038c-7793-48b2-89a7-9e010a4b2afa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046589 Oct 10 12:03:01.071399 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3674/7457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:01.181939 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:01.183948 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:01.191417 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.191922 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.192381 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.193464 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:01.194105 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:01.194715 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:01.346686 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:01.355521 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-26668ccb-7401-4fc7-8255-dfee5c574fed tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.177117 Oct 10 12:03:01.367045 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3784/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:01 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:02.379968 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:02.381609 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:02.389209 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:02.389701 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:02.390140 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:02.390846 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:02.391327 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:02.391753 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:02.536765 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:02.545304 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7ee3b36-2bb0-4164-b9ba-2f2a2ca81255 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.169428 Oct 10 12:03:02.545895 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3675/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:02 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:03.570075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:03.571521 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:03.579874 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.580421 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.580862 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.581598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:03.582075 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:03.582537 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:03.725611 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:03.733743 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-5481e314-eb95-4ab7-9832-1aae81582eac tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.167788 Oct 10 12:03:03.734340 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3785/7460] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:03 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:04.756584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:04.758214 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:04.766628 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.767264 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.767810 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.768650 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:04.769153 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:04.769663 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:04.916699 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:04.926294 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32417ac0-de20-4e7e-b376-92a1d3d86e37 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.173551 Oct 10 12:03:04.926881 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3676/7461] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:04 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:05.948749 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:05.949961 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:05.958393 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.958935 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.959420 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:05.960145 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:05.960619 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:05.961058 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:06.124282 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:06.132862 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-bb8a7c22-90ad-4fd6-bfdf-f397160c8037 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.188027 Oct 10 12:03:06.147203 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3786/7462] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:05 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:03:07.157860 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:07.158466 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:07.165358 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.165851 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.166291 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.167148 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.168294 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.168745 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.318751 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:07.326765 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31ff2d21-9942-4d25-84a0-074fd93da910 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.172807 Oct 10 12:03:07.327384 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3677/7463] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:07 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:07.471810 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:07.485914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:07.486591 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:07.487147 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:07.500455 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] Creating event network-changed:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:03:07.505921 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-68fbf525-aec6-4a5c-9825-bc7b20c3b3a1 req-8fd5cca6-8880-4c5a-baee-37172d7952c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038453 Oct 10 12:03:07.506544 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3787/7464] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:08.349683 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:08.350297 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:08.352295 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:08.353112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:08.360221 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.360710 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.361145 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.361841 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:08.362293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:08.362714 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:08.492965 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:08.501300 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-378e336d-ae16-4723-bc30-f9e056d99ba6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.155551 Oct 10 12:03:08.501873 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3678/7465] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:08 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:09.521712 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell0:SELECT=2 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:09.526795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:09.528216 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:09.535228 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.535738 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.536213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.537945 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:09.538430 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:09.538934 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:09.694215 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:09.703945 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-530ac1a0-252b-4ef1-b99b-75fb6efff90f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.183255 Oct 10 12:03:09.706435 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3788/7466] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:09 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:10.738752 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:10.739340 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:10.746158 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.746652 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.747115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.747798 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:10.748256 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:10.748678 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:10.881155 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:10.889085 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-509f9ec6-3c60-4812-abb8-e1803e726b11 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.154228 Oct 10 12:03:10.889678 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3679/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:10 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:10.992054 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "name": "network-vif-plugged", "status": "completed", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:11.003514 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:11.004150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:11.004598 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:11.016560 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] Creating event network-vif-plugged:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:03:11.021484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-611339b4-6bab-4ca2-9403-19943aea1498 req-f5ef3e1c-1f19-4ed0-9a2e-a4f139bd7f2f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033601 Oct 10 12:03:11.022324 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3789/7468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:03:11.913232 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:11.913811 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:11.920539 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:11.921017 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:11.921449 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:11.922127 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:11.922578 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:11.923010 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:12.051012 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:12.059722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92a436d6-4938-4ef3-8288-1e19b42decd8 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1374 microversion: 2.1 time: 0.149999 Oct 10 12:03:12.060303 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3680/7469] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:11 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:13.084951 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:13.085790 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:13.092287 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.092795 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.093252 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.093967 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.094441 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.094893 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.230855 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:13.238652 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-a44cbffb-2646-4b0a-9196-770af4abb3aa tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1558 microversion: 2.1 time: 0.158856 Oct 10 12:03:13.239275 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3790/7470] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:13 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:13.261203 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:03:13.262344 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:03:13.269478 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.269967 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.270406 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.271150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:13.271611 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:13.272041 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:13.406006 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:03:13.413722 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d603051b-7acc-4dfc-a19d-2ff5108ec3c6 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1558 microversion: 2.1 time: 0.156425 Oct 10 12:03:13.414298 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3681/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:03:13 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:03:15.336402 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:03:15.348673 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:03:15.349179 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:03:15.349634 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:03:15.362275 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] Creating event network-changed:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:03:15.367540 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-1808109d-cab6-4640-92b3-41ccc3c3ad3f req-4408c1e9-c592-41c7-b03f-786968699c80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037268 Oct 10 12:03:15.368097 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3791/7472] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:04:46.066517 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:46.067215 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=52 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:46.068237 n-d-860687-2 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:04:46.068389 n-d-860687-2 devstack@n-api.service[128801]: Mon Oct 10 12:04:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6/action (ip 10.222.0.16) !!! Oct 10 12:04:46.074673 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1799932348"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:46.077641 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:04:46.087961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:46.088448 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:46.088889 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:46.089584 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:46.090082 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:46.090537 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:46.470454 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcf56b58-6667-46e3-95ee-dc7b67c9672f tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "POST /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6/action" status: 202 len: 0 microversion: 2.1 time: 0.405843 Oct 10 12:04:46.471133 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3682/7473] 10.222.0.16 () {60 vars in 1278 bytes} [Mon Oct 10 12:04:46 2022] POST /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 12:04:53.490751 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_api:SELECT=24 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:53.491542 n-d-860687-2 devstack@n-api.service[128800]: DEBUG dbcounter [-] [128800] Writing DB stats nova_cell1:SELECT=42 {{(pid=128800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:53.493136 n-d-860687-2 devstack@n-api.service[128800]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:04:53.493475 n-d-860687-2 devstack@n-api.service[128800]: Mon Oct 10 12:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 10 12:04:53.498796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "name": "network-vif-plugged", "status": "completed", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:04:53.512301 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:04:53.513100 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:04:53.513548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:04:53.538483 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] Creating event network-vif-plugged:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:04:53.543914 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-e94ea027-5d83-41f2-b102-bf914c8ef7e0 req-1c928968-b04e-4b40-947a-993e0e0c9043 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055924 Oct 10 12:04:53.544760 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3792/7474] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:01.090115 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:01.091325 n-d-860687-2 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:01.095983 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:01.096447 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:01.096913 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:01.104507 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.104998 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.105432 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.106361 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.107040 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.107474 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.108911 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.109418 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.109987 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.122679 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] Creating event network-changed:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:05:01.129948 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-c023e248-aa45-49fb-812b-e4143e86f04b req-425e9cb2-c9f2-4731-a8ea-1b8afb79b47a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038902 Oct 10 12:05:01.130915 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3793/7475] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:01.136357 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:05:01.226228 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d418097-87bd-4b68-8eb6-557f425f307d tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 204 len: 0 microversion: 2.1 time: 0.137240 Oct 10 12:05:01.226968 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3683/7476] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:01 2022] DELETE /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:05:01.237461 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:01.238340 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:01.244742 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.245325 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.245854 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.246620 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:01.247213 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:01.247720 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:01.405199 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:01.413445 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-af17737b-3841-4b42-bbda-6bfeb6bd6ee0 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1683 microversion: 2.1 time: 0.180808 Oct 10 12:05:01.414038 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3794/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:01 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:02.438895 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:02.439614 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:02.446301 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:02.446784 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:02.447255 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:02.447943 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:02.448398 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:02.448816 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:02.589213 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:02.597485 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c48a87a-2e57-4683-a27a-ed185b73e636 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1683 microversion: 2.1 time: 0.163422 Oct 10 12:05:02.598047 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3684/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:02 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:03.190669 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88efe283-7627-4e57-8159-5975905394c6", "name": "network-vif-deleted", "tag": "9d348680-0248-4329-b100-fca21660309a"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:03.204206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.204812 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.205267 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.221668 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] Creating event network-vif-deleted:9d348680-0248-4329-b100-fca21660309a for instance 88efe283-7627-4e57-8159-5975905394c6 on n-h1-860687-2 Oct 10 12:05:03.227275 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-048d3509-429f-4c5e-ad5b-8f1c3bd3700e req-fb911b12-d482-42f4-bd69-582d84da027c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040993 Oct 10 12:05:03.227898 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3795/7479] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:03.621335 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:03.621954 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:03.629038 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.629523 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.629958 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.630655 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.631134 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.631562 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.666963 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:03.667531 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:03.667961 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:03.668413 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lazy-loading 'fault' on Instance uuid 88efe283-7627-4e57-8159-5975905394c6 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:03.713695 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:03.721359 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1cce7db-1257-475d-b388-eeda43056dcd tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 200 len: 1338 microversion: 2.1 time: 0.103981 Oct 10 12:05:03.721926 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3685/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:03 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:04.746765 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:04.747426 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 88efe283-7627-4e57-8159-5975905394c6] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:04.755174 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.755677 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.756125 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.756828 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:04.757297 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:04.757735 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:04.771484 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] HTTP exception thrown: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Request method failure captured: Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 HTTP/1.1 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAlc4wkdmXYEFoRryogO8HOm6nQwNkDsimpXQX1EajODPgmGrdrFsLDL1-pk3jGSj5VQYkCnfip8aOfK_vekYQuhesJmY7WeF9un2CE5HVyXUgHzhkwObpiK1ElSUAoIJ5cfbCbNa_iWUjgC-IAPTge64B1XX8kyR34gLevwVqX-vys Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0cf24b916cb146d092f09f2adece9cf0 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf24b916cb146d092f09f2adece9cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf24b916cb146d092f09f2adece9cf0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf24b916cb146d092f09f2adece9cf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf24b916cb146d092f09f2adece9cf0"}]}] Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0cf24b916cb146d092f09f2adece9cf0 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestSnapshotPattern-429793485-project Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e2440922d699499f9545dbb3316eaa81 Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestSnapshotPattern-429793485-project Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '88efe283-7627-4e57-8159-5975905394c6'} Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:04.773160 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Returning 404 to user: Instance 88efe283-7627-4e57-8159-5975905394c6 could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-7f36f65b-5ca4-4948-a292-e210b9f94927 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6" status: 404 len: 111 microversion: 2.1 time: 0.032070 Oct 10 12:05:04.778150 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3796/7481] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:04 2022] GET /compute/v2.1/servers/88efe283-7627-4e57-8159-5975905394c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:06.411293 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:06.411794 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:06.414085 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:06.424732 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.425748 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.426353 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.429668 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.431450 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.432146 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.432921 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.433376 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.433803 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.440303 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] Creating event network-changed:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:05:06.447172 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-ebdd7240-5a67-401a-a03b-292a46a6ca00 req-8ad08832-8208-465d-8707-30b8cd999ba0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036984 Oct 10 12:05:06.447907 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3797/7482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:06.462112 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:05:06.551651 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d54105b-fde4-400a-8568-87b441d64b8b tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 204 len: 0 microversion: 2.1 time: 0.144018 Oct 10 12:05:06.552622 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3686/7483] 10.222.0.16 () {58 vars in 1239 bytes} [Mon Oct 10 12:05:06 2022] DELETE /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:05:06.561069 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:06.561891 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:06.568909 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.569504 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.570057 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.570843 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:06.571416 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:06.571933 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:06.720988 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.policy [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128800) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:06.729036 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-43fa099f-908c-493b-823b-68af29a2d7ea tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1683 microversion: 2.1 time: 0.172131 Oct 10 12:05:06.729616 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3798/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:06 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:07.754538 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:07.755271 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:07.762308 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.762812 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.763303 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.764048 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:07.764513 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:07.764945 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:07.930150 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:07.938549 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb07dffa-11d7-4248-9da6-bd311d39c9e9 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1683 microversion: 2.1 time: 0.188431 Oct 10 12:05:07.939107 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3687/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:07 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:08.526796 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833620a5-bbdb-42bb-b481-3979018de1df", "name": "network-vif-deleted", "tag": "4fe94a23-0e74-48b5-96ba-d6da9ab562de"}]} {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:05:08.540148 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.540914 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.541367 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:08.553073 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.compute.server_external_events [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] Creating event network-vif-deleted:4fe94a23-0e74-48b5-96ba-d6da9ab562de for instance 833620a5-bbdb-42bb-b481-3979018de1df on n-h2-860687-2 Oct 10 12:05:08.557851 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [req-fe87df6f-8ea4-4be4-9a95-1a554b43a87a req-6e7933bc-5019-47b9-95bc-91536f136606 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035043 Oct 10 12:05:08.558474 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3799/7486] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Oct 10 12:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:08.963122 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:08.963790 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:08.970631 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.971163 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.971604 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:08.972306 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:08.972764 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:08.973191 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:09.005375 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:09.005857 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:09.006296 n-d-860687-2 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:09.006746 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lazy-loading 'fault' on Instance uuid 833620a5-bbdb-42bb-b481-3979018de1df {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:05:09.052092 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2440922d699499f9545dbb3316eaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf24b916cb146d092f09f2adece9cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:05:09.059136 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8eeb99c4-e860-4ed6-91cb-61f1b29cea85 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 200 len: 1339 microversion: 2.1 time: 0.099913 Oct 10 12:05:09.059715 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3688/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:08 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:05:10.082900 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '>' {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:10.083548 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.compute.api [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] [instance: 833620a5-bbdb-42bb-b481-3979018de1df] Fetching instance by UUID {{(pid=128800) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:05:10.091324 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.091837 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.092295 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.093014 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Acquiring lock "bed97504-010c-4a3b-9285-fc61eea1d980" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:10.093490 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:10.094502 n-d-860687-2 devstack@n-api.service[128800]: DEBUG oslo_concurrency.lockutils [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Lock "bed97504-010c-4a3b-9285-fc61eea1d980" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:10.112139 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.wsgi [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] HTTP exception thrown: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Request method failure captured: Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: request: GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df HTTP/1.1 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Accept: application/json Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Accept-Encoding: identity Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Connection: close Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Content-Length: 0 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Content-Type: application/json Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Host: 10.222.0.16 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: Openstack-System-Scope: None Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: User-Agent: python-urllib3/1.26.12 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Auth-Token: gAAAAABjRAlc4wkdmXYEFoRryogO8HOm6nQwNkDsimpXQX1EajODPgmGrdrFsLDL1-pk3jGSj5VQYkCnfip8aOfK_vekYQuhesJmY7WeF9un2CE5HVyXUgHzhkwObpiK1ElSUAoIJ5cfbCbNa_iWUjgC-IAPTge64B1XX8kyR34gLevwVqX-vys Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Id: None Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Domain-Name: None Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Identity-Status: Confirmed Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Is-Admin-Project: True Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Id: default Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Domain-Name: Default Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Id: 0cf24b916cb146d092f09f2adece9cf0 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Project-Name: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Role: member,reader Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Roles: member,reader Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf24b916cb146d092f09f2adece9cf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cf24b916cb146d092f09f2adece9cf0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cf24b916cb146d092f09f2adece9cf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cf24b916cb146d092f09f2adece9cf0"}]}] Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Id: 0cf24b916cb146d092f09f2adece9cf0 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-Tenant-Name: tempest-TestSnapshotPattern-429793485 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-User: tempest-TestSnapshotPattern-429793485-project Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Id: default Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-User-Domain-Name: Default Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-User-Id: e2440922d699499f9545dbb3316eaa81 Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: X-User-Name: tempest-TestSnapshotPattern-429793485-project Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: method: > Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: exception: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: action_args: {'id': '833620a5-bbdb-42bb-b481-3979018de1df'} Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: {{(pid=128800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:05:10.113827 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: ERROR nova.api.openstack.wsgi Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: DEBUG nova.api.openstack.wsgi [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Returning 404 to user: Instance 833620a5-bbdb-42bb-b481-3979018de1df could not be found. {{(pid=128800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: INFO nova.api.openstack.requestlog [None req-637487af-ed85-4714-92db-2757ee1d64a2 tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df" status: 404 len: 111 microversion: 2.1 time: 0.038001 Oct 10 12:05:10.119206 n-d-860687-2 devstack@n-api.service[128800]: [pid: 128800|app: 0|req: 3800/7488] 10.222.0.16 () {58 vars in 1236 bytes} [Mon Oct 10 12:05:10 2022] GET /compute/v2.1/servers/833620a5-bbdb-42bb-b481-3979018de1df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:10.306384 n-d-860687-2 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-969337f1-87c2-499d-aab0-a0d5639b2c1c tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] Calling method '.version_select at 0x7f677767cf70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:10.334820 n-d-860687-2 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-969337f1-87c2-499d-aab0-a0d5639b2c1c tempest-TestSnapshotPattern-429793485 tempest-TestSnapshotPattern-429793485-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2037906065" status: 202 len: 0 microversion: 2.1 time: 0.031278 Oct 10 12:05:10.334820 n-d-860687-2 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3689/7489] 10.222.0.16 () {58 vars in 1257 bytes} [Mon Oct 10 12:05:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2037906065 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)